Field notes
2,348 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
458 of 2,348 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on ai
458 notes, page 19 of 20
Accuracy and Satisfaction in Multi-Turn LLM Dialogues for NFR Assessment
Researchers evaluate the accuracy and quality of conversations between developers and a Language Model (LLM)-based agent in the context of Health Insurance Portability and Accountability Act (HIPAA) regulatory…
Decentralised AI Training and Inference with BlockTrain
The paper introduces Spheroid BlockTrain, a decentralized AI training protocol that partitions a model into independent blocks, each optimized on a local objective derived from the same global target. The protocol is…
DeepBD: A Grounded Agentic Workflow for Variant Prioritization and Diagnosis of Genetic Birth Defects
Researchers present DeepBD, an AI system designed to help diagnose genetic birth defects by prioritizing patient-specific candidate variants. The system uses a workflow with various components such as rule evidence…
EG-VQA: Benchmarking Verifiable Video Question Answering with Grounded Temporal Evidence
Researchers have developed a new benchmark called Evidence-Grounded Video Question Answering Benchmark (EG-VQA) to evaluate the performance of video question answering models. The benchmark is unique because it…
Governed Shared Memory for Multi-Agent LLM Systems
The paper proposes a solution for managing shared knowledge in multi-agent language model (LLM) environments. The authors identify four failure modes and introduce four primitives: scoped retrieval, temporal…
Grad Detect: Gradient-Based Hallucination Detection in LLMs
The authors present a new method called Grad Detect, which uses the internal gradient structure of Large Language Models (LLMs) during inference to detect hallucinations. This method outperforms confidence-based and…
Grading the Grader: Lessons from Evaluating an Agentic Data Analysis System
Researchers evaluated a multi-agent data analysis system called LAMBDA on numerical QRData tasks, using a three-layer human-AI grading cascade to assess its output. They found that both automated graders achieved high…
It's Complicated: On the Design and Evaluation of AI-Powered AAC Interfaces
The research paper discusses the complexities in evaluating AI-powered augmentative and alternative communication (AAC) interfaces, as people's needs can be multifaceted and nuanced. The authors propose six AAC problem…
LaGO: Latent Action Guidance for Online Reinforcement Learning
The paper 'LaGO: Latent Action Guidance for Online Reinforcement Learning' proposes a new framework called LaGO. This framework uses a pre-trained language model (LLM) as a guide to help with online policy optimization…
Paying to Know: Micro-Transaction Markets for Verified Product Information in Agentic E-Commerce
The authors propose a new approach for e-commerce where buyers can pay small amounts of money to access detailed, verified product information through micro-transaction markets. This system aims to reward genuine…
SAFARI: Scaling Long Horizon Agentic Fault Attribution via Active Investigation
Researchers have developed SAFARI, a framework that helps diagnose failures in autonomous agents by using a specialized toolbox for reading and searching trajectory segments and a persistent Short-Term Memory (STM) for…
Scaling Laws for Task-Specific LLM Distillation
This research provides empirical scaling laws for compressing Large Language Models (LLMs) specifically for certain domains, focusing on quantitative finance as the application domain. The study investigates the impact…
The Latent Bridge: A Continuous Slow-Fast Channel for Real-Time Game Agents
Researchers propose a new method called the Latent Bridge for real-time agents that can act quickly while still planning effectively, even under time constraints such as those found in video games. The method involves…
World Models in Pieces: Structural Certification for General Agents
The paper proposes a method to evaluate the understanding of an AI agent in a complex world model, focusing on situations where the agent's abilities are specialized. The authors argue that standard guarantees fail to…
AOHP: An Open-Source OS-Level Agent Harness for Personalized, Efficient and Secure Interaction
The paper presents the Android Open Harness Project (AOHP), an operating system level agent harness built on the Android Open Source Project. AOHP aims to treat AI agents as first-class OS actors, enabling adaptive…
HOLMES: Evaluating Higher-Order Logical Reasoning in LLMs
The paper introduces HOLMES, a new benchmark for evaluating higher-order symbolic reasoning in Large Language Models (LLMs). This benchmark is designed to test the models' ability to reason over rules, predicates…
Kamera: Unified Position-Invariant Multimodal KV Cache for Training-Free Reuse
Researchers propose a new method called Kamera for efficient use of KV cache by multimodal agents during reasoning iterations. The method avoids the need to re-encode from scratch and reduces the need for multiple…
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems
The paper presents Litmus, a system that creates evaluation metrics for AI pipelines by understanding the purpose of the code and asking questions about it. It was tested on three real AI pipelines and outperformed…
POTracker: Optimizing Large Language Models for Standard-Compliant Power Outage Report Generation
Researchers have developed POTracker, an optimized large language model (LLM) for generating power outage reports that follow strict formatting and structural rules required by energy-sector regulatory bodies in the…
RECALL: Recovery Experience Collection for Active Lifelong Learning in Vision-Language-Action Models
The paper proposes a new approach for training Vision-Language-Action (VLA) models through active, continual learning. This method aims to address the inefficiencies of traditional passive imitation learning by…
RS-Gen: A Multi-Stage Agentic Framework for Reasoning and Search-Augmented Image Generation
The paper introduces RS-Gen, a multi-stage image agent framework that aims to improve the performance of existing image generation and editing models by introducing a 'Questioning-and-Solving' closed-loop mechanism for…
Semantic Browsing: Controllable Diversity for Image Generation
Researchers have developed a new method for generating diverse images using text-to-image models. Instead of relying on stochastic variations within the model, they induce diversity directly at the text level. The…
Teaching LLMs String Matching, Backtracking, and Error Recovery to Deduce Bases and Truth Tables for the Combinatorially Exploding Bit Manipulation Puzzles
The paper presents a new approach to solve the NVIDIA Nemotron Model Reasoning Challenge's Bit Manipulation Puzzles, where the goal is to discover hidden rules for transforming binary strings. The approach avoids…
VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instruct
The paper presents VeriEvol, a framework for scaling reinforcement learning in visual mathematical reasoning. It addresses the challenge of maintaining reliable reward labels as data volume grows by treating scaling as…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
