Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
6 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on vision language model
6 notes
When Are Reasoning-Based Guardrails Not Efficient? ResponseGuard: A Fast Vision-Language Guard for Real-Time Moderation
A new AI guardrail called ResponseGuard has been developed that can quickly and efficiently detect harmful responses from a vision-language model without needing to go through step-by-step reasoning, which makes…
A Learning-Rate-Gated Failure of GRPO in a Small Language and Vision-Language Model Web Agent: A Controlled Null and Its Mechanism
The research investigates the effectiveness of Reinforcement learning with verifiable rewards and Group Relative Policy Optimization (GRPO) on a small language and vision-language model web agent at scales ranging from…
Bridging Physical Reasoning and Task Generalization via Visual Action Outcome Reasoning Alignment
Researchers propose a new reward system called VAORA to improve the performance of vision-language models in interactive physical reasoning tasks. The proposed system aims to address two main issues: hallucinated…
Automating Potential-based Reward Shaping with Vision Language Model Guidance
In this research, the authors propose a new method called VLM-PBRS for automating potential-based reward shaping using vision language model (VLM) feedback. The goal is to help reinforcement learning agents learn from…
Automating Potential-based Reward Shaping with Vision Language Model Guidance
Researchers introduce a new framework called VLM-PBRS for automating potential-based reward shaping in reinforcement learning agents. The framework learns the potential function directly from vision language model…
Automating Potential-based Reward Shaping with Vision Language Model Guidance
In this research, the authors present a new framework called VLM-guided PBRS, which learns potential functions for reward shaping directly from vision language model (VLM) feedback. The goal is to address the…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
