vision language model
6 notes, newest first.
When Are Reasoning-Based Guardrails Not Efficient? ResponseGuard: A Fast Vision-Language Guard for Real-Time Moderation
A new AI guardrail called ResponseGuard has been developed that can quickly and efficiently detect harmful responses from a vision-language model without needing to go through step-by-step reasoning, which makes…
A Learning-Rate-Gated Failure of GRPO in a Small Language and Vision-Language Model Web Agent: A Controlled Null and Its Mechanism
The research investigates the effectiveness of Reinforcement learning with verifiable rewards and Group Relative Policy Optimization (GRPO) on a small language and vision-language model web agent at scales ranging from…
Bridging Physical Reasoning and Task Generalization via Visual Action Outcome Reasoning Alignment
Researchers propose a new reward system called VAORA to improve the performance of vision-language models in interactive physical reasoning tasks. The proposed system aims to address two main issues: hallucinated…
Automating Potential-based Reward Shaping with Vision Language Model Guidance
In this research, the authors propose a new method called VLM-PBRS for automating potential-based reward shaping using vision language model (VLM) feedback. The goal is to help reinforcement learning agents learn from…
Automating Potential-based Reward Shaping with Vision Language Model Guidance
Researchers introduce a new framework called VLM-PBRS for automating potential-based reward shaping in reinforcement learning agents. The framework learns the potential function directly from vision language model…
Automating Potential-based Reward Shaping with Vision Language Model Guidance
In this research, the authors present a new framework called VLM-guided PBRS, which learns potential functions for reward shaping directly from vision language model (VLM) feedback. The goal is to address the…
