Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
36 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on computer vision
36 notes, page 1 of 2
Breaking the weakest link to evade vision language models
The authors investigate the vulnerability of Vision Language Models (VLMs) to adversarial attacks, which can disrupt or force the models' interpretation of visual inputs. They propose a gradient-based attack method…
UniTAC: Universal Task-Aware Compression via Weighted Distortion Measures
Researchers propose UniTAC, a universal image compression system for physical AI systems like autonomous vehicles and robots. The system can adapt to changing tasks without retraining, using task-specific importance…
Beyond Trial-and-Error: Agentic Optimization for Image-to-Video Adherence
Researchers present the 'Agentic Self-Improvement' framework to address challenges in professional workflows with modern Image-to-Video (I2V) models. The framework uses a two-stage approach: an iterative prompt…
DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigation
Researchers propose DreamFly, a framework for aerial vision-language navigation that addresses challenges like limited historical context, short planning horizons, and unreliable implicit termination. The framework…
Modern Backbones Improve Multi-task DETR for Mammography Classification and Lesion Localization
The study evaluates a multi-task DETR framework that simultaneously predicts the malignancy of mammogram images and locates lesions, using modern backbones such as ConvNeXtV2 and DINOv3. The results show that these…
NeuroRefiner: Morphology-Aware Multi-Agent Refinement for 3D Fluorescence Microscopy Neuron Segmentation
The study introduces a new method called NeuroRefiner for accurately segmenting neurons in 3D fluorescence microscopy images. The method overcomes challenges posed by the sparse and elongated morphology of neurons…
Open Evaluation Agent: Efficient and Promptable Evaluation of Visual Generative Models
Researchers present the Evaluation Agent framework, a system that efficiently evaluates visual generative models using human-like strategies. It decomposes evaluation requests into sub-aspects, generates prompts…
iARCS: Iterative Agentic RL for Controllable 3D Scene Generation
The paper presents iARCS, an iterative agentic reinforcement learning framework for enhancing the performance of synthetic 3D scene generators by adapting them to meet task-specific functional constraints, such as…
NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment
Researchers propose NSF-HRPT, a framework that uses a Neural Semantic Field (NSF) to model scene semantics, trajectory predictions, and probabilistic Time-to-Collision (TTC) distributions from simulation data. During…
EgoGenesis: Egocentric World-Action Modeling with Online Anchored Projective Memory and Action-3D RoPE
The authors present a method called EgoGenesis for creating synthetic manipulation videos for embodied AI using egocentric video. The method uses a pretrained video generation prior and introduces two geometry-aware…
Multimodal fusion of visual and morphometric features for avian bone classification
Researchers developed a framework that combines convolutional neural network-based image analysis with standardized morphometric data for classifying bird bones. The model achieved 86% accuracy in identifying skeletal…
GraphVid: Interactive Graph-Controllable Video Generation
The researchers introduce GraphVid, a model that generates interactive videos using structured interaction graphs, allowing for flexible and precise control. The model shows strong performance compared to Motion-I2V in…
HAS: Highlight-guided Attention Steering for Multimodal LLM Video Summarization
The paper proposes a new method called Highlight-guided Attention Steering (HAS) for video summarization using Multimodal Large Language Models (M-LLMs). HAS aims to enhance the understanding of videos by focusing…
O-VAD: Industrial Video Anomaly Detection through Object-Centric Tracking and Reasoning
Researchers have developed a new method for detecting abnormal objects and events in industrial settings using an object-centric tracking and reasoning approach. This method is designed to overcome the limitations of…
SGA: Plug&Play Geometric Verification for Educational Video Synthesis
Researchers have proposed a new tool called Symbolic Geometric Agent (SGA) to improve the spatial correctness and visual legibility of educational videos generated by Large Language Models (LLMs). The SGA intercepts…
UESF-Bench: Benchmarking and Probing for Unified Embodied Seeking and Following
The authors introduce the Unified Embodied Seeking and Following Benchmark (UESF-Bench), a new benchmark for embodied agents that allows them to search for and follow language-described targets in dynamic environments…
UR-VC: Unsupervised Robotic Value Correction for Time-Derived Progress Proxies
Researchers introduce an offline method called Unsupervised Robotic Value Correction (UR-VC) to correct time-derived progress labels used by modern robot learning systems. The method is based on a regularity in…
Evidence-Backed Video Question Answering
The authors propose Evidence-Backed Video Question Answering (E-VQA), a new task that requires models to not only provide answers but also the specific spatial and temporal evidence from videos. They introduce…
MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents
The paper introduces MM-ToolSandBox, a new evaluation framework for visual tool-calling agents. It supports multi-image, multi-turn tasks and offers a stateful execution environment with over 500 tools across 16…
MM-ToolSandBox: A Unified Framework for Evaluating Visual Tool-Calling Agents
Researchers introduce MM-ToolSandBox, a new evaluation framework for visual tool-calling agents. This framework supports over 500 tools across 16 application domains and can handle multi-image, multi-turn tasks with…
Vinci2: Providing Proactive Assistance in Continuous Egocentric Videos
The text discusses a new proactive assistance system named Vinci2, which provides assistance in continuous egocentric videos by considering the user's history, current activity, and whether help would be welcome. The…
OpenCoF: Learning to Reason Through Video Generation
The paper introduces OpenCoF, a framework that includes a new dataset and a fine-tuned video model for improving Chain-of-Frame (CoF) reasoning in video generation. The authors argue that existing models lack specific…
SLORR: Simple and Efficient In-Training Low-Rank Regularization
The paper introduces SLORR, a simple and efficient in-training low-rank regularization framework for neural networks. It aims to improve compressibility without significant accuracy loss, while avoiding the limitations…
When Prompts Ignore Structure: Graph-Based Attribute Reasoning for Calibrated VLMs
The paper proposes ARGTCA, a method to improve the calibration of Vision-Language Models (VLMs) by using Graph Attention Networks to capture inter-attribute dependencies and reduce overconfidence during test-time…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
