Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
9 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on multimodal
9 notes
GeoReform: Reflective Formalization Evolution for Multimodal Geometry Problem Solving
The preprint proposes GeoReform, which treats geometric formalization as an optimizable policy rather than a fixed parser output. It collects failed rollouts, diagnoses representation defects, and mutates how entities…
HRIL: Learning Multimodal Synergy via Higher-Order Tensor Modeling
The preprint frames multimodal synergy as higher-order dependence that can be lost by pairwise fusion. HRIL uses an empirical cross-moment tensor with Tucker decomposition and a synergy-aware regularizer. The authors…
VISTA: A Visual Harness for Reasoning in an Interactive World
The technical report introduces a visual harness that gives a multimodal model long-horizon visual context through direct perception, lossless visual memory, active retrieval, and input reorganization. The abstract…
WorldAuditBench: Interactive 3D World Auditing with Multimodal Agents
The preprint presents 213 anomaly tasks across 13 Unreal Engine 5 and three.js environments, covering five anomaly families. It evaluates five frontier models under a fixed exploration budget using VLA-led exploration…
C3M: Cross-Session Multimodal Memory Maintenance for Long-Horizon Tasks
The preprint proposes bounded query-blind memory for long-horizon tasks. It describes relation-aware updates for complementary and incompatible records, budgeted routing that selects index pages and expands source…
A Multimodal Dataset for Large Language Model Applications in the Energy Domain
The paper introduces a new open-access dataset called mAIEnergy which is a multimodal corpus designed to support Large Language Model (LLM) applications in the energy sector. It contains various types of data including…
Omni-Decision: A Progressive Evidence-State Agent System for Omni-Modal QA
The paper introduces Omni-Decision, a system aimed at answering questions where evidence is spread across multiple modalities like videos, audio, images, web pages, and computation results. The system maintains a…
Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing
The paper proposes a new multimodal agent called the Cognitive-structured Multimodal Agent. This agent is designed to improve long-horizon multimodal dialogue by externalizing visual information into an Episodic Visual…
Kamera: Unified Position-Invariant Multimodal KV Cache for Training-Free Reuse
Researchers propose a new method called Kamera for efficient use of KV cache by multimodal agents during reasoning iterations. The method avoids the need to re-encode from scratch and reduces the need for multiple…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
