auditing
5 notes, newest first.
Quipu: A Governed Bitemporal Knowledge Graph Store
The paper presents Quipu, an embeddable knowledge graph store designed to handle agent workloads more effectively than existing stores. Quipu reverses four common defaults of existing stores: it only accepts facts…
A Chain Is Only as Strong as Its Weakest Link: A Scoping Review of System Integration Audits in AI
A study reviews 58 AI audits that focus on system integration, finding that while few measures address integration-specific risks and significant gaps remain in traditional audit expectations, integration can be…
AISPA: User-Centric System Prompt Auditing for Large Language Model Applications
The paper introduces AISPA, a framework for auditing system prompts in AI systems to ensure user protection. The study analyzes 3,249 instructions from 88 commercial AI products and finds significant variation in…
Task-Conditional Faithfulness Auditing of Multimodal LLMs for Grid Diagnosis
The paper proposes a framework for auditing multimodal large language models used in grid diagnosis tasks to ensure they are using task-appropriate evidence. The framework compares self-reported reliance, behavior…
The Eticas AI Risk Taxonomy: Open Infrastructure for Operationalizing AI Audits
The paper introduces Eticas AI Risk Taxonomy v2.0.0, an open-source framework for operationalizing AI audits. It bridges the gap between identifying AI risks and executing audits by providing a method to measure and…
