Field notes

2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.

Notes on user interface

4 notes

  1. Thinkink: 2D Spatial Ink-native Interaction with LLMs

    Source note · Jul 23, 2026 · large language models, user interface

    The researchers proposed a new tool called Thinkink that integrates large language models (LLMs) into handwritten note-taking and sketching practices. The tool allows users to handwrite or draw on a shared canvas, with…

  2. Thinkink: 2D Spatial Ink-native Interaction with LLMs

    Source note · Jul 23, 2026 · nlp, design, user interface

    The researchers propose Thinkink, a tool that allows users to interact with large language models (LLMs) using handwritten text or sketches on a shared canvas. The tool uses a semantic tree for ink interpretation and a…

  3. Plover: Steering GUI Agents through Plan-Centric Interaction

    Source note · Jul 16, 2026 · artificial intelligence, human-computer interaction, user interface

    The paper introduces Plover, a system for GUI automation that makes task plans visible and editable by users, allowing them to supervise, correct, or intervene in the system's behavior. The system supports natural…

  4. GUI agent: Guided Exploration of User-Sensitive Screens

    Source note · Jun 24, 2026 · artificial intelligence, machine learning, computer science

    This research presents a new agent called Guided Exploration of User-Sensitive Screens (GUI agent) designed to automate tasks within an open Graphical User Interface (GUI) environment. The GUI agent is intended to…

An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.