user interface
4 notes, newest first.
Thinkink: 2D Spatial Ink-native Interaction with LLMs
The researchers proposed a new tool called Thinkink that integrates large language models (LLMs) into handwritten note-taking and sketching practices. The tool allows users to handwrite or draw on a shared canvas, with…
Thinkink: 2D Spatial Ink-native Interaction with LLMs
The researchers propose Thinkink, a tool that allows users to interact with large language models (LLMs) using handwritten text or sketches on a shared canvas. The tool uses a semantic tree for ink interpretation and a…
Plover: Steering GUI Agents through Plan-Centric Interaction
The paper introduces Plover, a system for GUI automation that makes task plans visible and editable by users, allowing them to supervise, correct, or intervene in the system's behavior. The system supports natural…
GUI agent: Guided Exploration of User-Sensitive Screens
This research presents a new agent called Guided Exploration of User-Sensitive Screens (GUI agent) designed to automate tasks within an open Graphical User Interface (GUI) environment. The GUI agent is intended to…
