Thinkink: 2D Spatial Ink-native Interaction with LLMs

Source

• Source name: arXiv
• Source kind: paper
• Authors / organization: Mohammad Hasan Payandeh, Daniel Vogel, Jian Zhao
• Venue: arXiv: cs.HC
• Published: 2026-07-23
• Collected: 2026-07-24
• URL: http://arxiv.org/abs/2607.21468v1
• PDF: https://arxiv.org/pdf/2607.21468v1
• DOI: UNKNOWN

Plain-Language Brief

Researchers propose 'Thinkink', a system that allows users to interact with large language models (LLMs) using handwritten notes and sketches, which are then visually integrated into a shared canvas. The system was developed through three stages: formative study, technical probe, and final study.

What the Document Says

• Researchers proposed a system called Thinkink for ink-native interaction with LLMs.
• Handwritten text and drawn sketches can be used as prompts in Thinkink.
• LLM-generated responses are visualized as ink-like text and sketches on the shared canvas.
• A semantic tree streamlines ink interpretation.
• The system provides a lightweight UI with explicit control using a state machine.
• The development of Thinkink was done through three stages: formative study, technical probe, and final study.
• In the formative study (N=12), current practices were examined using conventional and digital inking methods.
• A diagnostic study (N=6) was conducted for usability and human-LLM interaction challenges identification.
• The results from these studies led to the design of Thinkink.
• In the final study (N=10), the researchers examined how people incorporate Thinkink into their ideation practices.

Key Concepts Mentioned

• Thinkink
• large language models (LLMs)
• handwritten notes
• sketches
• semantic tree
• lightweight UI
• state machine

Claims Made by the Document

• Thinkink allows users to interact with LLMs using handwritten notes and sketches.
• The system provides a user-friendly interface for this interaction.

Evidence Used

• Proposing a new system called Thinkink
• Details of the system's features and development process

Methods / Approach

UNKNOWN

Limitations Stated by the Authors

UNKNOWN

Limitations Noted by the Agent

Agent interpretation — not from the source.

UNKNOWN

Open Questions

UNKNOWN

Notes for Future Q&A

May include interpretation. Labeled where it does.

UNKNOWN

Raw Abstract / Excerpt

People often use handwritten notes and sketches to externalize ideas for ideation. To integrate large language models (LLMs) into this practice, we propose Thinkink. Prompts can be handwritten text or drawn sketches with LLM-generated responses visualized as ink-like text and sketches spatially integrated into a shared canvas. A semantic tree streamlines ink interpretation, and a lightweight UI provides explicit control using a state machine. The tool was designed using a three-stage process. A formative study (N=12) examined current practices with conventional and digital inking methods. The results informed a technical probe for a diagnostic study (N=6) identifying usability and human-LLM interaction challenges. This motivated the design of Thinkink, with a final study (N=10) examining how people incorporate it into their ideation practices. We contribute design implications and a tool for ink-native LLM interaction where the user and LLM write and draw in a shared 2D canvas.