Adnan KhanAdnanProduct & AI
San Francisco Bay Area
Get in touch

Source note2 min read

Thinkink: 2D Spatial Ink-native Interaction with LLMs

Source

arXiv

arxiv.org/abs/2607.21468v1

Read the source

Source

Plain-Language Brief

The researchers propose Thinkink, a tool that allows users to interact with large language models (LLMs) using handwritten text or sketches on a shared canvas. The tool uses a semantic tree for ink interpretation and a lightweight UI for control. A three-stage process was followed in designing the tool: formative study, technical probe, and final study.

What the Document Says

  • The researchers propose a tool called Thinkink that integrates large language models (LLMs) into handwritten notes and sketches.
  • The tool visualizes LLM-generated responses as ink-like text and sketches on a shared canvas.
  • A semantic tree is used for ink interpretation in the tool.
  • A lightweight UI provides explicit control using a state machine.
  • The design of Thinkink was based on a three-stage process: formative study, technical probe, and final study.
  • The formative study involved 12 participants to examine current practices with conventional and digital inking methods.
  • The results from the formative study informed the technical probe for a diagnostic study involving 6 participants.
  • The diagnostic study identified usability and human-LLM interaction challenges.
  • The design of Thinkink was motivated by the findings from the diagnostic study.
  • A final study with 10 participants examined how people incorporate Thinkink into their ideation practices.
  • The researchers contribute design implications and a tool for ink-native LLM interaction.

Key Concepts Mentioned

  • Thinkink
  • Large Language Models (LLMs)
  • handwritten notes
  • sketches
  • shared canvas
  • semantic tree
  • lightweight UI
  • state machine
  • formative study
  • diagnostic study
  • final study

Claims Made by the Document

  • Thinkink integrates LLMs into handwritten notes and sketches.
  • The tool provides ink-like text and sketches visualization on a shared canvas.
  • A semantic tree is used for ink interpretation in Thinkink.

Evidence Used

  • The text states that the researchers propose Thinkink, a tool for integrating LLMs into handwritten notes and sketches.

Methods / Approach

UNKNOWN

Limitations Stated by the Authors

UNKNOWN

Limitations Noted by the Agent

Agent interpretation — not from the source.

UNKNOWN

Open Questions

UNKNOWN

Notes for Future Q&A

May include interpretation. Labeled where it does.

UNKNOWN

Raw Abstract / Excerpt

People often use handwritten notes and sketches to externalize ideas for ideation. To integrate large language models (LLMs) into this practice, we propose Thinkink. Prompts can be handwritten text or drawn sketches with LLM-generated responses visualized as ink-like text and sketches spatially integrated into a shared canvas. A semantic tree streamlines ink interpretation, and a lightweight UI provides explicit control using a state machine. The tool was designed using a three-stage process. A formative study (N=12) examined current practices with conventional and digital inking methods. The results informed a technical probe for a diagnostic study (N=6) identifying usability and human-LLM interaction challenges. This motivated the design of Thinkink, with a final study (N=10) examining how people incorporate it into their ideation practices. We contribute design implications and a tool for ink-native LLM interaction where the user and LLM write and draw in a shared 2D canvas.