FIELD NOTES TOPIC

gui

2 notes, newest first.

  1. SkillLens: Visual Skill Cards for Retrieval-Augmented GUI Action Prediction and On-Policy Distillation

    Source note ·

    Researchers introduce Visual Skill Cards (VSCs), a new method for improving the decision-making abilities of computer agents in GUI environments. VSCs are memory representations that bind reusable procedures with…

  2. GUI agent: Guided Exploration of User-Sensitive Screens

    Source note ·

    The text discusses a paper that proposes a solution for a problem in Large Language Model (LLM) agents used within Graphical User Interface (GUI) environments. The current issue is that these agents, fine-tuned to…