跳到正文
返回论文列表
cs.AI提交于 已译

未来软件中元访问的力量——以 LLM 聊天界面与 Chat AI 为例

The Power of Meta Access in the Software of the Future --- Demonstrated on LLM Chat UIs and Chat AI

Julian Kunkel · Ali Doosthosseini

中文摘要

聊天仍是许多大语言模型(LLM)任务的默认界面,即便 OpenCode 等智能体工具在编码与自动化上表现出色。但模型只能看到当前对话,看不到周围的工作区。研究探索元访问(meta access)——让助手获得对界面本身结构化、带权限的视图,并提出分级层次:功能引导;元数据、设置与偏好访问;对摘要和消息的检索、经确认的变更以及完整编排。元访问可将聊天客户端从众多屏幕变为查找、导航、组织与操作它的单一入口,同时带来接地、隐私、提示注入与信任方面的风险。通用智能体框架是运行时;由于它们能修改自身设置,元访问变得自反,需要单独的控制平面边界。研究以 Chat AI 客户端的 Meta Chat 原型为基础:从摘要、设置和相关消息构建有界上下文;将引用链接到对话、主题与角色;支持经确认、可逆的变更;提供可浏览的教程库;并以用户发起的对话形式推荐角色。通过以结构化形式暴露应用状态,元访问可将屏幕阅读器从控件描述扩展到语义化工作区操作。元访问由此把聊天从单一对话的窗口变为整个工作区的控制层,在不放弃用户控制的前提下将聊天推向智能体能力。随着助手嵌入 IDE、仪表盘、办公套件与操作系统,AI 时代的界面应暴露其状态与能力的结构化、带权限模型,最好通过类似调试器的接口开放其现有元模型。

关键要点

  1. 01问题:LLM 聊天界面只让模型看到当前对话,看不到周围工作区,限制了助手能力。
  2. 02方法:提出元访问分级层次,从功能引导到元数据访问、检索、确认变更与完整编排。
  3. 03实现:Meta Chat 原型构建有界上下文、链接引用、支持可逆变更并提供教程库与角色推荐。
  4. 04结果:元访问可将聊天变为整个工作区的控制层,并扩展屏幕阅读器到语义化操作。
  5. 05局限:带来接地、隐私、提示注入与信任风险,自反性需要单独的控制平面边界。

解读

尚无解读。

原始英文摘要

arXiv:2611.08428v1 Announce Type: new Abstract: Chat remains the default surface for many large language model (LLM) tasks, even as agentic tools such as OpenCode excel at coding and automation. Yet the model sees the current dialogue but not the workspace around it. We explore meta access---giving the assistant a structured, permissioned view of the interface itself and propose a ladder of levels: feature tutoring; metadata, settings, and preference access; retrieval over summaries and messages, confirmed mutation, and full orchestration. Meta access can turn a chat client from many screens into one entry point for finding, navigating, organising, and operating it, while raising risks around grounding, privacy, prompt injection, and trust. General-purpose agentic harnesses are runtimes; because they can change their own settings, meta access becomes reflexive and needs a separate control-plane boundary. We ground this in the Meta Chat prototype of the Chat AI client. It builds bounded context from, e.g., summaries, settings, and relevant messages; links references to conversations, topics, and personas; supports confirmed, reversible changes; offers a browsable tutorial library; and recommends personas as user-started conversations. By exposing application state in structured form, meta access can extend screen readers from widget descriptions to semantic workspace operations. Meta access thus turns chat from a window onto one conversation into a control layer for the whole workspace, extending chat toward agentic capability without surrendering user control. As assistants become embedded in IDEs, dashboards, office suites, and operating systems, AI-era interfaces should expose a structured, permissioned model of their state and capabilities, ideally by opening their existing metamodels through a debugger-like interface.

同方向论文 · cs.AI

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联工具 · 1

Product Hunt · AI 分类64

Cursor Remote Lite:手机远程控制电脑 Cursor 的应用

Cursor Remote Lite 让用户用手机远程控制电脑上的 Cursor,可在手机上回答 Agent 的问题、批准命令、分配任务、保持或撤销文件更改。支持本地、SSH 远程和 Agents 窗口,可切换模型和 effort,Agent 等待时推送通知。

推荐理由:原文给出了具体功能和使用场景,读者可以据此判断它能否解决自己的远程编程需求。

关联提示词 · 1

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Update Agent Permissions

# Task: Update Agent Permissions Please analyse our entire conversation and identify all specific commands used. Update permissions for both Claude Code and Gemini CLI. ## Reference Files - Claude: ~/.claude/settings.json - Gemini polic…