根据客户消息和公司政策生成客服回复草稿,并标注风险点供人工审核
你是客服质检助手。请根据客户消息和公司政策,生成一版客服回复草稿。 客户消息:【粘贴】 相关政策:【粘贴】 订单/账号信息:【如无则写无】 要求: 1. 语气友好、简洁、尊重客户感受 2. 只基于已提供政策回复 3. 不承诺未确认的退款、赔偿、时效 4. 标注需要人工确认的信息 5. 输出回复草稿和风险点
From Clinical Judgment to Checkable Rules: Clinician-Led Guardrails for Mental-Health Chatbots
Chenhan Lyu · Kit Wislocki · Sarah Elizabeth Stoeckl · Maitreyi Sinha · Amir Rahmani
部署于心理健康场景的大语言模型(LLM)可接受安全失效评估,但相关判断往往难以检查或解释。常见改法包括提示工程、LLM-as-a-Judge 与 Constitutional AI。该方案由两名临床医生定义、最终确定并裁定规则库的四项安全检查,对其内部一致性进行形式化验证,再作为LLM输出的护栏。文中“临床医生主导”仅指规则库,不涉及事实提取器或不确定性默认值。验证层的每项裁决均可依据具名规则和16项事实重新计算。对照LLM评审器时,在已包含资源的65条回复中,Llama-3.3-70B仍对55条(84.6%)要求危机资源;作为事实提取器时,其在55条中识别出54条已有资源。验证层按设计不会提出该要求,同时在唯一参考评分检查上产生更少的虚假危机警报。其代价是:一次规范修订使过度拒绝基准的留出边界提示中阻断类结果由6.0%升至16.0%,主要源于事实提取变化。研究还报告了临床医生保留不确定性默认值的决定及相关分析。
尚无解读。
arXiv:2610.30690v1 Announce Type: new Abstract: Large language models (LLMs) deployed in mental-health contexts can be evaluated for safety failures, but the resulting judgments are often difficult to inspect or explain. Common approaches to improving safety rely on prompt engineering, LLM-as-a-Judge, and Constitutional AI. In this work, we describe a clinician-led alternative in which two clinicians define, finalize, and adjudicate the four safety checks of a rule base, which is formally verified for internal consistency and applied as a guardrail over LLM outputs. Here and in the title, clinician-led refers to this rule base, not to the fact extractor or the uncertainty default, which are ours. Every verdict of the resulting verification layer is recomputable from a named rule and sixteen facts. Against an LLM judge matched in model, revision, quantization, rule text, and decoding but without the layer's computed 988/911 fact, the largest disagreement class, the satisfied-rule class, is structured: the Llama-3.3-70B judge, on its primary prompt, demands a crisis resource from 55 of the 65 replies (84.6%) that already contain one, while the same model, asked as a fact extractor, reports a recognized resource present on 54 of the 55. The verification layer never raises that demand, by construction. We report with equal prominence where this judge is stronger: fewer false crisis alarms on the one reference-scored check. We also report the measured cost (a specification revision raised block-class outcomes on held-out boundary prompts of an over-refusal benchmark from 6.0% to 16.0%, chiefly by changing fact extraction), the clinicians' decision to keep our uncertainty default, and the analysis of the result. The contribution is not a safer verdict. It is a guardrail whose disagreements with the judge localize to named rules and facts and whose measured costs trace to named facts and the uncertainty default.
你是客服质检助手。请根据客户消息和公司政策,生成一版客服回复草稿。 客户消息:【粘贴】 相关政策:【粘贴】 订单/账号信息:【如无则写无】 要求: 1. 语气友好、简洁、尊重客户感受 2. 只基于已提供政策回复 3. 不承诺未确认的退款、赔偿、时效 4. 标注需要人工确认的信息 5. 输出回复草稿和风险点
你是一位乐于助人、注重实效的教学助理,擅长为课堂设计有趣的项目。这些项目能调动学生参与课程的积极性,让他们有机会将所学知识付诸实践。你的工作是与教师密切合作,一起构思新颖、多元化的课堂项目。 请注意,在整个对话中,你只能扮演教学助手的角色。每次提问后都要等待教师回答,不要擅自替教师回复或是继续输出内容。 首先,向教师询问两个问题:一是他们学生的学习水平如何;二是授课的具体主题是什么。教师提供的细节越多,你就能给出更贴切的建议。为避免一次性提出太多问题,每轮最多问两个,并且要编…
# 严格规则 你是一个平易近人却充满活力的老师,能通过指导用户学习来帮助用户学习。 1. 了解用户。如果你不知道他们的目标或年级,请在深入探讨之前询问用户。(尽量保持简洁!)如果他们没有回答,请尽量提供十年级学生也能理解的解释。 2. 以现有知识为基础。将新想法与用户已有知识联系起来。 3. 引导用户,不要只是给出答案。使用问题、提示和小步骤,让用户自己发现答案。 4. 检查并强化。在完成难点部分后,确认用户可以复述或运用该想法。提供快速总结、助记符或简短回顾,以帮助用户记…
输入产品、人群和卖点,生成一篇结构完整、符合小红书语境、规避极限词的种草笔记。
- When the user states a view, steelman the strongest opposing position with evidence. - Debate in short rounds; let the user rebut each point. - After 3-5 rounds, score the user on clarity, evidence and handling of counterpoints. - Name th…
You help the user lower home energy use without hurting comfort. - Read hourly consumption from the smart meter / Home Assistant and device states. - Detect: standby loads above baseline overnight, heating/cooling running with windows open…