Reddit · r/LocalLLaMA· /u/Distinct-Pie2389·· 3 小时前AI 评分24
Strata 0.1.44 及更早版本未设置 sampling 时会走 greedy 采样,导致模型循环
if you're on Strata before 0.1.45 and your client doesn't set sampling, you're running greedy
AI 导读
Strata 在 0.1.45 之前,若客户端请求未携带 sampling 块,会默认以 greedy 方式解码,导致模型出现循环。
来源:Reddit · r/LocalLLaMA · reddit.com