两个优于一个:优化在线平台的二元评分量表
Two is better than one: optimizing binary rating scales for online platforms
Liren Shan · Alec Sun · Jingyan Wang
中文摘要
在线平台常受评分虚高、信息量不足的困扰,可通过改进数据收集机制(如调整用户问题措辞)缓解。已有工作针对二元反馈优化单一评分量表,以区分物品固有质量。本文展示为不同用户使用不同评分量表的效果:首先证明设计者总能把单一量表拆成两个以提升物品排名;其次将多量表最优设计形式化为阈值等距分布的0-1阶跃函数序列;最后考虑自适应模型,后续量表可依赖先前用户与物品的响应,并按完整响应序列排名,证明自适应性带来指数级更强的区分能力。理论结果表明,使用多个评分量表能显著提升平台物品排名。
关键要点
- 01单一二元评分量表存在评分虚高、信息量不足的问题
- 02证明将单一量表拆分为两个总能提升物品排名
- 03多量表最优设计为阈值等距的0-1阶跃函数序列
- 04自适应量表依赖历史响应,区分能力指数级增强
解读
尚无解读。
原始英文摘要
arXiv:2611.23626v1 Announce Type: cross Abstract: Online platforms often struggle with inflated, uninformative user ratings. This issue can be mitigated by better design of the data collection mechanism, for example through changing the phrasing of user questions. Previous work optimizes a single rating scale to best distinguish the inherent qualities of items under binary feedback. In this paper, we demonstrate the power of utilizing different rating scales for different users. First, we show that a designer can always split a single rating scale into two to improve item rankings. Next, we formally characterize the optimal design of multiple scales as a series of 0-1 step functions whose threshold values are evenly spaced. Finally, we consider an adaptive model where subsequent rating scales can depend on the responses from previous users and items are ranked by their full sequence of responses, and show that adaptivity leads to exponentially greater distinguishing power. All in all, our theoretical results show that using multiple rating scales significantly improves item rankings on platforms.