arXiv Artificial Intelligence· Siyang Wu, Weizhi Zhang, Chen Yang, Esther Xu Fei, Jorin Overwiening, Xu Pan, Jing Tang, Yixuan He, Kelvin C. Mo, Peiwen Li, Defu Cao, Xu Hu, Haixin Wang, Taoran Li, Haoming Li, Zheyuan Deng, Jingwen Zhang, Pengsong Zhang, Haichao Zhang, Guangze Luo, Yi Daniel Lu, Zihuai He, Chenxi Qiu, Dianzhuo Wang, Zhejian Peng, Shushu Liang, Wenyi Lu, Yifan Wang, Jintao Huang, Yijun Wang, Xiaomin Li, Yuexing Hao·· 2 小时前AI 评分31
PersonaScienceBench：用多样化模拟研究者评估科学智能体
PersonaScienceBench: Evaluating Scientific Agents with Diverse Simulated Researchers
AI 导读
PersonaScienceBench 是一个评估科学智能体与不同研究者协作能力的基准，包含来自五个基准、覆盖四个科学领域的 200 个任务。模拟研究者按 persona 画像提供上下文和反馈，任务目标与评分保持固定，智能体只能通过对话接触研究者偏好。
来源：arXiv Artificial Intelligence · arxiv.org