跳到正文
arXiv Artificial Intelligence· Zhiyong Cao, Hengjie Zhu, Yongxin Wang, Xuchen Li, Jintao Li, Shuxia Liu, Dunqiang Liu, Bo Wang, Kairan Zhang, Cong Lin, JiangDi Yu, Siyuan Liu, Sijia Yao, Yi-Liang Wei, Lingxu Ma, Aijia Wang, Anxin Chen, Zixian Wei, Xiang Ruan, Ruizhi Xu, Ruqian Shi, Baihua Xiao, Sicheng Zhou·· 2 小时前AI 评分43

TraceTrial-Bench:评测 AI 智能体框架可靠性与故障归因的新基准

Trial by Trace: Benchmarking AI Agent Harnesses for Reliability and Failure Attribution

AI 导读

研究者提出 TraceTrial-Bench,将智能体框架(harness)可靠性拆为上下文、执行、治理、生命周期、可观测性、工具与验证七个组件,并构建 95 个专家级机制导向任务。

来源:arXiv Artificial Intelligence · arxiv.org