arXiv Artificial Intelligence· Zhiyong Cao, Hengjie Zhu, Yongxin Wang, Xuchen Li, Jintao Li, Shuxia Liu, Dunqiang Liu, Bo Wang, Kairan Zhang, Cong Lin, JiangDi Yu, Siyuan Liu, Sijia Yao, Yi-Liang Wei, Lingxu Ma, Aijia Wang, Anxin Chen, Zixian Wei, Xiang Ruan, Ruizhi Xu, Ruqian Shi, Baihua Xiao, Sicheng Zhou·· 2 小时前AI 评分43
TraceTrial-Bench:评测 AI 智能体框架可靠性与故障归因的新基准
Trial by Trace: Benchmarking AI Agent Harnesses for Reliability and Failure Attribution
AI 导读
研究者提出 TraceTrial-Bench,将智能体框架(harness)可靠性拆为上下文、执行、治理、生命周期、可观测性、工具与验证七个组件,并构建 95 个专家级机制导向任务。
来源:arXiv Artificial Intelligence · arxiv.org