arXiv Artificial Intelligence· Linfei Ji (Huazhong University of Science and Technology), Jiayun Li (Tsinghua University), Haozhao Wang (Huazhong University of Science and Technology), Siyu Jiang (Huazhong University of Science and Technology), Zehao Wang (Harbin Institute of Technology), Longtao Xiao (Huazhong University of Science and Technology), Yu-Jie Yuan (Huawei Technologies Ltd), Ruixuan Li (Huazhong University of Science and Technology)·· 18 小时前AI 评分31
TeachBack：用双向偏好优化实现同策略自蒸馏中的“学会教学”
TeachBack: Learning to Teach via Bidirectional Preference Optimization for On-Policy Self-Distillation
AI 导读
华中科技大学等团队提出 TeachBack，一个面向同策略自蒸馏（OPSD）的双向偏好学习框架，让模型不仅向 Teacher 学习，也学习 Teacher 应如何教学。
来源：arXiv Artificial Intelligence · arxiv.org