跳到正文
arXiv Computer Vision· Yiyang Du, Zhanqiu Guo, Haochen Zhang, Annabella Macaluso, Xin Ye, Liu Ren, Yonatan Bisk, Chenyan Xiong·· 3 小时前AI 评分31

EmbodiedMidtrain:通过中期训练弥合 VLM 与 VLA 之间的差距

EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training

AI 导读

研究者提出 EmbodiedMidtrain,通过中期训练弥合 VLM 与 VLA 之间的数据分布差距。该方法用轻量可学习邻近度估计器从大规模 VLM 数据池中筛选与 VLA 最对齐的样本,构建 EmbodiedMidtrain-1M 数据集,在 VLA 微调前对 VLM 进行中期训练。

来源:arXiv Computer Vision · arxiv.org