跳到正文
arXiv Artificial Intelligence· Chenyu Zhu, Ruoyu Zhao, Zhichao Lu·· 3 小时前AI 评分31

ResNSC:为 Transformer 异构资源分配引入残差上下文的神经谱容量方法

Neural Spectral Capacity with Residual Context for Heterogeneous Resource Allocation within Transformers

AI 导读

研究者提出 Residual-Aware Neural Spectral Capacity(ResNSC),用规格推导的统计参考刻画累积残差更新,并扩展 NSC-DP 为 ResNSC-DP,在资源预算下联合分配残差与前馈宽度。

来源:arXiv Artificial Intelligence · arxiv.org