arXiv Artificial Intelligence· Chenyu Zhu, Ruoyu Zhao, Zhichao Lu·· 3 小时前AI 评分31
ResNSC:为 Transformer 异构资源分配引入残差上下文的神经谱容量方法
Neural Spectral Capacity with Residual Context for Heterogeneous Resource Allocation within Transformers
AI 导读
研究者提出 Residual-Aware Neural Spectral Capacity(ResNSC),用规格推导的统计参考刻画累积残差更新,并扩展 NSC-DP 为 ResNSC-DP,在资源预算下联合分配残差与前馈宽度。
来源:arXiv Artificial Intelligence · arxiv.org