基于RRAM的神经常微分方程网络全模拟架构设计

孙玉丽, 燕博南, 陶耀宇, 杨玉超

集成电路与嵌入式系统 ›› 2025, Vol. 25 ›› Issue (10) : 1-9.

PDF(12287 KB)
PDF(12287 KB)
集成电路与嵌入式系统 ›› 2025, Vol. 25 ›› Issue (10) : 1-9. DOI: 10.20193/j.ices2097-4191.2025.0066
封面文章

基于RRAM的神经常微分方程网络全模拟架构设计

作者信息 +

Design of RRAM-based fully analog compute-in-memory architecture for Neural ODEs

Author information +
文章历史 +

摘要

针对神经常微分方程网络推理在冯·诺依曼架构中面临“功耗墙”和“存储墙”瓶颈、在传统存内计算架构中因存在大量数/模、模/数转换而产生过多的时间和功耗开销等问题,提出一种基于RRAM的面向神经常微分方程网络的全模拟存内计算架构,能够实现纯模拟数据流的神经常微分方程网络推理。架构仿真工作在Cadence Virtuoso平台上完成,通过该平台对RRAM器件、阵列及其外围电路进行仿真与分析。架构测试工作基于40 nm工艺的RRAM测试平台和差分输入/输出PCB板,完成整个系统的功能验证。结合测试误差对神经常微分方程网络分类任务进行实验与评估,最终证明了该架构的功能性和可靠性,为后续的硬件实现和应用部署奠定了坚实基础。

Abstract

Neural ordinary differential equation (ODE) network inference in Von Neumann architectures faces problems like the "power wall" and "memory wall". Traditional in-memory computing architectures also suffer from excessive time and power consumption due to numerous digital-to-analog and analog-to-digital conversions. To address these issues, we propose a fully analog compute-in-memory architecture for Neural ODEs based on RRAM to achieve fully analog data flow in network inference. The simulation is completed on the Cadence Virtuoso platform, which includes RRAM device, array, and the peripheral circuits. The test is performed on a 40 nm RRAM test platform and differential input/output PCB, achieving functional verification of the entire system. Experiments and evaluations of the classification tasks of Neural ODEs are conducted with testing errors, ultimately proving the functionality and reliability of the architecture. This lays a solid foundation for subsequent hardware implementation and application deployment.

关键词

RRAM存内计算 / 神经常微分方程 / 全模拟数据流 / 架构设计

Key words

RRAM-based compute-in-memory / neural ordinary differential equation / fully analog data flow / architecture design

引用本文

导出引用
孙玉丽, 燕博南, 陶耀宇, . 基于RRAM的神经常微分方程网络全模拟架构设计[J]. 集成电路与嵌入式系统. 2025, 25(10): 1-9 https://doi.org/10.20193/j.ices2097-4191.2025.0066
SUN Yuli, YAN Bonan, TAO Yaoyu, et al. Design of RRAM-based fully analog compute-in-memory architecture for Neural ODEs[J]. Integrated Circuits and Embedded Systems. 2025, 25(10): 1-9 https://doi.org/10.20193/j.ices2097-4191.2025.0066
中图分类号: TN492 (专用集成电路)   

参考文献

[1]
LI Y. Research and application of deep learning in image recognition[C]// 2022 IEEE 2nd international conference on power,electronics and computer applications (ICPECA). IEEE, 2022:994-999.
[2]
PATWARDHAN N, MARRONE S, SANSONE C. Transformers in the real world:A survey on nlp applications[J]. Information, 2023, 14(4):242.
[3]
SZE V, CHEN Y H, YANG T J, et al. Efficient processing of deep neural networks:A tutorial and survey[J]. Proceedings of the IEEE, 2017, 105(12):2295-2329.
[4]
LANZA M, SEBASTIAN A, LU W D, et al. Memristive technologies for data storage,computation,encryption,and radio-frequency communication[J]. Science, 2022, 376(6597):eabj9979.
[5]
CHEN R T Q, RUBANOVA Y, BETTENCOURT J, et al. Neural ordinary differential equations[J]. Advances in neural information processing systems, 2018,31.
[6]
YAO P, WU H, GAO B, et al. Fully hardware-implemented memristor convolutional neural network[J]. Nature, 2020, 577(7792):641-646.
[7]
SAXENA V. A mixed-signal convolutional neural network using hybrid cmos-rram circuits[C]// 2021 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE, 2021:1-5.
[8]
HUNG J M, WEN T H, HUANG Y H, et al. 8-b precision 8-Mb ReRAM compute-in-memory macro using direct-current-free time-domain readout scheme for AI edge devices[J]. IEEE Journal of Solid-State Circuits, 2022, 58(1):303-315.
[9]
WEN T H, HSU H H, KHWA W S, et al. 34.8 a 22nm 16mb floating-point reram compute-in-memory macro with 31.2 tflops/w for ai edge devices[C]// 2024 IEEE International Solid-State Circuits Conference (ISSCC).IEEE, 2024,67:580-582.
[10]
GONG H, HE H, GAO B, et al. A 1-Mb Programming Configurable ReRAM Fully Integrating into a 32-Bit Microcontroller Unit[J]. IEEE Transactions on Circuits and Systems II:Express Briefs, 2023, 70(8):2734-2738.

责任编辑: 薛士然
PDF(12287 KB)

Accesses

Citation

Detail

段落导航
相关文章

/