Aiming at the problems of poor data storage security and high load pressure on data transmission server,a massive industrial big data parallel transmission and capacity expansion storage system is designed.The parallel transmission subsystem cooperates with each other through user interface module,wireless communication module and USB module,adopts FPGA parallel transmission technology,and carries out parallel high-speed transmission in the form of P2P after character coding based on Cyclone V series core processor.The capacity expansion storage subsystem removes the duplicate data collected by the interface by integrating dedup and map/reduce technology,and uses the big data security fault-tolerant algorithm to control the convergence and elasticity of data to realize the capacity expansion storage of big data.The experiment results show that the big data storage integrity of the system is high.It can realize stable parallel transmission of big data.The security of data storage is high, and the real-time load pressure of the server does not exceed 20% when large data is transmitted in parallel.
Key words
industrial big data /
big data /
parallel transmission /
expansion storage /
storage security /
server load
{{custom_sec.title}}
{{custom_sec.title}}
{{custom_sec.content}}
References
[1] 黄炜.卫星数据的分布式存储系统设计与验证[J].遥感信息,2020,35(5):70-75.
[2] 刘光亮,徐茜,徐辰生,等.烟叶生产大数据管理信息系统设计及应用[J].中国烟草科学,2019,40(2):95-101.
[3] 潘梁静.海上船舶目标图像多通道并行传输系统设计[J].舰船科学技术,2020,42(4):62-64.
[4] 张卫,丁金福,纪杨建,等.工业大数据环境下的智能服务模块化设计[J].中国机械工程,2019,30(2):167-173,182.
[5] 卞咸杰.大数据时代档案信息资源共享平台数据采集系统设计与应用[J].档案与建设,2020,382(10):27-31.
[6] 金宇.基于云计算环境的大数据兼容性存储系统设计[J].现代电子技术,2019,42(1):24-27.
[7] 王西超,高颂,浦乐,等.导弹全寿命周期大数据分布式存储系统研究[J].弹箭与制导学报,2020,40(5):11-15.
[8] 陈游旻,陆游游,罗圣美,等.基于RDMA的分布式存储系统研究综述[J].计算机研究与发展,2019,56(2):3-15.
[9] Singh A,Garg S,Kaur K,et al.Fuzzy-Folded Bloom Filter-as-a-Service for Big Data Storage in the Cloud[J].IEEE Transactions on Industrial Informatics,2019,15(4):2338-2348.