基于PF_RING的多核视频流高性能传输模型

李欣; 樊志杰; 曹志威; 胡正梁; 陈国梁

doi:10.13700/j.bh.1001-5965.2020.0076

基于PF_RING的多核视频流高性能传输模型

doi: 10.13700/j.bh.1001-5965.2020.0076

李欣^{1, 2},
樊志杰^{2, 3, 4, ,},
曹志威^{3, 4},
胡正梁^{3, 4},
陈国梁^{3, 4}

1.
中国人民公安大学信息技术与网络安全学院, 北京 100038
2.
安全防范技术与风险评估公安部重点实验室, 北京 100038
3.
公安部第三研究所信息安全技术部, 上海 200031
4.
上海辰锐信息科技公司, 上海 200031

基金项目:

国家重点研发计划 2018YFC0807105

详细信息

作者简介:
李欣男，博士，副教授。主要研究方向：网络安全、智能视频处理等

樊志杰男，博士，助理研究员。主要研究方向：网络安全、大数据安全、物联网安全、视频安全等

通讯作者:
樊志杰.E-mail:aaronzfan@126.com

中图分类号: TP399
计量
- 文章访问数: 1023
- HTML全文浏览量: 438
- PDF下载量: 164
- 被引次数: 0
出版历程
- 收稿日期: 2020-03-03
- 录用日期: 2020-04-24
- 网络出版日期: 2020-09-20

High-performance multi-core video stream transmission model based on PF_RING

LI Xin^{1, 2},
FAN Zhijie^{2, 3, 4
, ,},
CAO Zhiwei^{3, 4},
HU Zhengliang^{3, 4},
CHEN Guoliang^{3, 4}

1.
College of Information Technology and Network Security, People's Public Security University of China, Beijing 100038, China
2.
Key Laboratory of Security Prevention Technology and Risk Assessment of the Ministry of Public Security, Beijing 100038, China
3.
Department of Information Security Technology, The Third Research Institute of Ministry of Public Security, Shanghai 200031, China
4.
Shanghai Chenrui Information Technology Company, Shanghai 200031, China

Funds:

National Key R & D Program of China 2018YFC0807105

More Information

Corresponding author: FAN Zhijie.E-mail:aaronzfan@126.com

摘要

摘要:
在视频流高性能传输任务中，视频流量的传输问题已成为一个研究的热点。为此，提出了一种基于PF_RING技术的模型。通过使用PF_RING+TNAPI技术，并结合内存路由表、多核、多队列多线程等相关技术确保视频流的高性能传输。同时为了保证不同网域间共享视频数据的安全传输，提出了一种面向视频控制信令双向物理通道、视频流单向物理通道的视频传输模型。实验结果表明：所提方法在有效吞吐量、CPU使用率和平均误码率方面均取得了10%以上的提升。因此，所提方法通过采用PF_RING+TNAPI技术，同时结合视频传输模型，确保了共享视频数据传输的安全性和高效性。
- PF_RING+TNAPI /
- 内存路由表 /
- 视频控制信令 /
- 视频传输模型 /
- 多核多通道
Abstract:
The problem of video traffic transmission has become a research focus in the task of high-performance video stream transmission. In this paper, a model based on PF_RING is proposed to solve this problem. In this model, PF_RING+TNAPI technology, memory routing table, multi-core, multi-queue multi-threading and other related technologies are used to ensure the high-performance transmission of video stream. At the same time, in order to ensure the safe transmission of shared video data among different network domains, a video transmission model for video control signaling dual channel and video data single channel is proposed. The experimental results show that the performance of the proposed method has been increased by at least 10% in effective throughput, CPU utilization, and average bit error rate. Therefore, by fusing PF_RING+TNAPI technology and video transmission system model, the proposed method ensures the security and efficiency of shared video data transmission.
- PF_RING+TNAPI /
- memory routing table /
- video control signaling /
- video transmission model /
- multi-core and multi-channel

HTML全文

图 1 视频传输系统部署架构

Figure 1. Deployment framework of video transmission system

下载: 全尺寸图片幻灯片

图 2 传统协议栈与PF_RING工作机制的比较

Figure 2. Comparison of working mechanism between traditional protocol stack and PF_RING

下载: 全尺寸图片幻灯片

图 3 PF_RING+TNAPI的实现机制

Figure 3. Implementation mechanism of PF_RING+TNAPI

下载: 全尺寸图片幻灯片

图 4 PF_RING零拷贝的实现机制

Figure 4. Implementation mechanism of PF_RING zero-copy

下载: 全尺寸图片幻灯片

图 5 视频传输系统的视频流传输

Figure 5. Video stream transmission of video transmission system

下载: 全尺寸图片幻灯片

图 6 SnifferThread服务框架

Figure 6. Service framework of SnifferThread

下载: 全尺寸图片幻灯片

图 7 测试环境拓扑

Figure 7. Topology of test environment

下载: 全尺寸图片幻灯片

图 8 有效吞吐量对比

Figure 8. Comparision of effective throughput

下载: 全尺寸图片幻灯片

图 9 CPU使用率对比

Figure 9. Comparision of CPU utilization

下载: 全尺寸图片幻灯片

图 10 平均误码率对比

Figure 10. Comparision of average bit error rate

下载: 全尺寸图片幻灯片

表 1 DataNetPortVsas的数据结构

Table 1. Data structure of DataNetPortVsas

属性名	数据类型	属性描述
timelast	time_t	数据报文时间戳
proxyType	IPProxyType	应用层协议类型
netSrcIPPort	NetIPPort	码流的视频源IP地址和端口
setNetDstIPPort	std::set〈NetIPPort〉	码流的视频目标IP地址和端口集合

下载: 导出CSV

参考文献(18)

[1]	令瑞林, 李峻峰, 李丹, 等.基于多核平台的高速网络流量实时捕获方法[J].计算机研究与发展, 2017, 54(6):1300-1313. http://www.cnki.com.cn/Article/CJFDTOTAL-JFYZ201706013.htm LING R L, LI J F, LI D, et al.Realtime capture of high-speed traffic on multi-core platform[J].Journal of Computer Research and Development, 2017, 54(6):1300-1313(in Chinese). http://www.cnki.com.cn/Article/CJFDTOTAL-JFYZ201706013.htm
[2]	刘宝辰.高性能数据包捕获系统的研究与实现[D].上海: 上海交通大学, 2013: 5-37. LIU B C.Research and implementation of a high-performance packet capture system[D].Shanghai: Shanghai Jiao Tong University, 2013: 5-37(in Chinese).
[3]	刘峰.利用PF_Ring零拷贝优化Spark Streaming网络性能[D].南宁: 广西大学, 2017: 10-30. LIU F.The optimization of network performance of Spark Streaming by using the PF_Ring zero_copy technology[D].Nanning: Guangxi University, 2017: 10-30(in Chinese).
[4]	赵志强, 易秀双, 刘浩, 等.基于IPv6的PF_RING ZC数据包捕获技术在IDS中的应用[J].通信学报, 2018, 39(1):1-6. http://www.cnki.com.cn/Article/CJFDTotal-TXXB2018S1009.htm ZHAO Z Q, YI X S, LIU H, et al.Application of PF_RING ZC packet capture technology based on IPv6 in IDS[J].Journal on Communications, 2018, 39(1):1-6(in Chinese). http://www.cnki.com.cn/Article/CJFDTotal-TXXB2018S1009.htm
[5]	吴克河, 王冬冬.基于PF_RING的高速网络数据捕获方法[J].计算机与数字工程, 2019, 47(3):598-604. http://www.cnki.com.cn/Article/CJFDTotal-JSSG201903023.htm WU K H, WANG D D.Data capture method of high speed network based on PF_RING[J].Computer and Digital Engineering, 2019, 47(3):598-604(in Chinese). http://www.cnki.com.cn/Article/CJFDTotal-JSSG201903023.htm
[6]	刘小威, 陈蜀宇, 卢尧, 等.零拷贝技术在网络分析工具中的应用[J].计算机系统应用, 2012, 21(4):169-173. LIU X W, CHEN S Y, LU Y, et al.Application of zero-copy technology to network analysis system[J].Computer Systems and Applications, 2012, 21(4):169-173(in Chinese).
[7]	WANG H P, HE D Z, WANG H, et al.Comparison of high-performance packet processing frameworks on NUMA[C]//2016 7th IEEE International Conference on Software Engineering and Service Science(ICSESS).Piscataway: IEEE Press, 2016: 54-58.
[8]	USUI T, KITATSUJI Y, YOKOTA H.A study on traffic management cooperating with IMS in MPLS networks[J].Telecommunication Systems, 2013, 52(2):671-680.
[9]	SAMOSIR J, INDRAWAN S M, HAGHIGHI P D.An evaluation of data stream processing systems for data driven applications[J].Procedia Computer Science, 2016, 80(1):439-449.
[10]	DERI L.High-speed dynamic packet filtering[J].Journal of Network and Systems Management, 2007, 15(3):401-415.
[11]	DENG R, LIU G Z.QoE driven cross-layer scheme for DASH-based scalable video transmission over LTE[J].Multimedia Tools and Applications, 2018, 77(6):6445-6469. doi: 10.1007/s11042-017-4551-y
[12]	刘文敏, 张冬梅, 李舒辰, 等.基于Netmap的网络监听技术研究[J].信息网络安全, 2013(11):45-48. http://www.cnki.com.cn/Article/CJFDTotal-XXAQ201311018.htm LIU W M, ZHANG D M, LI S C, et al.The network monitoring technology based on Netmap[J].Information Network Security, 2013(11):45-48(in Chinese). http://www.cnki.com.cn/Article/CJFDTotal-XXAQ201311018.htm
[13]	尚珍.基于NIDS系统下Snort源码分析与数据结构研究[J].网络安全技术与应用, 2017(8):64-65. http://www.cnki.com.cn/Article/CJFDTotal-WLAQ201708039.htm SHANG Z.Research on Snort source code analysis and data structure based on NIDS[J].Network Security Technology and Application, 2017(8):64-65(in Chinese). http://www.cnki.com.cn/Article/CJFDTotal-WLAQ201708039.htm
[14]	TYLMAN W.Native support for Modbus RTU protocol in Snort intrusion detection system[J].Advances in Intelligent Systems and Computing, 2013, 224:479-487.
[15]	笱程成, 赵荣彩, 邰铭, 等.高负载网络下线速包捕获接口的设计与实现[J].计算机工程与设计, 2010, 31(10):2203-2205. http://www.cnki.com.cn/Article/CJFDTotal-SJSJ201010015.htm GOU C C, ZHAO R C, TAI M, et al.Wire-speed packet capture interface design and implementation in high-load network[J].Computer Engineering and Design, 2010, 31(10):2203-2205(in Chinese). http://www.cnki.com.cn/Article/CJFDTotal-SJSJ201010015.htm
[16]	CHEN S, YANG J, RAN Y, et al.Adaptive layer switching algorithm based on buffer under-flow probability for scalable video streaming over wireless networks[J].IEEE Transactions on Circuits and Systems for Video Technology, 2016, 26(6):1146-1160. doi: 10.1109/TCSVT.2015.2437071
[17]	谢文韬.基于无锁结构的大容量数据高性能检索系统研究[D].南京: 东南大学, 2017: 5-25. XIE W T.Large capacity data high-performance retrieval system based on lock free structure[D].Nanjing: Southeast University, 2017: 5-25(in Chinese).
[18]	尚彪.网络数据包捕获技术的比较研究与实现[D].武汉: 华中科技大学, 2014: 1-26. SHANG B.Comparative study and implementation of network packet capture technology[D].Wuhan: Huazhong University of Science and Technology, 2014: 1-26(in Chinese).