Abstract
With the rapid development of the Internet of things, social networks, and e-commerce, the era of big data has arrived. Although big data has great potential for many areas such as industry, education, and health care, getting valuable knowledge from big data can be a daunting task. Big data has the characteristics of high-speed change, and its content and distribution characteristics are in dynamic changes. Most current models are static learning models that do not support online updating, making it difficult to learn dynamically changing big data features in real time. In order to solve this problem, this paper proposed a method to support incremental recursive least squares (IRLS) regression parameter estimation and variable sliding window algorithm to analyze and judge the trends of dynamic characteristics of data streams, which can provide early warning, status assessment, and decision support for monitoring objects and improve the accuracy and adaptability of data flow classification. The real-time computational and analysis accuracy are obviously improved than the traditional algorithm, and the simulation results verify the effectiveness of the proposed algorithm.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wang C, Pang X, Lu Z, et al. Research on data flow classification based on dynamic feature extraction and neural network. Comput Syst Appl. 2010;30(6):1539–42.
Koski A, Juhola M, Meriste M. Syntactic recognition of ECG signals by attributed finite automata. Pattern Recogn. 1995;28(12):1927–40.
Shatkay H, Zdonik S. Approximate queries and representations for large data sequences. In: Proceedings of 12th IEEE international conference on data engineering. Washington: IEEE Computer Society; 1996. p. 546–53.
Keogh E, Chu S, Hart D, et al. Segmenting time series: a survey and novel approach. In: Proceedings of IEEE international conference on data mining. Los Jose: IEEE Computer Society; 2001. p. 289–96.
Sylvie C, Carlos GB, Cathering C, et al. Trends extraction and analysis for complex system monitoring and decision support. Eng Appl Artif Intell. 2005;18(1):21–36.
Zhou Q, Wu T. Research and application of a data flow trend analysis method. Control Decis Mak. 2008;23(10):1182–5.
Zhou Q, Cluett W. Recursive identification of time-varying systems via incremental estimation. Automatica. 1996;32(10):1427–31.
Acknowledgements
This paper is supported by Natural Youth Science Foundation of China (61501326, 61401310) and Natural Science Foundation of China (61271411). It also supported by Tianjin Research Program of Application Foundation and Advanced Technology (15JCZDJC31500) and Tianjin Science Foundation (16JCYBJC16500).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, W., Zhang, M. (2020). Research on Data Flow Partitioning Based on Dynamic Feature Extraction. In: Liang, Q., Liu, X., Na, Z., Wang, W., Mu, J., Zhang, B. (eds) Communications, Signal Processing, and Systems. CSPS 2018. Lecture Notes in Electrical Engineering, vol 516. Springer, Singapore. https://doi.org/10.1007/978-981-13-6504-1_36
Download citation
DOI: https://doi.org/10.1007/978-981-13-6504-1_36
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-6503-4
Online ISBN: 978-981-13-6504-1
eBook Packages: EngineeringEngineering (R0)