Abstract
Entropy measures have been widely used to quantify the complexity of theoretical and experimental dynamical systems. In this paper, two novel entropy measures are developed based on using coarse quantization to classify and compare dynamical features within a time series: quantized dynamical entropy and a quantization-based approximation of sample entropy. The properties of the developed entropy measures are examined alongside sample entropy and permutation entropy by studying the logistic map, bifurcations in a nonsmooth predator-prey model and the real-world case study of characterizing changes in gait dynamics caused by age and cognitive interference. Based on these investigations, it is shown that the developed measures have the best overall performance in instances where computational efficiency is vital.
Similar content being viewed by others
References
Lui, X., Wang, Y.: Fine-grained permutation entropy as a measure of natural complexity for time series. Chin. Phys. B 18(7), 2690–2695 (2009)
Gao, J., Hu, J., Tung, W.: Entropy measures for biological signal analyses. Nonlinear Dyn. 68, 431–444 (2012)
Yang, C., Wu, Q., Zhang, P.: Estimation of Lyapunov exponents from a time series for n-dimensional state space using nonlinear mapping. Nonlinear Dyn. 69(4), 1493–1507 (2012)
Yang, C., Wu, Q.: A robust method on estimation of Lyapunov exponents from a noisy time series. Nonlinear Dyn. 64, 279–292 (2011)
Zeng, X., Pielke, R.A., Eykholt, R.: Extracting Lyapunov exponents from short time series of low precision. Mod. Phys. Lett. B. 6(2), 55–75 (1992)
Shi, W., Shang, P.: Cross-sample entropy statistic as a measure of synchronism and cross-correlation of stock markets. Nonlinear Dyn. 71, 539–554 (2013)
Pincus, S.M.: Approximate entropy as a measure of system complexity. Proc. Natl. Acad. Sci. USA 88(6), 2297–2301 (1991)
Richman, J.S., Moorman, J.R.: Physiological time-series analysis using approximate and sample entropy. Am. J. Physiol. Heart Circ. Physiol 278(6), 2039–49 (2000)
Chen, W., Zhuang, J., Yu, W., Wang, Z.: Measuring complexity using FuzzyEn, ApEn, and SampEn. Med. Eng. Phys. 31, 61–68 (2008)
Bandt, C., Pompe, B.: Permutation entropy: a natural complexity measure for time series. Phys. Rev. Lett. 88(17), 174102 (2002)
Lv, Y., Yuan, R., Pei, Y.: Dynamics in two nonsmooth predatorprey models with threshold harvesting. Nonlinear Dyn. 74, 107–132 (2013)
Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27, 379–423 (1948)
Kolmogorov, A.N.: Entropy per unit time as a metric invariant of automorphism. Dokl. Russ. Acad. Sci. 124, 754–755 (1959)
Sinai, Y.G.: On the notion of entropy of a dynamical system. Dokl. Russ. Acad. Sci. 124, 768–771 (1959)
Grassberger, P., Procaccia, I.: Estimation of the Kolmogorov entropy from a chaotic signal. Phys. Rev. A 28(4), 2591–2593 (1983)
Eckmann, J.P., Ruelle, D.: Ergodic theory of chaos and strange attractors. Rev. Mod. Phys. 57(3), 617–656 (1985)
Wolf, A., Swift, J., Swinney, H., Vastano, J.: Determining Lyapunov exponents from a time series. Phys. D 16(3), 285–317 (1985)
Young, L.S.: Entropy in dynamical systems. In: Greven, A., Keller, G., Warnecke, G. (eds.) Entropy, pp. 313–328. Princeton University Press, New Jersey (2003)
Al-Yahya, E., Dawes, H., Smith, L., Dennis, A., Howells, K., Cockburn, J.: Cognitive motor interference while walking: a systematic review and meta-analysis. Neurosci. Biobehav. Rev. 35, 715–728 (2010)
Leverick, G., Szturm, T., Wu, C.: Investigation of the suitability of utilizing permutation entropy to characterize gait dynamics. In: Proceedings of the 2013 ASME Dynamics System and Control Conference, Stanford (2013)
Acknowledgments
We gratefully acknowledge funding from the Natural Sciences and Engineering Research Council of Canada.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Leverick, G., Wu, C. & Szturm, T. Coarse quantization in calculations of entropy measures for experimental time series. Nonlinear Dyn 79, 93–100 (2015). https://doi.org/10.1007/s11071-014-1647-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11071-014-1647-z