Abstract
Obesity and its numerous devastating consequences are on the rise globally. While widespread tactics to fight against obesity often focus on healthy eating, how the food is consumed is oftentimes overlooked even though convincing evidence attests that merely eating slowly and properly chewing one’s meal significantly reduces obesity. This research introduces a method that recognizes common human actions during mealtime—namely, food chewing, food swallowing, drink swallowing, and talking. The proposed system is unobtrusive. It uses a cheap and small bone conduction microphone to collect intra-body sound and a smartphone that provides feedback in real-time. Our proposed approach achieves similar performances (Accuracy = 97.5%, Specificity = 98.0%, Precision = 83.8%, Recall = 91.7%, \(F_1\) score = 87.2%, and MCC = 0.85) as those achieved by the most recent state of the art models even though our system uses modest machine learning models.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
\(XGB(colsample\_bytree\,=\,0.5, \gamma \,=\,0.7, depth\,=\,4, subsample\,=\,0.4)\).
- 3.
\(KNeighbors(k\_neighbors\,=\,14, weights\) = “distance”).
- 4.
\(RandomForest(depth\,=\,24, max\_features\) = “\(log_2\)”).
- 5.
\(LGBM(colsample\_bytree\,=\,0.7, depth\,=\,32,num\_leaves\,=\,70, \alpha \,=\,0.5)\).
References
Alías, F., Socoró, J., Sevillano, X.: A Review of physical and perceptual feature extraction techniques for speech, music and environmental sounds. Appl. Sci. 6(5), 143 (2016). https://doi.org/10.3390/app6050143
Amft, O., Troster, G.: On-body sensing solutions for automatic dietary monitoring. IEEE Pervasive Comput. 8(2), 62–70 (2009). https://doi.org/10.1109/MPRV.2009.32
Bi, S., et al.: Auracle: detecting eating episodes with an ear-mounted sensor. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 2, no. 3, pp. 1–27, September 2018. https://doi.org/10.1145/3264902
Box, G.E.P., Cox, D.R.: An analysis of transformations. J. Roy. Stat. Soc.: Series B (Methodol.) 26(2), 211–243 (1964). https://doi.org/10.1111/j.2517-6161.1964.tb00553.x
Chakroborty, S., Roy, A., Saha, G.: Fusion of a complementary feature set with MFCC for improved closed set text-independent speaker identification. In: 2006 IEEE International Conference on Industrial Technology, pp. 387–390. IEEE (2006). https://doi.org/10.1109/ICIT.2006.372388
Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321–357 (2002). https://doi.org/10.1613/jair.953
Chicco, D., Jurman, G.: The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genomics 21(1), 6 (2020). https://doi.org/10.1186/s12864-019-6413-7
Goto, M.: SmartMusicKIOSK: music listening station with chorus-search function. In: Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology - UIST 2003, vol. 5, pp. 31–40. ACM Press, New York (2003). https://doi.org/10.1145/964696.964700, http://portal.acm.org/citation.cfm?doid=964696.964700
Guyon, I., Weston, J., Barnhill, S., Vapnik, V.: Gene selection for cancer classification using support vector machines. Mach. Learn. 46(1–3), 389–422 (2002). https://doi.org/10.1023/A:1012487302797
Han, H., Wang, W.Y., Mao, B.H.: Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning. Adv. Intell. Syst. Comput. 683, 878–887 (2005). https://doi.org/10.1007/11538059_91
He, H., Ma, Y.: Imbalanced Learning: Foundations, Algorithms, and Applications. Wiley-IEEE Press, July 2013
Hurst, Y., Fukuda, H.: Effects of changes in eating speed on obesity in patients with diabetes: a secondary analysis of longitudinal health check-up data. BMJ Open 8(1), e019589 (2018). https://doi.org/10.1136/bmjopen-2017-019589
Hussain, G., Javed, K., Cho, J., Yi, J.: Food intake detection and classification using a necklace-type piezoelectric wearable sensor system. IEICE Trans. Inf. Syst. 101(11), 2795–2807 (2018). https://doi.org/10.1587/transinf.2018EDP7076
Jain, A., Kondo, T., Kamachi, H., Yokokubo, A., Lopez, G.: Detailed classification of meal-related activities from eating sound collected in free living conditions. In: Proceedings of the 13th International Joint Conference on Biomedical Engineering Systems and Technologies - Vol. 5: HEALTHINF, pp. 284–291. INSTICC, SCITEPRESS, February 2020. https://doi.org/10.5220/0009187502840291
Kondo, T., Kamachi, H., Ishii, S., Yokokubo, A., Lopez, G.: Robust classification of eating sound collected in natural meal environment. In: Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers - UbiComp/ISWC 2019, pp. 105–108. ACM Press, New York, September 2019. https://doi.org/10.1145/3341162.3343780
Kondo, T., Shiro, H., Yokokubo, A., Lopez, G.: Optimized classification model for efficient recognition of meal-related activities in daily life meal environment. In: 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR), pp. 146–151. IEEE, May 2019. https://doi.org/10.1109/ICIEV.2019.8858526, https://ieeexplore.ieee.org/document/8858526/
Kyritsis, K., Diou, C., Delopoulos, A.: A data driven end-to-end approach for in-the-wild monitoring of eating behavior using smartwatches. IEEE J. Biomed. Health Inform. 1 (2020). https://doi.org/10.1109/JBHI.2020.2984907
de Lara, J.R.C., et al.: A method of automatic speaker recognition using cepstral features and vectorial quantization. In: Sanfeliu, A., Cortés, M.L. (eds.) CIARP 2005. LNCS, vol. 3773, pp. 146–153. Springer, Heidelberg (2005). https://doi.org/10.1007/11578079_16
Le, T.T., Fu, W., Moore, J.H.: Scaling tree-based automated machine learning to biomedical big data with a feature set selector. Bioinformatics 36(1), 250–256 (2020). https://doi.org/10.1093/bioinformatics/btz470
Lopez, G., Mitsui, H., Ohara, J., Yokokubo, A.: Effect of feedback medium for real-time mastication awareness increase using wearable sensors. In: Proceedings of the 12th International Joint Conference on Biomedical Engineering Systems and Technologies, pp. 442–449, no. Biostec. SCITEPRESS - Science and Technology Publications (2019). https://doi.org/10.5220/0007569804420449
Mellina, A., Sentinelli, A., Marfia, G., Roccetti, M.: AREEB: automatic refrain extraction for thumbnail. In: 2012 IEEE Consumer Communications and Networking Conference (CCNC), no. Mi, pp. 472–476. IEEE, January 2012. https://doi.org/10.1109/CCNC.2012.6181003
Scheirer, E., Slaney, M.: Construction and evaluation of a robust multifeature speech/music discriminator. In: 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 2, pp. 1331–1334. IEEE Comput. Soc. Press (1801). https://doi.org/10.1109/ICASSP.1997.596192
Schoeller, D.A.: Limitations in the assessment of dietary energy intake by self-report. Metabolism 44(SUPPL. 2), 18–22 (1995). https://doi.org/10.1016/0026-0495(95)90204-X
Selamat, N.A., Ali, S.H.M.: Automatic food intake monitoring based on chewing activity: a survey. IEEE Access 8, 48846–48869 (2020). https://doi.org/10.1109/ACCESS.2020.2978260
Tada, A., Miura, H.: Association of mastication and factors affecting masticatory function with obesity in adults: a systematic review. BMC Oral Health 18(1), 76 (2018). https://doi.org/10.1186/s12903-018-0525-3
Vu, T., Lin, F., Alshurafa, N., Xu, W.: Wearable food intake monitoring technologies: a comprehensive review. Computers 6(1), 1–28 (2017). https://doi.org/10.3390/computers6010004
Westerterp, K.R., Goris, A.H.: Validity of the assessment of dietary intake: problems of misreporting. Curr. Opinion Clin. Nutr. Metab. Care 5(5), 489–493 (2002). https://doi.org/10.1097/00075197-200209000-00006
Yeo, I.K.: A new family of power transformations to improve normality or symmetry. Biometrika 87(4), 954–959 (2000). https://doi.org/10.1093/biomet/87.4.954
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Nkurikiyeyezu, K., Kamachi, H., Kondo, T., Jain, A., Yokokubo, A., Lopez, G. (2021). Classification of Eating Behaviors in Unconstrained Environments. In: Ye, X., et al. Biomedical Engineering Systems and Technologies. BIOSTEC 2020. Communications in Computer and Information Science, vol 1400. Springer, Cham. https://doi.org/10.1007/978-3-030-72379-8_29
Download citation
DOI: https://doi.org/10.1007/978-3-030-72379-8_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-72378-1
Online ISBN: 978-3-030-72379-8
eBook Packages: Computer ScienceComputer Science (R0)