Abstract
Nowadays smart phones are becoming more and more popular with the development of mobile technology. Phones are made more stronger and take more data related with user and it is also easier to collect information from smart phones than before. In the article, the tool we proposed aims to achieve the ability to predict and prevent complex diseases by mining multiple type of data that is collected by smart phones. It provides patients with health recommendations based on their daily diets and physiological information using Multimodal data based Health Recommendations module. In turn, users can interact with the smart phones to gain suggestions from historical results. The paper introduces the following: (i) Collecting users’ physiological information to provide disease prediction; (ii) Analyzing diet images to obtain users’ eating habits; (iii) Health recommendations based on the results of (i) and (ii).
Similar content being viewed by others
References
Abdel-Hamid O, Mohamed A, Jiang H, Li D, Penn G, Dong Y (2014) Convolutional neural networks for speech recognition. IEEE/ACM Trans Audio Speech Lang Process 22(10):1533–1545
Bosch M., Zhu F, Khanna N, Boushey CJ, Delp E J (2011) Combining global and local features for food identification in dietary assessment. In: Image processing (ICIP), pp 1789–1792
Bossard L, Guillaumin M, Gool LV (2014) Food-101 – mining discriminative components with random forests, pp 446–461
Chen MY, Yang YH, Ho CJ, Wang SH, Liu SM, Chang E, Yeh CH, Ming O (2012) Automatic chinese food identification and quantity estimation. In: SIGGRAPH Asia 2012 technical briefs, pp 1–4
Cheplygina V, Tax D M J, Loog M (2013) Combining instance information to classify bags. Multiple Class Syst:13–24
Dahl G E, Dong Y, Li D, Acero A (2012) Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition. IEEE Transon Audio Speech Lang Process 20(1):30–42
Deng J, Dong W, Socher R, Li LJ (2009) Imagenet: a large-scale hierarchical image database, pp 248–255
Dong H Y, Zhu J, Tang Y, Xu C H, Ding R (2015) Ubs: a novel news recommendation system based on user behavior sequence. KSEM, online first
General Chair-Brush A, General Chair-Friday A, Program Chair-Kientz J, Program Chair-Scott J, Program Chair-Song J (2014) Proceedings of the 2014 acm international joint conference on pervasive and ubiquitous computing: Adjunct publication. In: ACM International joint conference on pervasive and ubiquitous computing: adjunct publication, pp 423–429
Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. Comput Sci:580–587
He K, Zhang X, Ren S, Sun J (2014) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37 (9):1904–1916
Hoashi H, Joutou T, Yanai K (2010) Image recognition of 85 food categories by feature fusion. In: Ism 2010, IEEE International symposium on multimedia. Taichung, pp 296–301
Kagaya H, Aizawa K, Ogawa M (2014) Food detection and recognition using convolutional neural network. In: ACM multimedia, pp 1085–1088
Kawano Y, Foodcam KY (2014) A real-time food recognition system on a smartphone. Multimed Tools Appl 74(14):1–25
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25(2):2012
Lawrence S, Giles C L, Tsoi A C, Back A D (1997) Face recognition: a convolutional neural-network approach. IEEE Transa Neural Netw 8(1):98–113
Li J, Liu C, Bo L, Mao R, Wang Y, Chen S, Yang J-J, Pan H, Wang Q (2015) Diversity-aware retrieval of medical records. Comput Ind 69:81–91
Liu F, Lin G, Shen C (2015) Crf learning with cnn features for image segmentation. Pattern Recog 48(10):2983–2992
Liu C, Cao Yu, Luo Y, Chen G, Vokkarane V, Ma Yunsheng (2016) Deepfood: deep learning-based food image recognition for computer-aided dietary assessment
Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(60):91–110
Pouladzadeh P, Shirmohammadi S, Al-Maghrabi R (2014) Measuring calorie and nutrition from food image. IEEE Trans Instrum Measur 63(8):1947–1956
Pouladzadeh P, Yassine A, Shirmohammadi S (2015) Foodd: food detection dataset for calorie measurement using food images. Lect Notes Comput Sci:441–448
Schafer JB, Dan F, Herlocker J, Sen S (2007) Collaborative filtering recommender systems, pp 46–45
Schmidhuber J (2014) Deep learning in neural networks: an overview, vol 61
Shaw P A, Heiland P, Tillmann RW, Maas HJ (2015) Context-based recommendation system
Shi XY, Ye HW, Gong SJ (2008) A personalized recommender integrating item-based and user-based collaborative filtering, pp 264–267
Shimoda W, Yanai K (2015) Cnn-based food image segmentation without pixel-wise annotation, pp 449–457
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Comput Sci
Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M (2014) Striving for simplicity: the all convolutional net. Eprint Arxiv
Wang J, Huang JZ, Guo J, Lan Y (2015) Recommending high-utility search engine queries via a query-recommending model. Neurocomputing 167:195–208
Wang K, Kong Y Diagnosis of heart disease via cnns
Wen W, Yang J (2009) Fast food recognition from videos of eating for calorie estimation, pp 1210–1213
Yanai K, Kawano Y (2015) Food image recognition using deep convolutional network with pre-training and fine-tuning. In: IEEE International conference on multimedia & expo workshops, pp 1–6
Zhao ZD, Shang M (2010) User-based collaborative-filtering recommendation algorithms on hadoop. In: International conference on knowledge discovery and data mining, Wkdd 2010. Phuket, pp 478–481
Zheng K, Huang Z, Zhou X, et al. (2011) Discovering the most influential sites over uncertain data: a rank based approach. IEEE Trans Knowledge Data Eng 99:1–1
Zheng K, Zhou X, Fung PC, Xie K (2012) Spatial query processing for fuzzy objects. VLDB J:1–23
Zhu J, Yang Y, Xie Q, Wang L W, Hassan S (2014) Robust hybrid name disambiguation framework for large databases. Scientometrics 98(3):2255–2274
Zhu X, Suk H I, Lee S W, Shen D (2015) Subspace Regularized Sparse Multi-Task Learning for Multi-Class Neurodegenerative Disease Identification 63 (3):607–618
Zhu X, Zhang L, Huang Z (2014) A sparse embedding and least variance encoding approach to hashing. IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society 23(9):3737–50
Zhu X, Zhang S, Zhang J, Zhang C (2007) Cost-Sensitive Imputing Missing Values with Ordering. AAAI Conference on Artificial Intelligence. Vancouver, British Columbia, Canada, pp 1922–1923
Acknowledgments
This work was supported by the Natural Science Foundation of Guangdong Province, China (No.2015A030310509), the National Science Foundation of China (61370229, 61272067, 61303049, 61402313), and the S&T Projects of Guangdong Province (2015A030401087, 2015B010110002, No.2016A030303055, No.2016B030305004, 2016B010109008).
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
Xu, C., Zhu, J., Huang, J. et al. A health management tool based smart phone. Multimed Tools Appl 76, 17541–17558 (2017). https://doi.org/10.1007/s11042-016-4220-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-016-4220-6