FOOD RECOGNITION IN ASSESSING THE MEDITERRANEAN DIET: A HIERARCHICAL APPROACH

Papathanail, Ioannis; Lu, Ya; Vasiloglou, Maria; Stathopoulou, Thomai; Ghosh, Arindam; Faeh, David; Mougiakakou, Stavroula (March 2021). FOOD RECOGNITION IN ASSESSING THE MEDITERRANEAN DIET: A HIERARCHICAL APPROACH (Unpublished). In: 14th International Conference on Advanced Technologies & Treatments for Diabetes.

Official URL: https://attd.kenes.com/

Background and aims: The Mediterranean diet (MD) is an eating pattern that can lower the risk of non-communicable diseases, including diabetes. The Mediterranean Diet Adherence (MDA) index determines how closely individuals follow MD, based on their consumed meals. The index can be automatically evaluated with a system which accurately recognises the food items that appear in a photo of a person’s meal.
Methods: We propose a novel hierarchical algorithm to address the problem of multi-label automatic food recognition. The input of the system is an image of a meal and the outputs are the MD-related food categories it contains. Firstly, a convolutional neural network (CNN) is trained to recognise the food items that exist in an image. The food categories are often confused by the CNN but are merged into coarse classes. Then, a newly introduced CNN following a hierarchical architecture learns to output from the coarse to the MD-related food categories.
Results: We used a dataset that contains 5778 food images captured under free living conditions. The images are annotated into 31 food categories of interest for MD, from which the MDA index is defined. For the 31 MD-related food categories, the hierarchical model achieved a mean Average Precision of 52.71%.
Conclusions: The proposed algorithm can more accurately predict the food items that appear in an image than the baseline method and will be integrated into a smartphone application that estimates the weekly MDA on the basis of each consumed meal/drink.

Item Type:

Conference or Workshop Item (Poster)

Division/Institute:

10 Strategic Research Centers > ARTORG Center for Biomedical Engineering Research > ARTORG Center - AI in Health and Nutrition

Graduate School:

Graduate School for Cellular and Biomedical Sciences (GCB)

UniBE Contributor:

Papathanail, Ioannis, Lu, Ya, Vasiloglou, Maria, Stathopoulou, Thomai, Mougiakakou, Stavroula

Subjects:

600 Technology > 610 Medicine & health
600 Technology > 620 Engineering

Language:

English

Submitter:

Stavroula Mougiakakou

Date Deposited:

02 Jun 2021 14:51

Last Modified:

05 Dec 2022 15:48

URI:

https://boris.unibe.ch/id/eprint/152880

Actions (login required)

Edit item Edit item
Provide Feedback