Hyperparameter Tuning and Automatic Image Augmentation for Deep Learning-Based Angle Classification on Intraoral Photographs-A Retrospective Study.

Cejudo Grano de Oro, José Eduardo; Koch, Petra Julia; Krois, Joachim; Garcia Cantu Ros, Anselmo; Patel, Jay; Meyer-Lueckel, Hendrik; Schwendicke, Falk (2022). Hyperparameter Tuning and Automatic Image Augmentation for Deep Learning-Based Angle Classification on Intraoral Photographs-A Retrospective Study. Diagnostics, 12(7) MDPI 10.3390/diagnostics12071526

[img]
Preview
Text
diagnostics-12-01526.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).

Download (2MB) | Preview

We aimed to assess the effects of hyperparameter tuning and automatic image augmentation for deep learning-based classification of orthodontic photographs along the Angle classes. Our dataset consisted of 605 images of Angle class I, 1038 images of class II, and 408 images of class III. We trained ResNet architectures for classification of different combinations of learning rate and batch size. For the best combination, we compared the performance of models trained with and without automatic augmentation using 10-fold cross-validation. We used GradCAM to increase explainability, which can provide heat maps containing the salient areas relevant for the classification. The best combination of hyperparameters yielded a model with an accuracy of 0.63-0.64, F1-score 0.61-0.62, sensitivity 0.59-0.65, and specificity 0.80-0.81. For all metrics, it was apparent that there was an ideal corridor of batch size and learning rate combinations; smaller learning rates were associated with higher classification performance. Overall, the performance was highest for learning rates of around 1-3 × 10-6 and a batch size of eight, respectively. Additional automatic augmentation improved all metrics by 5-10% for all metrics. Misclassifications were most common between Angle classes I and II. GradCAM showed that the models employed features relevant for human classification, too. The choice of hyperparameters drastically affected the performance of deep learning models in orthodontics, and automatic image augmentation resulted in further improvements. Our models managed to classify the dental sagittal occlusion along Angle classes based on digital intraoral photos.

Item Type:

Journal Article (Original Article)

Division/Institute:

04 Faculty of Medicine > School of Dental Medicine > Department of Preventive, Restorative and Pediatric Dentistry

UniBE Contributor:

Meyer-Lückel, Hendrik

Subjects:

600 Technology > 610 Medicine & health

ISSN:

2075-4418

Publisher:

MDPI

Language:

English

Submitter:

Pubmed Import

Date Deposited:

29 Jul 2022 07:32

Last Modified:

05 Dec 2022 16:22

Publisher DOI:

10.3390/diagnostics12071526

PubMed ID:

35885432

Uncontrolled Keywords:

artificial intelligence deep learning modeling orthodontics photographs

BORIS DOI:

10.48350/171607

URI:

https://boris.unibe.ch/id/eprint/171607

Actions (login required)

Edit item Edit item
Provide Feedback