Automated detecting, segmenting and measuring of grains in images of fluvial sediments: The potential for large and precise data from specialist deep learning models and transfer learning

Mair, David; Witz, Guillaume; do Prado, Ariel Henrique; Garefalakis, Philippos; Schlunegger, Fritz (2023). Automated detecting, segmenting and measuring of grains in images of fluvial sediments: The potential for large and precise data from specialist deep learning models and transfer learning. Earth surface processes and landforms, 49(3), pp. 1099-1116. Wiley 10.1002/esp.5755

[img]
Preview
Text
Earth_Surf_Processes_Landf_-_2023_-_Mair_-_Automated_detecting_segmenting_and_measuring_of_grains_in_images_of_fluvial.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).

Download (10MB) | Preview

The size of sedimentary particles in rivers bears information on the sediment entrainment or deposition mechanisms and the hydraulic conditions controlling them. However, collecting such data from coarse-grained sediments is work intensive, both in the field and remotely. Therefore, attention has turned to machine learning models to improve the data acquisition. Despite their success, current methods need large quantities of data and yield results limited to a few percentile values of grain size datasets, often additionally affected by a systematic bias. In most cases, the root of these limitations is the challenge of accurately segmenting grains. Here, we present a new approach to improve the segmentation of individual grains based on the capacity of transfer learning in convolutional neural networks. Specifically, we re-train a state-of-the-art model for cell segmentation in biomedical images to find and segment coarse-grained particles in images of fluvial sediments. Our results show that the performance in the segmentation tasks can be directly transferred to images of fluvial sediments and that our re-trained models outperform existing methods. We document that our results are achievable with only 10%–20% of the data needed for training other deep learning models designed to measure the size of fluvial sediments. Moreover, we find that traits in our data control the segmentation performance. This enables data-driven approaches to create specialist segmentation models. Additionally, comparing our automatically obtained datasets with the results retrieved from image and field-based surveys confirms that improvements in segmentation are directly leading to more precise and more accurate grain size data even if data collection occurs in images taken at different conditions. Finally, we release a software package, the trained models and our data. The goal is to offer a tool to efficiently segment and measure grains in sediment images in an automated way, which can be adapted to different settings.

Item Type:

Journal Article (Original Article)

Division/Institute:

08 Faculty of Science > Institute of Geological Sciences
08 Faculty of Science > Institute of Geological Sciences > Exogenous Geology

UniBE Contributor:

Mair, David, Witz, Guillaume Robert, do Prado, Ariel Henrique, Garefalakis, Philippos Erich, Schlunegger, Fritz

Subjects:

500 Science > 550 Earth sciences & geology

ISSN:

0197-9337

Publisher:

Wiley

Language:

English

Submitter:

Fritz Schlunegger

Date Deposited:

03 Jan 2024 11:33

Last Modified:

16 Jun 2024 02:21

Publisher DOI:

10.1002/esp.5755

BORIS DOI:

10.48350/191048

URI:

https://boris.unibe.ch/id/eprint/191048

Actions (login required)

Edit item Edit item
Provide Feedback