Drone-based photogrammetry combined with deep-learning to estimate hail size distributions and melting of hail on the ground

Lainer, Martin; Brennan, Killian P.; Hering, Alessandro; Kopp, Jérôme; Monhart, Samuel; Wolfensberger, Daniel; Germann, Urs (2023). Drone-based photogrammetry combined with deep-learning to estimate hail size distributions and melting of hail on the ground (In Press). Atmospheric Measurement Techniques (AMT) Copernicus Publications 10.5194/amt-2023-89

Preview

Text amt-2023-89.pdf - Submitted Version Available under License Creative Commons: Attribution (CC-BY). Download (31MB) | Preview

Hail is a major threat associated with severe thunderstorms and an estimation of the hail size is important for issuing warnings to the public. Operational radar products exist that estimate the size of the expected hail. For the verification of such products, ground based observations are necessary. Automatic hail sensors, as for example within the Swiss hail network, record the kinetic energy of hailstones and can estimate with this the hail diameters. However, due to the small size of the observational area of these sensors (0.2 m2) the estimation of the hail size distribution (HSD) can have large uncertainties. To overcome this issue, we combine drone-based aerial photogrammetry with a state-of-the-art custom trained deep-learning object detection model to identify hailstones in the images and estimate the HSD in a final step. This approach is applied to photogrammetric image data of hail on the ground from a supercell storm, that crossed central Switzerland from southwest to northeast in the afternoon of June 20, 2021. The hail swath of this intense right-moving supercell was intercepted a few minutes after the passage at a soccer field near Entlebuch (Canton Lucerne, Switzerland) and aerial images of the hail on the ground were taken by a commercial DJI drone, equipped with a 50 megapixels full frame camera system. The average ground sampling distance (GSD) that could be reached was 1.5 mm per pixel, which is set by the mounted camera objective with a focal length of 35 mm and a flight altitude of 12 m above ground. A 2D orthomosaic model of the survey area (750 m2) is created based on 116 captured images during the first drone mapping flight. Hail is then detected by using a region-based Convolutional Neural Network (Mask R-CNN). We first characterize the hail sizes based on the individual hail segmentation masks resulting from the model detections and investigate the performance by using manual hail annotations by experts to generate validation and test data sets. The final HSD, composed of 18209 hailstones, is compared with nearby automatic hail sensor observations, the operational weather radar based hail product MESHS (Maximum Expected Severe Hail Size) and some crowdsourced hail reports. Based on the retrieved drone hail data set, a statistical assessment of sampling errors of hail sensors is carried out. Furthermore, five repetitions of the drone-based photogrammetry mission within about 18 min give the unique opportunity to investigate the hail melting process on the ground for this specific supercell hailstorm and location.

Interest & Impact

Downloads

50 since deposited on 01 Nov 2023
50 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item