Real-Time Light Field 3D Microscopy via Sparsity-Driven Learned Deconvolution

Vizcaino, Josue Page; Wang, Zeguan; Symvoulidis, Panagiotis; Favaro, Paolo; Guner-Ataman, Burcu; Boyden, Edward S.; Lasser, Tobias (May 2021). Real-Time Light Field 3D Microscopy via Sparsity-Driven Learned Deconvolution. IEEE Xplore, pp. 1-11. IEEE 10.1109/ICCP51581.2021.9466256

	Text Conference_Real-Time_Light_Field_3D_Microscopy_via_Sparsity-Driven_Learned_Deconvolution.pdf - Accepted Version Restricted to registered users only Available under License Publisher holds Copyright. Download (11MB) | Request a copy
	Text Real-Time_Light_Field_3D_Microscopy_via_Sparsity-Driven_Learned_Deconvolution.pdf - Published Version Restricted to registered users only Available under License Publisher holds Copyright. Download (17MB) | Request a copy

Light Field Microscopy (LFM) is a scan-less 3D imaging technique capable of capturing fast biological processes, such as neural activity in zebrafish. However, current methods to recover a 3D volume from the raw data require long reconstruction times hampering the usability of the microscope in a closed-loop system. Moreover, because the main focus of zebrafish brain imaging is to isolate and study neural activity, the ideal volumetric reconstruction should be sparse to reveal the dominant signals. Unfortunately, current sparse decomposition methods are computationally intensive and thus introduce substantial delays. This motivates us to introduce a 3D reconstruction method that recovers the spatio-temporally sparse components of an image sequence in real-time. In this work we propose a combination of a neural network (SLNet) that recovers the sparse components of a light field image sequence and a neural network (XLFMNet) for 3D reconstruction. In particular, XLFMNet is able to achieve high data fidelity and to preserve important signals, such as neural potentials, even on previously unobserved samples. We demonstrate successful sparse 3D volumetric reconstructions of the neural activity of live zebrafish, with an imaging span covering 800 × 800 × 250µm3 at an imaging rate of 24 − 88Hz, which provides a 1500 fold speed increase against prior work and enables real-time reconstructions without sacrificing imaging resolution.

Interest & Impact

Downloads

2 since deposited on 21 Apr 2022
2 in the past 12 months

Citations

5 Citations in Web of Science ®
6 Citations in Scopus

Search

in Google Scholar™

Services

Actions (login required)

Edit item

Actions (login required)

Edit item