Real-time FLIM

Oct 26, 2023 ยท 1 min read

We built a histogram-free, real-time fluorescence lifetime imaging (FLIM) system with an in-house micrscope, SPAD image sensor, and FPGA with RNN.

The core idea behind this work is to employ an RNN to process the timestamps from SPAD image sensors on the fly in an event-driven way, without histogramming. This work has been published on Scientific Reports in 2024.

We built a customized microscope, with a lab-developed SPAD image sensor named Piccolo, and deployed the RNN on the FPGA for real-time processing. A Qt-based GUI is developed to control the system. Below is a screen recording of operating such a system: