We propose an end-to-end image analysis pipeline based on the Adaptive Particle Representation (APR) for analyzing large 3D cleared tissue samples such as whole mouse brains or large human brain sections, achieving 100+ times faster computation. Our pipeline is compatible with real-time use, i.e. analysis can be done during acquisition. In addition to faster processing, using APR yields memory and storage compression ratios ranging from dozens to thousands depending on the labeling sparsity, saving costs on the storage and computing infrastructures.
Understanding how cells form tissues and how organs grow into their final shape relies on direct observation of these self-organization processes in living specimen. In cell and developmental biology, such observations are made possible by recent breakthroughs in volumetric 3D live microscopy, providing tissue-level data at sub-cellular resolution. These 3D+time datasets allow us to directly observe the processes of life, but they also define a new set of computer-science challenges: How to store and process Terabyte-sized 3D images? How to learn physical principles from them? How to visualize data at rates of several Gigabytes per second? This has given rise to the field of big-data bio-image informatics. In my talk, I will give an overview of the approaches we developed over the past few years. I will present a novel image representation, the Adaptive Particle Representation, which can replace the traditional pixel grids in such applications. I will show how the APR has enabled real-time processing and visualization of very large microscopy volumes, and how one can adapt convolutional neural networks to natively operate on this representation without intermediately having to go back to pixels. Finally, I highlight some recent advancements in statistical learning theory that enable us to learn interpretable and physically consistent active matter models directly from noisy microscopy videos, closing the loop back to the initial physical hypothesis of tissue self-organization.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.