10.18710/IDCUCIOpstad, Ida S.Ida S.Opstad0000-0003-4462-4600UiT The Arctic University of NorwayGodtliebsen, GustavGustavGodtliebsenUiT The Arctic University of NorwaySekh, Arif AhmedArif AhmedSekh0000-0003-0706-2565UiT The Arctic University of NorwayReplication Data for: Physics based machine learning for sub-cellular segmentation in living cellsDataverseNO2021Computer and Information ScienceMedicine, Health and Life Sciencesfluorescence microscopylive-celldeep learningcardiomyoblastsmitochondriaartificial intelligencesegmentationOpstad, Ida S.Ida S.OpstadUiT The Arctic University of NorwayUiT The Arctic University of NorwayUiT The Arctic University of NorwayUiT The Arctic University of Norway2021-06-052021-06-162023-09-282016-04-20/2021-04-01Experimental data15982302500653025006524341028616295100842312433485629471393310491392232104913972351049143379210491402236104914073271049140694910491406239120558781362170412055888636217761205597313622600465081773text/plainimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffimage/tiffapplication/zip1.1CC0 1.0Abstract: Segmenting sub-cellular structures in living cells from fluorescence microscopy images is a ground truth (GT) hard problem. The microscope’s 3-dimensional blurring function, finite optical resolution due to light diffraction, finite pixel resolution, and complex morphological manifestations of the structures, all contribute to GT-hardness. Unsupervised segmentation approaches are quite inaccurate. Manual segmentation relying of heuristics and experience therefore remains the preferred approach. Nonetheless, this process is tedious, with 100s of structures present inside a single cell. Thus, generating analytic across large population of cells or performing advanced artificial intelligence (AI) tasks such as tracking is greatly limited. We bring modeling and deep learning to a nexus for solving this GT-hard problem, improving both the accuracy and speed of sub-cellular segmentation. We introduce the approach of simulation-supervision empowered with physics-based GT. In the simulation-supervision datasets used for training, the physics-based GT resolves the GT hardness while computational modeling of all the relevant physics aspects assists deep learning models to learn to compensate for physics and instrument induced limitations to a great extent. We show extensive results on segmentation of small vesicles and large diversity of mitochondria in diverse independent living and fixed cell datasets, demonstrate the adaptability of the approach across diverse microscopes through transfer learning, and illustrate biologically-relevant applications of automated analytic and motion analysis.UiT The Arctic University of NorwayEuropean Research Council804233The Research Council of Norway288565Northern Norway Regional Health AuthorityHNF1449-19UiT The Arctic University of NorwayUiT The Arctic University of Norway