Segmenting and tracking cell instances with cosine embeddings and recurrent hourglass networks.

08:00 EDT 29th June 2019 | BioPortfolio

Summary of "Segmenting and tracking cell instances with cosine embeddings and recurrent hourglass networks."

Differently to semantic segmentation, instance segmentation assigns unique labels to each individual instance of the same object class. In this work, we propose a novel recurrent fully convolutional network architecture for tracking such instance segmentations over time, which is highly relevant, e.g., in biomedical applications involving cell growth and migration. Our network architecture incorporates convolutional gated recurrent units (ConvGRU) into a stacked hourglass network to utilize temporal information, e.g., from microscopy videos. Moreover, we train our network with a novel embedding loss based on cosine similarities, such that the network predicts unique embeddings for every instance throughout videos, even in the presence of dynamic structural changes due to mitosis of cells. To create the final tracked instance segmentations, the pixel-wise embeddings are clustered among subsequent video frames by using the mean shift algorithm. After showing the performance of the instance segmentation on a static in-house dataset of muscle fibers from H&E-stained microscopy images, we also evaluate our proposed recurrent stacked hourglass network regarding instance segmentation and tracking performance on six datasets from the ISBI celltracking challenge, where it delivers state-of-the-art results.


Journal Details

This article was published in the following journal.

Name: Medical image analysis
ISSN: 1361-8423
Pages: 106-119


DeepDyve research library

PubMed Articles [18359 Associated PubMed Articles listed on BioPortfolio]

Arthroscopic assessment of patella tracking correlates with recurrent patellar instability.

For recurrent lateral patellar instability surgical algorithm, an arthroscopic assessment of patellar tracking can aid with the decision of adding a tibial tubercle transfer procedure based on knee fl...

Scalable Zero-Shot Learning via Binary Visual-Semantic Embeddings.

Zero-shot learning aims to classify visual instances from unseen classes in the absence of training examples. This is typically achieved by directly mapping visual features to a semantic embedding spa...

GRUU-Net: Integrated convolutional and gated recurrent neural network for cell segmentation.

Cell segmentation in microscopy images is a common and challenging task. In recent years, deep neural networks achieved remarkable improvements in the field of computer vision. The dominant paradigm i...

Oriented Cell Division: The Pull of the Pole.

Cells are thought to divide along their longest axis. Now, two studies in Developmental Cell (Scarpa et al., 2018) and EMBO Journal (Finegan et al., 2018) reveal that in many instances, cell divisio...

Cell-Penetrating Peptide-Functionalized Persistent Luminescence Nanoparticles for Tracking J774A.1 Macrophages Homing to Inflamed Tissues.

Recruitment of leukocytes containing arguable and ambiguous processes is involved in the inflammatory response, a specific reaction of organism to tissue damage. Tracking leukocytes is of great import...

Clinical Trials [10490 Associated Clinical Trials listed on BioPortfolio]

Tracking Intervention Effects With Eye Tracking

This pilot study examines concurrent and predictive relationships between eye tracking and clinical outcomes during a 16-week behavioral intervention (PRT) for children with ASD. Eye track...

EYE-TRAC Advance: Technology Verification (ETA-TV) Cohort 1

This study will assess the effects of exercise and non-concussive bodily contact on eye-tracking scores collected by the EYE-SYNC eye-tracking device.

Controlling Femoral Derotation Osteotomy With Electromagnetic Tracking

The study is designed to evaluate the use of electromagnetic tracking in femoral derotation osteotomies. The goal is to raise the precision of the surgical procedure in order to improve th...

An Eye Tracking Study of Affective Disorder Patients With Suicide Risk

This research tries to investigate the validity and reliability of eye-tracking technologies by using different paradigms (eg. free-view, pro-saccade and anti-saccade) which served as a no...

Cell Tracking Using Superparamagnetic Particles of Iron Oxide (SPIO) and Magnetic Resonance Imaging (MRI) - A Pilot Study

The ability to label specific cells and image their natural movements in vivo would allow researchers to investigate the mechanisms of disease progression. In addition, cell-based therapy,...

Medical and Biotech [MESH] Definitions

Non-invasive imaging of cells that have been labeled non-destructively, such as with nanoemulsions or reporter genes that can be detected by molecular imaging, to monitor their location, viability, cell lineage expansion, response to drugs, movement, or other behaviors in vivo.

A group of malignant lymphomas thought to derive from peripheral T-lymphocytes in lymph nodes and other nonlymphoid sites. They include a broad spectrum of lymphocyte morphology, but in all instances express T-cell markers admixed with epithelioid histiocytes, plasma cells, and eosinophils. Although markedly similar to large-cell immunoblastic lymphoma (LYMPHOMA, LARGE-CELL, IMMUNOBLASTIC), this group's unique features warrant separate treatment.

Rare autosomal recessive disorder of metabolism due to mutations in the prolidase gene. It is characterized by recurrent lower extremity skin ulcers, recurrent infections, and FACIES, often with mental retardation.

A disorder with chronic or recurrent colonic symptoms without a clearcut etiology. This condition is characterized by chronic or recurrent ABDOMINAL PAIN, bloating, MUCUS in FECES, and an erratic disturbance of DEFECATION.

Spectroscopy technique which measures changes in organic compounds by tracking the spectral energy of absorption of HYDROGEN atoms.

Quick Search


DeepDyve research library

Relevant Topics

Arthritis Fibromyalgia Gout Lupus Rheumatic Rheumatology is the medical specialty concerned with the diagnosis and management of disease involving joints, tendons, muscles, ligaments and associated structures (Oxford Medical Diction...

Antiretroviral therapy
Standard antiretroviral therapy (ART) consists of the combination of at least three antiretroviral (ARV) drugs to maximally suppress the HIV virus and stop the progression of HIV disease. Huge reductions have been seen in rates of death and suffering whe...

Searches Linking to this Article