Missing MRI Pulse Sequence Synthesis using Multi-Modal Generative Adversarial Network.

08:00 EDT 4th October 2019 | BioPortfolio

Summary of "Missing MRI Pulse Sequence Synthesis using Multi-Modal Generative Adversarial Network."

Magnetic resonance imaging (MRI) is being increasingly utilized to assess, diagnose, and plan treatment for a variety of diseases. The ability to visualize tissue in varied contrasts in the form of MR pulse sequences in a single scan provides valuable insights to physicians, as well as enabling automated systems performing downstream analysis. However many issues like prohibitive scan time, image corruption, different acquisition protocols, or allergies to certain contrast materials may hinder the process of acquiring multiple sequences for a patient. This poses challenges to both physicians and automated systems since complementary information provided by the missing sequences is lost. In this paper, we propose a variant of generative adversarial network (GAN) capable of leveraging redundant information contained within multiple available sequences in order to generate one or more missing sequences for a patient scan. The proposed network is designed as a multi-input, multi-output network which combines information from all the available pulse sequences and synthesizes the missing ones in a single forward pass. We demonstrate and validate our method on two brain MRI datasets each with four sequences, and show the applicability of the proposed method in simultaneously synthesizing all missing sequences in any possible scenario where either one, two, or three of the four sequences may be missing. We compare our approach with competing unimodal and multi-modal methods, and show that we outperform both quantitatively and qualitatively.


Journal Details

This article was published in the following journal.

Name: IEEE transactions on medical imaging
ISSN: 1558-254X


DeepDyve research library

PubMed Articles [12849 Associated PubMed Articles listed on BioPortfolio]

A giant cervical aneurysmal bone cyst and its multi-modal management.

Giant aneurysmal bone cysts (ABCs) of the spine are very rare lesions, and correspondingly, the optimal treatment sequence is unclear if gross total resection (GTR) cannot be achieved. We present a re...

Collective Affinity Learning for Partial Cross-Modal Hashing.

In the past decade, various unsupervised hashing methods have been developed for cross-modal retrieval. However, in real-world applications, it is often the incomplete case that every modality of data...

Prediction of binding property of RNA-binding proteins using multi-sized filters and multi-modal deep convolutional neural network.

RNA-binding proteins (RBPs) are important in gene expression regulations by post-transcriptional control of RNAs and immune system development and its function. Due to the help of sequencing technolog...

A Manifold Regularized Multi-Task Learning Model for IQ Prediction from Two fMRI Paradigms.

Multi-modal brain functional connectivity (FC) data have shown great potential for providing insights into individual variations in behavioral and cognitive traits. The joint learning of multi-modal d...

Generalized Zero-Shot Cross-Modal Retrieval.

Cross-modal retrieval is an important research area due to its wide range of applications and several algorithms have been proposed to address this task. We feel that it is the right time to take a st...

Clinical Trials [5149 Associated Clinical Trials listed on BioPortfolio]

A Pilot Investigation Detecting Cryoablation Scar by 3D Late Gadolinium Enhancement

This is a prospective trial investigating the effectiveness of a modified MRI preparatory pulse sequence to improve pulmonary vein isolation visualization.

Multi-modal Exercise Program in Older Aduls With Knee Osteoarthritis

Aim: To evaluate the short-term effects of a multi-modal exercise program on physical performance variables in older adults with knee osteoarthritis.

Multi-modal Exercise Program in Older Adults

Aim: To evaluate the short-term effects of a multi-modal exercise program on physical performance variables in older adults.

Evaluation of a New MR Pulse Sequence to Quantify Liver Iron Concentration

The purpose of this study is to determine if a new MR pulse sequence is accurate in determining how much iron is in the liver.

Alternate Methodology of Pulse Oximeter Validation

This study will determine if the replacement of the measured arterial blood oxygen saturation with expired (end-tidal) oxygen value is an acceptable method to calculate the accuracy of pul...

Medical and Biotech [MESH] Definitions

Use of a pulse of X-rays or fast electrons to generate free radicals for spectroscopic examination.

Evaluation of the contour of the PULSE waves which vary in different parts of the circulation and depend on physiological as well as pathophysiological conditions of the individual.

Technique used in AYURVEDIC MEDICINE, and EAST ASIAN TRADITIONAL MEDICINE, in which reading PULSE is used in the diagnosis of diseases.

The sequence of PURINES and PYRIMIDINES in nucleic acids and polynucleotides. It is also called nucleotide sequence.

Any detectable and heritable alteration in the lineage of germ cells. Mutations in these cells (i.e., "generative" cells ancestral to the gametes) are transmitted to progeny while those in somatic cells are not.

Quick Search

DeepDyve research library

Relevant Topics

Radiology is the branch of medicine that studies imaging of the body; X-ray (basic, angiography, barium swallows), ultrasound, MRI, CT and PET. These imaging techniques can be used to diagnose, but also to treat a range of conditions, by allowing visuali...

Mergers & Acquisitions
Commercial and market reports on mergers and acquisitions in the biotechnology, pharmaceutical, medical device and life-science industries. Mergers and acquisitions (abbreviated M&A;) is an aspect of corporate strategy, corporate finance and manageme...

The term allergy is used to describe a response, within the body, to a substance, which is not necessarily harmful in itself, but results in an immune response and a reaction that causes symptoms and disease in a predisposed person, which in turn can cau...

Searches Linking to this Article