Sequence-to-Segments Networks for Detecting Segments in Videos.

08:00 EDT 10th September 2019 | BioPortfolio

Summary of "Sequence-to-Segments Networks for Detecting Segments in Videos."

Detecting segments of interest from videos is a common problem for many applications. And yet it is a challenging problem as it often requires not only knowledge of individual target segments, but also contextual understanding of the entire video and the relationships between the target segments. To address this problem, we propose the Sequence-to-Segments Network (S2N), a novel and general end-to-end sequential encoder-decoder architecture. S2N first encodes the input video into a sequence of hidden states that capture information progressively, as it appears in the video. It then employs the Segment Detection Unit (SDU), a novel decoding architecture, that sequentially detects segments. At each decoding step, the SDU integrates the decoder state and encoder hidden states to detect a target segment. During training, we address the problem of finding the best assignment of predicted segments to ground truth using the Hungarian Matching Algorithm with Lexicographic Cost. Additionally, we propose to use the squared Earth Mover's Distance to optimize the localization errors of the segments. We show the state-of-the-art performance of S2N across numerous tasks, including video highlighting, video summarization, and human action proposal generation.


Journal Details

This article was published in the following journal.

Name: IEEE transactions on pattern analysis and machine intelligence
ISSN: 1939-3539


DeepDyve research library

PubMed Articles [7736 Associated PubMed Articles listed on BioPortfolio]

Membrane Protein Integration and Topogenesis at the ER.

Most membrane proteins are composed of hydrophobic α-helical transmembrane segments and are integrated into the lipid bilayer of the endoplasmic reticulum by the highly conserved Sec61 translocon. Wi...

Rare-Earth and Antimony-Oxo Clusters Simultaneously Connecting Antimonotungstates Comprising Divacant and Tetravacant Keggin Fragments.

Four novel rare-earth (RE) and Sb-oxo clusters simultaneously bridging antimonotungstates (ATs) [HN(CH)]NaH{[RE(HO)SbO](SbWO)(SbWO)}·24HO [RE = Dy (), Er (), Y (), Ho ()] were triumphantly isolated b...

Rostral lumbar segments are the key controllers of hindlimb locomotor rhythmicity in the adult spinal rat.

The precise location and functional organization of the spinal neuronal locomotor-related networks in adult mammals remains unclear. Our recent neurophysiological findings provided empirical evidence ...

Role of Extracellular Calcium and Calcium Sensitization in the Anti-Contractile Effect of Perivascular Adipose Tissue in Pregnant Rat Aorta.

Previous studies have shown that the anti-contractile effect of the perivascular adipose tissue (PVAT) is attenuated in pregnancy. In the present investigation, we have examined the possibility that t...

Computed Tomographic Evaluation of Adjacent Segment Motion after Ex Vivo Fusion of Equine Third and Fourth Cervical Vertebrae.

 Surgical fusion of vertebral segments is a treatment option for horses with cervical stenotic myelopathy or cervical fracture.Degenerative disease affecting adjacent vertebral segments is a reporte...

Clinical Trials [2168 Associated Clinical Trials listed on BioPortfolio]

Deep Learning Algorithm for Recognition of Colonic Segments.

The purpose of this study is to develop and validate a deep learning algorithm to realize automatic recognition of colonic segments under conventional colonoscopy. Then, evaluate the accur...

INTACS (Intrastromal Corneal Ring Segments) For Corneal Ectasia

To join established study put on by Addition Technologies, Inc. in the surgical implantation of asymmetrical INTACS segments to treat myopia and astigmatism in patients with keratoconus.

Osteopathy and Latent Hypothyroidism

This study evaluates the effectiveness of stimulating the neurological segments c8-th5 in patients with latent hypothyroidism. One half of the participants will receive an osteopathic ma...

Morphologic Study of the Intersegmental Plane After Fully Thoracoscopic Segmentectomy

The objective of this study is to determine whether stapling adversely affects the pulmonary parenchyma and the vascularisation of the adjacent segments. The aim of our work is to explore ...

ORANGE SEGMENTS: Open Versus Laparoscopic Parenchymal Preserving Postero-Superior Liver Segment Resection

The international and multicentre ORANGE SEGMENTS - Trial is a prospective, double blinded, randomized controlled study comparing patients undergoing parenchymal preserving resection of po...

Medical and Biotech [MESH] Definitions

Staining of bands, or chromosome segments, allowing the precise identification of individual chromosomes or parts of chromosomes. Applications include the determination of chromosome rearrangements in malformation syndromes and cancer, the chemistry of chromosome segments, chromosome changes during evolution, and, in conjunction with cell hybridization studies, chromosome mapping.

RNA consisting of two strands as opposed to the more prevalent single-stranded RNA. Most of the double-stranded segments are formed from transcription of DNA by intramolecular base-pairing of inverted complementary sequences separated by a single-stranded loop. Some double-stranded segments of RNA are normal in all organisms.

Genes encoding the different subunits of the IMMUNOGLOBULINS, for example the IMMUNOGLOBULIN LIGHT CHAIN GENES and the IMMUNOGLOBULIN HEAVY CHAIN GENES. The heavy and light immunoglobulin genes are present as gene segments in the germline cells. The completed genes are created when the segments are shuffled and assembled (B-LYMPHOCYTE GENE REARRANGEMENT) during B-LYMPHOCYTE maturation. The gene segments of the human light and heavy chain germline genes are symbolized V (variable), J (joining) and C (constant). The heavy chain germline genes have an additional segment D (diversity).

Genes and gene segments encoding the IMMUNOGLOBULIN HEAVY CHAINS. Gene segments of the heavy chain genes are symbolized V (variable), D (diversity), J (joining), and C (constant).

Genes and gene segments encoding the IMMUNOGLOBULIN LIGHT CHAINS. Gene segments of the light chain genes are designated as V (variable), J (joining), and C (constant).

Quick Search

DeepDyve research library

Relevant Topic

Antiretroviral therapy
Standard antiretroviral therapy (ART) consists of the combination of at least three antiretroviral (ARV) drugs to maximally suppress the HIV virus and stop the progression of HIV disease. Huge reductions have been seen in rates of death and suffering whe...

Searches Linking to this Article