Spatial Pyramid-Enhanced NetVLAD With Weighted Triplet Loss for Place Recognition.

08:00 EDT 26th April 2019 | BioPortfolio

Summary of "Spatial Pyramid-Enhanced NetVLAD With Weighted Triplet Loss for Place Recognition."

We propose an end-to-end place recognition model based on a novel deep neural network. First, we propose to exploit the spatial pyramid structure of the images to enhance the vector of locally aggregated descriptors (VLAD) such that the enhanced VLAD features can reflect the structural information of the images. To encode this feature extraction into the deep learning method, we build a spatial pyramid-enhanced VLAD (SPE-VLAD) layer. Next, we impose weight constraints on the terms of the traditional triplet loss (T-loss) function such that the weighted T-loss (WT-loss) function avoids the suboptimal convergence of the learning process. The loss function can work well under weakly supervised scenarios in that it determines the semantically positive and negative samples of each query through not only the GPS tags but also the Euclidean distance between the image representations. The SPE-VLAD layer and the WT-loss layer are integrated with the VGG-16 network or ResNet-18 network to form a novel end-to-end deep neural network that can be easily trained via the standard backpropagation method. We conduct experiments on three benchmark data sets, and the results demonstrate that the proposed model defeats the state-of-the-art deep learning approaches applied to place recognition.


Journal Details

This article was published in the following journal.

Name: IEEE transactions on neural networks and learning systems
ISSN: 2162-2388


DeepDyve research library

PubMed Articles [13134 Associated PubMed Articles listed on BioPortfolio]

A multi-view pyramid network for skull stripping on neonatal T1-weighted MRI.

Skull stripping or brain extraction on magnetic resonance imaging is a crucial step for structure analyses. In spite of good performances of conventional methods on adult brains, the skull stripping f...

Perceptual Adversarial Networks With A Feature Pyramid for Image Translation.

This work investigates the image-to-image translations problems, where the input image is translated into its synthetic form with the original structure and semantics preserved. Widely used methods co...

Thermally Activated Delayed Fluorescence via Triplet Fusion.

Manipulating triplet states is technically intriguing for organic semiconductors and photochemical conversion. Sensitized photon upconversion that converts low-energy photons into higher-energy ones v...

Visible-to-Ultraviolet Upconversion Efficiency above 10% Sensitized by Quantum-Confined Perovskite Nanocrystals.

Photon upconversion (UC) based on sensitized triplet-triplet-annihilation (TTA), TTA-UC, can potentially alleviate the transmission loss of below-band-gap photons in solar energy conversion. TTA-UC ac...

Regional Standardization of Prostate Multiparametric MRI Performance and Reporting: Is There a Role for a Director of Prostate Imaging?

The purpose of this study was to assess prostate multiparametric MRI (mpMRI) before and after intervention by a director of prostate imaging. Images from prostate mpMRI examinations at four periphera...

Clinical Trials [5006 Associated Clinical Trials listed on BioPortfolio]

Efficacy of Parent-Child Dieting Plans Incorporating Medifast Meal Replacements for Weight Loss

1. Does a joint parent-child dieting approach, as opposed to an individually-based approach, improve weight loss outcomes? 2. Is a diet which includes Medifast meal replacements as...

BestFIT: a Personalized Weight Loss Program

The purpose of this study is to learn how to personalize weight loss programs. In this research we will study: 1. Whether a weight loss counselor should decide if the traditional weight...

Defining the Extent and Grade of Prostate Cancer Using Dynamic Contrast Enhanced Diffusion Weighted and BOLD MRI

The purpose of this study is to determine the ability of functional MRI techniques [High Resolution Dynamic Contrast Enhanced MRI (HR-DCE-MRI), diffusion weighted MRI (DWI) and BOLD MRI] t...

Weighted Pacifier Vs. Non-Weighted Pacifier

This study will determine if it is beneficial to use a weighted pacifier in neonates.

Breast Cancer Screening With Diffusion-weighted MRI in Women at High Risk for Breast Cancer

A prospective observational multicenter study to compare the outcome of breast cancer surveillance using mammography, breast US, contrast-enhanced MRI, and diffusion-weighted MR imaging (D...

Medical and Biotech [MESH] Definitions

Methods used to take into account and incorporate spatial autocorrelation and regional variation into regression analysis models of data that has spatial dependency, and also to provide information on the spatial relationships among the variables.

Integration of spatial information perceived by visual and/or auditory CUES.

A process through which individuals encode information about their environmental CUES to facilitate SPATIAL NAVIGATION.

Memory related to spatial information.

Type III intermediate filament proteins that assemble into neurofilaments, the major cytoskeletal element in nerve axons and dendrites. They consist of three distinct polypeptides, the neurofilament triplet. Types I, II, and IV intermediate filament proteins form other cytoskeletal elements such as keratins and lamins. It appears that the metabolism of neurofilaments is disturbed in Alzheimer's disease, as indicated by the presence of neurofilament epitopes in the neurofibrillary tangles, as well as by the severe reduction of the expression of the gene for the light neurofilament subunit of the neurofilament triplet in brains of Alzheimer's patients. (Can J Neurol Sci 1990 Aug;17(3):302)

Quick Search

DeepDyve research library

Relevant Topic

Antiretroviral therapy
Standard antiretroviral therapy (ART) consists of the combination of at least three antiretroviral (ARV) drugs to maximally suppress the HIV virus and stop the progression of HIV disease. Huge reductions have been seen in rates of death and suffering whe...

Searches Linking to this Article