Jamming in Multilayer Supervised Learning Models.

08:00 EDT 18th October 2019 | BioPortfolio

Summary of "Jamming in Multilayer Supervised Learning Models."

Critical jamming transitions are characterized by an astonishing degree of universality. Analytic and numerical evidence points to the existence of a large universality class that encompasses finite and infinite dimensional spheres and continuous constraint satisfaction problems (CCSP) such as the nonconvex perceptron and related models. In this Letter we investigate multilayer neural networks (MLNN) learning random associations as models for CCSP that could potentially define different jamming universality classes. As opposed to simple perceptrons and infinite dimensional spheres, which are described by a single effective field in terms of which the constraints appear to be one dimensional, the description of MLNN involves multiple fields, and the constraints acquire a multidimensional character. We first study the models numerically and show that similarly to the perceptron, whenever jamming is isostatic, the sphere universality class is recovered, we then write the exact mean-field equations for the models and identify a dimensional reduction mechanism that leads to a scaling regime identical to the one of spheres.


Journal Details

This article was published in the following journal.

Name: Physical review letters
ISSN: 1079-7114
Pages: 160602


DeepDyve research library

PubMed Articles [9200 Associated PubMed Articles listed on BioPortfolio]

Jamming as a Multicritical Point.

The discontinuous jump in the bulk modulus B at the jamming transition is a consequence of the formation of a critical contact network of spheres that resists compression. We introduce lattice models ...

On Kernel Method-Based Connectionist Models and Supervised Deep Learning without Backpropagation.

We propose a novel family of connectionist models based on kernel machines and consider the problem of learning layer by layer a compositional hypothesis class (i.e., a feedforward, multilayer archite...

Self-supervised learning for medical image analysis using image context restoration.

Machine learning, particularly deep learning has boosted medical image analysis over the past years. Training a good model based on deep learning requires large amount of labelled data. However, it is...

Evaluating genotoxicity of metal oxide nanoparticles: Application of advanced supervised and unsupervised machine learning techniques.

Presence of missing data points in datasets is among main challenges in handling the toxicological data for nanomaterials. As the processing of missing data is an important part of data analysis, we h...

Improving Dataset Volumes and Model Accuracy with Semi-Supervised Iterative Self-Learning.

Within this work a novel semi-supervised learning technique is introduced based on a simple iterative learning cycle together with learned thresholding techniques and an ensemble decision support syst...

Clinical Trials [2833 Associated Clinical Trials listed on BioPortfolio]

Effectiveness of Two Compression Methods in the Treatment of Upper Limb Lymphedema

Treatment of lymphedema is based on a combined program called complex decongestive therapy. The components of the complex decongestive therapy are skin care, kinesiotherapy, manual lymphat...

Polyurethane Foam on the Sacrum for Prevention

The aim of the present study is to assess whether the application of a new hydrocellular polyurethane foam multilayer dressing shaped for the sacral area (MSP) in addition to standard care...

Quality Measurement of Esophagogastroduodenoscopy Using Deep Learning Models

The aim of our study was to develop DCNN-based models and assess feasibility of the models in the quality measurement of EGD.

Silicone Adhesive Multilayer Foam Dressings to Prevent Pressure Ulcer

The objective of this study is to determine if silicone adhesive multilayer foam dressings applied to the sacrum, heels and greater trochanter in addition to standard prevention reduce pre...

Evaluation of Safety and Efficacy of the Bifurcated Multilayer Flow Modulator (BMFM®).

To determine the safety and efficacy of the BMFM® kit in the use for the endovascular treatment of aortic aneurysms involving iliac arteries. The BMFM® kit is an adaptation of the aortic...

Medical and Biotech [MESH] Definitions

A MACHINE LEARNING paradigm used to make predictions about future instances based on a given set of labeled paired input-output training (sample) data.

A computer architecture, implementable in either hardware or software, modeled after biological neural networks. Like the biological system in which the processing capability is a result of the interconnection strengths between arrays of nonlinear processing nodes, computerized neural networks, often called perceptrons or multilayer connectionist models, consist of neuron-like units. A homogeneous group of units makes up a layer. These networks are good at pattern recognition. They are adaptive, performing tasks by example, and thus are better for decision-making than are linear learning machines or cluster analysis. They do not require explicit programming.

SUPERVISED MACHINE LEARNING algorithm which learns to assign labels to objects from a set of training examples. Examples are learning to recognize fraudulent credit card activity by examining hundreds or thousands of fraudulent and non-fraudulent credit card activity, or learning to make disease diagnosis or prognosis based on automatic classification of microarray gene expression profiles drawn from hundreds or thousands of samples.

Process in which individuals take the initiative, in diagnosing their learning needs, formulating learning goals, identifying resources for learning, choosing and implementing learning strategies and evaluating learning outcomes (Knowles, 1975)

Usually refers to the use of mathematical models in the prediction of learning to perform tasks based on the theory of probability applied to responses; it may also refer to the frequency of occurrence of the responses observed in the particular study.

Quick Search

DeepDyve research library

Searches Linking to this Article