Optimal Sampling of Parametric Families: Implications for Machine Learning.

07:00 EST 8th November 2019 | BioPortfolio

Summary of "Optimal Sampling of Parametric Families: Implications for Machine Learning."

It is well known in machine learning that models trained on a training set generated by a probability distribution function perform far worse on test sets generated by a different probability distribution function. In the limit, it is feasible that a continuum of probability distribution functions might have generated the observed test set data; a desirable property of a learned model in that case is its ability to describe most of the probability distribution functions from the continuum equally well. This requirement naturally leads to sampling methods from the continuum of probability distribution functions that lead to the construction of optimal training sets. We study the sequential prediction of Ornstein-Uhlenbeck processes that form a parametric family. We find empirically that a simple deep network trained on optimally constructed training sets using the methods described in this letter can be robust to changes in the test set distribution.


Journal Details

This article was published in the following journal.

Name: Neural computation
ISSN: 1530-888X
Pages: 1-19


DeepDyve research library

PubMed Articles [13852 Associated PubMed Articles listed on BioPortfolio]

Predicting Outpatient Appointment Demand Using Machine Learning and Traditional Methods.

Traditional methods have long been used for clinical demand forecasting. Machine learning methods represent the next evolution in forecasting, but model choice and optimization remain challenging for ...

Machine learning and big data: Implications for disease modeling and therapeutic discovery in psychiatry.

Machine learning capability holds promise to inform disease models, the discovery and development of novel disease modifying therapeutics and prevention strategies in psychiatry. Herein, we provide an...

What Is Machine Learning: a Primer for the Epidemiologist.

Machine learning is a branch of computer science that has the potential to transform epidemiological sciences. Amid a growing focus on "Big Data," it offers epidemiologists new tools to tackle problem...

Mapping urban air quality using mobile sampling with low-cost sensors and machine learning in Seoul, South Korea.

Recent studies have demonstrated that mobile sampling can improve the spatial granularity of land use regression (LUR) models. Mobile sampling campaigns deploying low-cost (

APD optimal bias voltage compensation method based on machine learning.

The signal-to-noise ratio (SNR) of avalanche photodiode (APD) in optical detection system is greatly influenced by background radiation and operating temperature, so an APD optimal bias voltage compen...

Clinical Trials [6459 Associated Clinical Trials listed on BioPortfolio]

Machine Learning From Fetal Flow Waveforms to Predict Adverse Perinatal Outcomes

The aim of this study is to get a proof of concept for using a computational model of fetal haemodynamics, combined with machine learning based on Doppler patterns of the fetal cardiovascu...

Family Learning on Asthma Topics

1. Hypothesis: The Family Learning on Asthma Topics (F.L.O.A.T) in the form of a a group teaching environment for family education stemming from standardized education materials ...

Machine Learning-Based Risk Profile Classification of Patients Undergoing Elective Heart Valve Surgery

Machine learning methods potentially provide a highly accurate and detailed assessment of expected individual patient risk before elective cardiac surgery. Correct anticipation of this ris...

Smartphone Enabled Detection of Nocturnal Cough Rate and Sleep Quality as a Prognostic Marker for Asthma Control

The purpose of the study is to explore the value which cough rate might provide for asthma self-management. In this study, the focus will be specifically on nocturnal cough rate. The plan ...

Telemedicine Notifications With Machine Learning for Postoperative Care

The ODIN-Report study will be a randomized controlled trial of the effect of providing machine learning risk forecasts to providers caring for patients immediately after surgery on serious...

Medical and Biotech [MESH] Definitions

A MACHINE LEARNING paradigm used to make predictions about future instances based on a given set of labeled paired input-output training (sample) data.

A MACHINE LEARNING paradigm used to make predictions about future instances based on a given set of unlabeled paired input-output training (sample) data.

SUPERVISED MACHINE LEARNING algorithm which learns to assign labels to objects from a set of training examples. Examples are learning to recognize fraudulent credit card activity by examining hundreds or thousands of fraudulent and non-fraudulent credit card activity, or learning to make disease diagnosis or prognosis based on automatic classification of microarray gene expression profiles drawn from hundreds or thousands of samples.

A type of ARTIFICIAL INTELLIGENCE that enable COMPUTERS to independently initiate and execute LEARNING when exposed to new data.

Process in which individuals take the initiative, in diagnosing their learning needs, formulating learning goals, identifying resources for learning, choosing and implementing learning strategies and evaluating learning outcomes (Knowles, 1975)

Quick Search

DeepDyve research library

Searches Linking to this Article