Online and Unsupervised Anomaly Detection for Streaming Data Using an Array of Sliding Windows and PDDs.

07:00 EST 28th November 2019 | BioPortfolio

Summary of "Online and Unsupervised Anomaly Detection for Streaming Data Using an Array of Sliding Windows and PDDs."

In this article, we propose an online and unsupervised anomaly detection algorithm for streaming data using an array of sliding windows and the probability density-based descriptors (PDDs) (based on these windows). This algorithm mainly consists of three steps: 1) we use a main sliding window over streaming data and segment this window into an array of nonoverlapping subwindows; 2) we propose the PDDs with dimension reduction, based on the kernel density estimation, to estimate the probability density of data in each subwindow; and 3) we design the distance-based anomaly detection rule to determine whether the current observation is anomalous. The experimental results and performances are presented based on the Numenta anomaly benchmark. Compared with the anomaly detection algorithm using the hierarchical temporal memory proposed by Numenta (which outperforms a wide range of other anomaly detection algorithms), our algorithm can perform better in many cases, that is, with higher detection rates and earlier detection for contextual anomalies and concept drifts.


Journal Details

This article was published in the following journal.

Name: IEEE transactions on cybernetics
ISSN: 2168-2275


DeepDyve research library

PubMed Articles [18119 Associated PubMed Articles listed on BioPortfolio]

Unsupervised Anomaly Detection With LSTM Neural Networks.

We investigate anomaly detection in an unsupervised framework and introduce long short-term memory (LSTM) neural network-based algorithms. In particular, given variable length data sequences, we first...

Anomaly detection over differential preserved privacy in online social networks.

The massive reach of social networks (SNs) has hidden their potential concerns, primarily those related to information privacy. Users increasingly rely on social networks for more than merely interact...

A tool for Swarm satellite data analysis and anomaly detection.

In this work we introduce a system pipeline for the analysis of earth's electromagnetic field that is used to analyse precursors to earthquakes. Data gathered by the Swarm satellites are used to prese...

Spectral constraint adversarial autoencoders approach to feature representation in hyperspectral anomaly detection.

Anomaly detection in hyperspectral images (HSIs) faces various levels of difficulty due to the high dimensionality, redundant information and deteriorated bands. To address these problems, we propose ...

Hand hygiene compliance surveillance with time series anomaly detection.

Hand hygiene is the most important intervention to reduce the risk of transmission of pathogens in health care. Assurance of effective hand hygiene improvement campaigns includes adequate data analyti...

Clinical Trials [5798 Associated Clinical Trials listed on BioPortfolio]

Multi-Dose Study to Assess the Patients' Ability to Self-Administer Fasinumab in an Unsupervised Setting

The primary objective is to demonstrate that the Prefilled Syringe (PFS) and the auto-injector(AI) are suitable to be used to administer fasinumab at home by patients or their caregivers, ...

The MORE Study: Manifest vs. Online Refraction Evaluation

The assessment of the refractive state of the eye is a fundamental and important part of ophthalmic and optometric clinical practice. The development of an unsupervised online subjective r...

DNA Array Analysis of Patients With Cervical Cancer

Primary Objectives: 1. To obtain preliminary descriptive data on early changes in tumor DNA array expression following chemo-radiation of cervical cancer. These data will permit t...

Identifying Patients With Hereditary and Familial Colorectal Cancer by Using an Online Risk Tool

In this trial the investigators will evaluate the effectiveness of the implementation of a digital familial risk questionnaire in the detection of CRC patients with hereditary or familial ...

Comparison of Supervised and Unsupervised Physical Activity Programs During a Weight Loss Intervention for Adults

Adults who are overweight or obese are typically prescribed a calorie-restricted diet and physical activity to promote weight loss and improve health. The manner in which physical activity...

Medical and Biotech [MESH] Definitions

A MACHINE LEARNING paradigm used to make predictions about future instances based on a given set of unlabeled paired input-output training (sample) data.

Supporting content or information, such as animation, datasets, multimedia files, video, movies, audio files, text files, or software, which is submitted for publication in an online journal or an online edition of a journal. This information may be referenced in the text of the article with a link to the supplementary data provided. CATALOG: do not use

Systems where the input data enter the computer directly from the point of origin (usually a terminal or workstation) and/or in which output data are transmitted directly to that terminal point of origin. (Sippl, Computer Dictionary, 4th ed)

Information application based on a variety of coding methods to minimize the amount of data to be stored, retrieved, or transmitted. Data compression can be applied to various forms of data, such as images and signals. It is used to reduce costs and increase efficiency in the maintenance of large volumes of data.

Detection of drugs that have been abused, overused, or misused, including legal and illegal drugs. Urine screening is the usual method of detection.

Quick Search

DeepDyve research library

Relevant Topic

A diagnostic test is any kind of medical test performed to aid in the diagnosis or detection of disease. For example: to diagnose diseases to measure the progress or recovery from disease to confirm that a person is free from disease Clin...

Searches Linking to this Article