Deep Machine Learning with Spatio-Temporal Inference
Deep Machine Learning (DML) refers to methods which utilize hierarchies of more than one or two layers of computational elements to achieve learning. DML may draw upon biomemetic models, or may be simply biologically-inspired. Regardless, these architectures seek to employ hierarchical processing as...
Main Author: | |
---|---|
Format: | Text |
Language: | unknown |
Published: |
TRACE: Tennessee Research and Creative Exchange
2012
|
Subjects: | |
Online Access: | https://trace.tennessee.edu/utk_graddiss/1315 https://trace.tennessee.edu/cgi/viewcontent.cgi?article=2442&context=utk_graddiss |
id |
ftunivtennknox:oai:trace.tennessee.edu:utk_graddiss-2442 |
---|---|
record_format |
openpolar |
spelling |
ftunivtennknox:oai:trace.tennessee.edu:utk_graddiss-2442 2023-05-15T16:01:36+02:00 Deep Machine Learning with Spatio-Temporal Inference Karnowski, Thomas Paul 2012-05-01T07:00:00Z application/pdf https://trace.tennessee.edu/utk_graddiss/1315 https://trace.tennessee.edu/cgi/viewcontent.cgi?article=2442&context=utk_graddiss unknown TRACE: Tennessee Research and Creative Exchange https://trace.tennessee.edu/utk_graddiss/1315 https://trace.tennessee.edu/cgi/viewcontent.cgi?article=2442&context=utk_graddiss Doctoral Dissertations Machine Learning Image Processing Other Computer Engineering text 2012 ftunivtennknox 2022-03-02T20:12:44Z Deep Machine Learning (DML) refers to methods which utilize hierarchies of more than one or two layers of computational elements to achieve learning. DML may draw upon biomemetic models, or may be simply biologically-inspired. Regardless, these architectures seek to employ hierarchical processing as means of mimicking the ability of the human brain to process a myriad of sensory data and make meaningful decisions based on this data. In this dissertation we present a novel DML architecture which is biologically-inspired in that (1) all processing is performed hierarchically; (2) all processing units are identical; and (3) processing captures both spatial and temporal dependencies in the observations to organize and extract features suitable for supervised learning. We call this architecture Deep Spatio-Temporal Inference Network (DeSTIN). In this framework, patterns observed in pixel data at the lowest layer of the hierarchy are organized and fit to generalizations using decomposition algorithms. Subsequent spatial layers draw upon previous layers, their own temporal observations and beliefs, and the observations and beliefs of parent nodes to extract features suitable for supervised learning using standard classifiers such as feedforward neural networks. Hence, DeSTIN is viewed as an unsupervised feature extraction scheme in the sense that rather than relying on human engineering to determine features for a particular problem, DeSTIN naturally constructs features of interest by representing salient regularities in the patterns observed. Detailed discussion and analysis of the DeSTIN framework is provided, including focus on its key components of generalization through online clustering and temporal inference. We present a variety of implementation details, including static and dynamic learning formulations, and function approximation methods. Results on standardized datasets of handwritten digits as well as face and optic nerve detection are presented, illustrating the efficacy of the proposed approach. Text DML University of Tennessee, Knoxville: Trace |
institution |
Open Polar |
collection |
University of Tennessee, Knoxville: Trace |
op_collection_id |
ftunivtennknox |
language |
unknown |
topic |
Machine Learning Image Processing Other Computer Engineering |
spellingShingle |
Machine Learning Image Processing Other Computer Engineering Karnowski, Thomas Paul Deep Machine Learning with Spatio-Temporal Inference |
topic_facet |
Machine Learning Image Processing Other Computer Engineering |
description |
Deep Machine Learning (DML) refers to methods which utilize hierarchies of more than one or two layers of computational elements to achieve learning. DML may draw upon biomemetic models, or may be simply biologically-inspired. Regardless, these architectures seek to employ hierarchical processing as means of mimicking the ability of the human brain to process a myriad of sensory data and make meaningful decisions based on this data. In this dissertation we present a novel DML architecture which is biologically-inspired in that (1) all processing is performed hierarchically; (2) all processing units are identical; and (3) processing captures both spatial and temporal dependencies in the observations to organize and extract features suitable for supervised learning. We call this architecture Deep Spatio-Temporal Inference Network (DeSTIN). In this framework, patterns observed in pixel data at the lowest layer of the hierarchy are organized and fit to generalizations using decomposition algorithms. Subsequent spatial layers draw upon previous layers, their own temporal observations and beliefs, and the observations and beliefs of parent nodes to extract features suitable for supervised learning using standard classifiers such as feedforward neural networks. Hence, DeSTIN is viewed as an unsupervised feature extraction scheme in the sense that rather than relying on human engineering to determine features for a particular problem, DeSTIN naturally constructs features of interest by representing salient regularities in the patterns observed. Detailed discussion and analysis of the DeSTIN framework is provided, including focus on its key components of generalization through online clustering and temporal inference. We present a variety of implementation details, including static and dynamic learning formulations, and function approximation methods. Results on standardized datasets of handwritten digits as well as face and optic nerve detection are presented, illustrating the efficacy of the proposed approach. |
format |
Text |
author |
Karnowski, Thomas Paul |
author_facet |
Karnowski, Thomas Paul |
author_sort |
Karnowski, Thomas Paul |
title |
Deep Machine Learning with Spatio-Temporal Inference |
title_short |
Deep Machine Learning with Spatio-Temporal Inference |
title_full |
Deep Machine Learning with Spatio-Temporal Inference |
title_fullStr |
Deep Machine Learning with Spatio-Temporal Inference |
title_full_unstemmed |
Deep Machine Learning with Spatio-Temporal Inference |
title_sort |
deep machine learning with spatio-temporal inference |
publisher |
TRACE: Tennessee Research and Creative Exchange |
publishDate |
2012 |
url |
https://trace.tennessee.edu/utk_graddiss/1315 https://trace.tennessee.edu/cgi/viewcontent.cgi?article=2442&context=utk_graddiss |
genre |
DML |
genre_facet |
DML |
op_source |
Doctoral Dissertations |
op_relation |
https://trace.tennessee.edu/utk_graddiss/1315 https://trace.tennessee.edu/cgi/viewcontent.cgi?article=2442&context=utk_graddiss |
_version_ |
1766397390264205312 |