This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 1 On the Impact of Approximate Computation in an Ana

• Main Authors: Steven Young, Student Member, Junjie Lu, Jeremy Holleman, Itamar Arel, Senior Member
• Other Authors: The Pennsylvania State University CiteSeerX Archives
• Format: Text
• Language: English
• Subjects: DML
• Online Access: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.464.3882; http://web.eecs.utk.edu/~itamar/Papers/TNNLS_Young_2013.pdf

Abstract — Deep machine learning (DML) holds the potential to revolutionize machine learning by automating rich feature extraction, which has become the primary bottleneck of human engineering in pattern recognition systems. However, the heavy computational burden renders DML systems implemented on conventional digital processors impractical for large-scale prob-lems. The highly parallel computations required to implement large-scale deep learning systems are well suited to custom hard-ware. Analog computation has demonstrated power efficiency advantages of multiple orders of magnitude relative to digital systems while performing nonideal computations. In this paper, we investigate typical error sources introduced by analog compu-tational elements and their impact on system-level performance in DeSTIN—a compositional deep learning architecture. These inaccuracies are evaluated on a pattern classification benchmark, clearly demonstrating the robustness of the underlying algorithm to the errors introduced by analog computational elements. A clear understanding of the impacts of nonideal computations is necessary to fully exploit the efficiency of analog circuits. Index Terms — Analog circuits, analog computation, deep machine learning, feature extraction, floating gates.