In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarises relevant work, much of it from the previous millennium. Shallow and deep learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. It reviews deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.
This is the preprint of an invited Deep Learning (DL) overview. One of its goals is to assign credit to those who contributed to the present state of the art. It acknowledges the limitations of attempting to achieve this goal. The DL research community itself may be viewed as a continually evolving, deep network of scientists who have influenced each other in complex ways. Starting from recent DL results, It tried to trace back the origins of relevant ideas through the past half century and beyond, sometimes using "local search" to follow citations of citations backwards in time. Since not all DL publications properly acknowledge earlier relevant work, additional global search strategies were employed, aided by consulting numerous neural network experts. As a result, the present preprint mostly consists of references.
Pages : | N/A |
Size : | PDF (206 pages) |
File type : | |
Downloads: | 12 |
Created: | 2020-08-28 |
License: | Non-exclusive License to Distribute |
Author(s): | Juergen Schmidhuber |
GANs in Action: Deep Learning with Generative Adversarial Networks
Download free course Practices of the Python Pro, pdf file on 248 pages by Dane Hillard....
Deep Learning with JavaScriptDownload free course Deep Learning with JavaScript, pdf file on 560 pages by Shanqing Cai, Stanley Bileschi, Eric D. Nielsen, Francois Chollet....
Problem Solving with Algorithms and Data Structures Using PythonTHIS TEXTBOOK is about computer science. It is also about Python. However, there is much more. The study of algorithms and data structures is central to understanding what computer science is all about. Learning computer science is not unlike learning any other type of difficult subject matter. Th...
Create a C# Project with Visual Studio Code free PDFDownload free course Create a C# Project with Visual Studio Code free PDF, pdf file on 6 pages by tutorialkart.com....
Building iPhone Apps with HTML, CSS, and JavaScriptDownload free course Building iPhone Apps with HTML, CSS, and JavaScript, pdf file on 186 pages by by Jonathan Stark....
Algorithms and Data Structures With Applications to Graphics and GeometryAn introductory coverage of algorithms and data structures with application to graphics and geometry. ...
Learning .NET Framework PDF courseDownload free Dot net tutorial course in PDF, training file in 59 chapters and 241 pages. Free unaffiliated ebook created from Stack OverFlow contributor....
Exploring SwiftSwift is more than just a modern replacement for Objective-C. Ever since going open source..., download free Swift tutorial in PDF (94 pages) created by ....
An Introduction to C & GUI ProgrammingEven if you are an absolute beginner, this book will teach you all you need to know to wri..., download free C Programming tutorial in PDF (156 pages) created by Simon Long ....
The Vue.js HandbookDownload free course The Vue.js Handbook, pdf file on 122 pages by Flavio Copes....