In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarises relevant work, much of it from the previous millennium. Shallow and deep learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. It reviews deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.
This is the preprint of an invited Deep Learning (DL) overview. One of its goals is to assign credit to those who contributed to the present state of the art. It acknowledges the limitations of attempting to achieve this goal. The DL research community itself may be viewed as a continually evolving, deep network of scientists who have influenced each other in complex ways. Starting from recent DL results, It tried to trace back the origins of relevant ideas through the past half century and beyond, sometimes using "local search" to follow citations of citations backwards in time. Since not all DL publications properly acknowledge earlier relevant work, additional global search strategies were employed, aided by consulting numerous neural network experts. As a result, the present preprint mostly consists of references.
Pages : | N/A |
Size : | PDF (206 pages) |
File type : | |
Downloads: | 12 |
Created: | 2020-08-28 |
License: | Non-exclusive License to Distribute |
Author(s): | Juergen Schmidhuber |
Deep Learning and the Game of Go
GANs in Action: Deep Learning with Generative Adversarial Networks
If you want to understand computer science, but have no programming experience, this book is for you. Think Java starts with the most basic programming concepts and carefully defines every term when it's first used. The authors then develop each new concept in a logical progression. Larger pieces ...
Think Perl 6: How to Think Like a Computer ScientistWant to learn how to program and think like a computer scientist? This practical guide gets you started on your programming journey with the help of Perl 6, the younger sister of the popular Perl programming language. Ideal for beginners, this hands-on book includes over 100 exercises with multiple ...
RESTful Web Services Quick GuideRESTful Service quick guide ,this PDF tutorial provides some recommendations for Creating best Web Services project. Free training document course material on 30 pages by Todd Fredrich....
Learning Python languageComplete Python language tutorial, courses, exercises and Python language examples designed for developers who want to learn the basics of this language. PDF document on 1067 pages created by StackOverFlow....
HTML, CSS, Bootstrap, Javascript and jQuery in PDFFree tutorial to download about HTML, CSS, Bootstrap, Javascript and jQuery, pdf document course in 72 pages created by Meher Krishna Patel....
O'Reilly® Think Python, 2nd Edition, - How to Think Like a Computer ScientistThink Python is an introduction to Python programming for students with no programming experience. It starts with the most basic concepts of programming, and is carefully designed to define all terms when they are first used and to develop each new concept in a logical progression. Larger pieces, ...
PC Assembly LanguageThis book has extensive coverage of interfacing assembly and C code and so might be of int..., download free Assembly tutorial in PDF (190 pages) created by Paul Carter ....
Kotlin tutorial in PDFThis Kotlin pdf tutorial will teach you how to develop with Kotlin on Android Studio as part of the mobile development for Android platforms....
Pointers - C++ coursePDF course about C++ and pointers, free document in 65 pages....
Learning C++Download free course Learning C++, pdf file on 897 pages by Stack Overflow Community....