Deep Learning in Neural Networks: An Overview
In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarises relevant work, much of it from the previous millennium. Shallow and deep learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. It reviews deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.
This is the preprint of an invited Deep Learning (DL) overview. One of its goals is to assign credit to those who contributed to the present state of the art. It acknowledges the limitations of attempting to achieve this goal. The DL research community itself may be viewed as a continually evolving, deep network of scientists who have influenced each other in complex ways. Starting from recent DL results, It tried to trace back the origins of relevant ideas through the past half century and beyond, sometimes using "local search" to follow citations of citations backwards in time. Since not all DL publications properly acknowledge earlier relevant work, additional global search strategies were employed, aided by consulting numerous neural network experts. As a result, the present preprint mostly consists of references.
| Pages : | N/A |
| Size : | PDF (206 pages) |
| File type : | |
| Downloads: | 12 |
| Created: | 2020-08-28 |
| License: | Non-exclusive License to Distribute |
| Author(s): | Juergen Schmidhuber |
Warning: Trying to access array offset on false in /home/tutovnfz/public_html/article.php on line 233
Others Deep learning Tutorials
Deep Learning and the Game of Go
Neural Networks and Deep Learning
GANs in Action: Deep Learning with Generative Adversarial Networks
Others related eBooks about Deep Learning in Neural Networks: An Overview
Learning Ruby on RailsDownload free course Learning Ruby on Rails, pdf file on 291 pages by Stack Overflow Community....
A Practical Introduction to Python ProgrammingThis book is for anyone who wants to understand Python programming. It is degigned as partly a tutorial and partly a reference of Python....
Deep Learning and the Game of GoThe ancient strategy game of Go is an incredible case study for AI. In 2016, a deep learning-based system shocked the Go world by defeating a world champion. Shortly after that, the upgraded AlphaGo Zero crushed the original bot by using deep reinforcement learning to master the game. Now, you can l...
3D Game Development with LWJGL 3Download free course 3D Game Development with LWJGL 3, pdf file on 371 pages by Self-publishing....
Practices of the Python ProDownload free course Practices of the Python Pro, pdf file on 248 pages by Dane Hillard....
Visual Basic .NET Notes for ProfessionalsDownload free course Visual Basic .NET Notes for Professionals, pdf file on 148 pages by Stack Overflow Community....
C programming, C and C notesDownload PDF course about C Programming, free document in 134 pages for beginners students....
Real-Time ASP.NET Core 3 Apps with SignalR SuccinctlyDownload free course Real-Time ASP.NET Core 3 Apps with SignalR Succinctly, pdf file on 81 pages by Dirk Strauss....
: Just Enough R: Learn Data Analysis with R in a DayLearn R programming for data analysis in a single day. The book aims to teach data analysis using R within a single day to anyone who already knows some programming in any other language. The book has sample code which can be downloaded as a zip file. ...
Learning Regular ExpressionsA regular expression (regex or regexp) is a sequence of characters that define a search pa..., download free Regular Expressions tutorial in PDF (94 pages) created by ....