Deep Learning in Neural Networks: An Overview

In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarises relevant work, much of it from the previous millennium. Shallow and deep learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. It reviews deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.

This is the preprint of an invited Deep Learning (DL) overview. One of its goals is to assign credit to those who contributed to the present state of the art. It acknowledges the limitations of attempting to achieve this goal. The DL research community itself may be viewed as a continually evolving, deep network of scientists who have influenced each other in complex ways. Starting from recent DL results, It tried to trace back the origins of relevant ideas through the past half century and beyond, sometimes using "local search" to follow citations of citations backwards in time. Since not all DL publications properly acknowledge earlier relevant work, additional global search strategies were employed, aided by consulting numerous neural network experts. As a result, the present preprint mostly consists of references.

Pages : N/A
Size : PDF (206 pages)
File type : pdf
Downloads: 12
Created: 2020-08-28
License: Non-exclusive License to Distribute
Author(s): Juergen Schmidhuber
Deep Learning in Neural Networks: An Overview

Warning: Trying to access array offset on false in /home/tutovnfz/public_html/article.php on line 233

Others Deep learning Tutorials

GANs in Action: Deep Learning with Generative Adversarial Networks

Deep Learning and the Game of Go

Neural Networks and Deep Learning

Others related eBooks about Deep Learning in Neural Networks: An Overview

Practices of the Python Pro

Download free course Practices of the Python Pro, pdf file on 248 pages by Dane Hillard....

Deep Learning with JavaScript

Download free course Deep Learning with JavaScript, pdf file on 560 pages by Shanqing Cai, Stanley Bileschi, Eric D. Nielsen, Francois Chollet....

Problem Solving with Algorithms and Data Structures Using Python

THIS TEXTBOOK is about computer science. It is also about Python. However, there is much more. The study of algorithms and data structures is central to understanding what computer science is all about. Learning computer science is not unlike learning any other type of difficult subject matter. Th...

Create a C# Project with Visual Studio Code free PDF

Download free course Create a C# Project with Visual Studio Code free PDF, pdf file on 6 pages by tutorialkart.com....

Building iPhone Apps with HTML, CSS, and JavaScript

Download free course Building iPhone Apps with HTML, CSS, and JavaScript, pdf file on 186 pages by by Jonathan Stark....

Algorithms and Data Structures With Applications to Graphics and Geometry

An introductory coverage of algorithms and data structures with application to graphics and geometry. ...

Learning .NET Framework PDF course

Download free Dot net tutorial course in PDF, training file in 59 chapters and 241 pages. Free unaffiliated ebook created from Stack OverFlow contributor....

Exploring Swift

Swift is more than just a modern replacement for Objective-C. Ever since going open source..., download free Swift tutorial in PDF (94 pages) created by ....

An Introduction to C & GUI Programming

Even if you are an absolute beginner, this book will teach you all you need to know to wri..., download free C Programming tutorial in PDF (156 pages) created by Simon Long ....

The Vue.js Handbook

Download free course The Vue.js Handbook, pdf file on 122 pages by Flavio Copes....