In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarises relevant work, much of it from the previous millennium. Shallow and deep learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. It reviews deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.
This is the preprint of an invited Deep Learning (DL) overview. One of its goals is to assign credit to those who contributed to the present state of the art. It acknowledges the limitations of attempting to achieve this goal. The DL research community itself may be viewed as a continually evolving, deep network of scientists who have influenced each other in complex ways. Starting from recent DL results, It tried to trace back the origins of relevant ideas through the past half century and beyond, sometimes using "local search" to follow citations of citations backwards in time. Since not all DL publications properly acknowledge earlier relevant work, additional global search strategies were employed, aided by consulting numerous neural network experts. As a result, the present preprint mostly consists of references.
Pages : | N/A |
Size : | PDF (206 pages) |
File type : | |
Downloads: | 12 |
Created: | 2020-08-28 |
License: | Non-exclusive License to Distribute |
Author(s): | Juergen Schmidhuber |
GANs in Action: Deep Learning with Generative Adversarial Networks
Download free course Invent Your Own Computer Games with Python, pdf file on 367 pages by Al Sweigart....
Coding for kidsThis PDF book teaches you how to encourage your kids to code at home, a guide to empowering kids with coding skills....
Professor Frisby's Mostly Adequate Guide to Functional ProgrammingThis is a book on the functional paradigm in general. We'll use the world's most popular f..., download free Functional Programming tutorial in PDF (146 pages) created by Brian Lonsdorf ....
How to Build a SharePoint WebsiteDownload free SharePoint tutorial in pdf, training document on 11 pages for beginners....
An Introduction to Programming in GoLearning Go language, free PDF tutorial in 168 pages. Go is an ideal language to learn as your first programming language....
Learning Laravel by examplesWith this PDF tutorial you will learn how to build a web application with Laravel PHP Framework version 4, free training document under 58 pages....
Programming FundamentalsThis programming fundamentals tutorial in PDF format covers the key concepts and principles that are essential for anyone looking to become a proficient coder. The tutorial begins with an introduction to programming, explaining the basic concepts and terminologies that underlie all programming langu...
Android Programming BasicsStart learning development mobile with this tutorial ,it's an easy trainig document in PDF the about of Android Programming ,free courses under 22 pages for beginners....
Getting started with XcodeDownload free Xcode tutorial course in PDF, training file in 11 chapters and 49 pages. Free unaffiliated ebook created from Stack OverFlow contributor....
Defensive Database Programming with SQL ServerDownload free course Defensive Database Programming with SQL Server, pdf file on 389 pages by Alex Kuznetsov....