Deep Learning in Neural Networks: An Overview

In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarises relevant work, much of it from the previous millennium. Shallow and deep learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. It reviews deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.

This is the preprint of an invited Deep Learning (DL) overview. One of its goals is to assign credit to those who contributed to the present state of the art. It acknowledges the limitations of attempting to achieve this goal. The DL research community itself may be viewed as a continually evolving, deep network of scientists who have influenced each other in complex ways. Starting from recent DL results, It tried to trace back the origins of relevant ideas through the past half century and beyond, sometimes using "local search" to follow citations of citations backwards in time. Since not all DL publications properly acknowledge earlier relevant work, additional global search strategies were employed, aided by consulting numerous neural network experts. As a result, the present preprint mostly consists of references.

Pages : N/A
Size : PDF (206 pages)
File type : pdf
Downloads: 12
Created: 2020-08-28
License: Non-exclusive License to Distribute
Author(s): Juergen Schmidhuber
Deep Learning in Neural Networks: An Overview

Warning: Trying to access array offset on false in /home/tutovnfz/public_html/article.php on line 233

Others Deep learning Tutorials

GANs in Action: Deep Learning with Generative Adversarial Networks

Deep Learning and the Game of Go

Neural Networks and Deep Learning

Others related eBooks about Deep Learning in Neural Networks: An Overview

Invent Your Own Computer Games with Python

Download free course Invent Your Own Computer Games with Python, pdf file on 367 pages by Al Sweigart....

Coding for kids

This PDF book teaches you how to encourage your kids to code at home, a guide to empowering kids with coding skills....

Professor Frisby's Mostly Adequate Guide to Functional Programming

This is a book on the functional paradigm in general. We'll use the world's most popular f..., download free Functional Programming tutorial in PDF (146 pages) created by Brian Lonsdorf ....

How to Build a SharePoint Website

Download free SharePoint tutorial in pdf, training document on 11 pages for beginners....

An Introduction to Programming in Go

Learning Go language, free PDF tutorial in 168 pages. Go is an ideal language to learn as your first programming language....

Learning Laravel by examples

With this PDF tutorial you will learn how to build a web application with Laravel PHP Framework version 4, free training document under 58 pages....

Programming Fundamentals

This programming fundamentals tutorial in PDF format covers the key concepts and principles that are essential for anyone looking to become a proficient coder. The tutorial begins with an introduction to programming, explaining the basic concepts and terminologies that underlie all programming langu...

Android Programming Basics

Start learning development mobile with this tutorial ,it's an easy trainig document in PDF the about of Android Programming ,free courses under 22 pages for beginners....

Getting started with Xcode

Download free Xcode tutorial course in PDF, training file in 11 chapters and 49 pages. Free unaffiliated ebook created from Stack OverFlow contributor....

Defensive Database Programming with SQL Server

Download free course Defensive Database Programming with SQL Server, pdf file on 389 pages by Alex Kuznetsov....