Deep Learning in Neural Networks: An Overview

In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarises relevant work, much of it from the previous millennium. Shallow and deep learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. It reviews deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.

This is the preprint of an invited Deep Learning (DL) overview. One of its goals is to assign credit to those who contributed to the present state of the art. It acknowledges the limitations of attempting to achieve this goal. The DL research community itself may be viewed as a continually evolving, deep network of scientists who have influenced each other in complex ways. Starting from recent DL results, It tried to trace back the origins of relevant ideas through the past half century and beyond, sometimes using "local search" to follow citations of citations backwards in time. Since not all DL publications properly acknowledge earlier relevant work, additional global search strategies were employed, aided by consulting numerous neural network experts. As a result, the present preprint mostly consists of references.

PagesN/A
SizePDF (206 pages)
File typepdf
Downloads12
Created2020-08-28
LicenseNon-exclusive License to Distribute
Author(s)Juergen Schmidhuber
Cover of Deep Learning in Neural Networks: An Overview

Download

  • Getting started with MongoDB

    MongoDB is a document-oriented NoSQL database. As we will see, the whole system revolves around this document management, including the query language, which makes it its strong point. We are going to tackle now the setting up of a Mongo server and how to integrate your data in this environment....

  • Think Java, 2nd Edition

    Think Java is a hands-on introduction to computer science and programming used by many uni..., download free Java tutorial in PDF (326 pages) created by ....

  • Programming Windows Store Apps with HTML, CSS, and JavaScript

    Download free course Programming Windows Store Apps with HTML, CSS, and JavaScript, pdf file on 1311 pages by Kraig Brockschmidt....

  • Raspberry Pi Camera Guide

    Download free course Raspberry Pi Camera Guide, pdf file on 132 pages by Dan Aldred, Wesley Archer, Jody Carter, PJ Evans, Richard Hayler, James Singleton, Rob Zwetsloot....

  • The Pascal Programming Language

    This tutorial will give you great understanding on Pascal Programming concepts, Download free PDF training course on 13 pages by B.A.C. Schopman....

  • Annotated Algorithms in Python: with Applications in Physics, Biology, and Finance

    This book is assembled from lectures given by the author over a period of 10 years at the School of Computing of DePaul University. The lectures cover multiple classes, including Analysis and Design of Algorithms, Scientific Computing, Monte Carlo Simulations, and Parallel Algorithms. These lectur...

  • Getting started with Hibernate

    Download free Hibernate tutorial course in PDF, training file in 14 chapters and 39 pages. Free unaffiliated ebook created from Stack OverFlow contributor....

  • How To Code in Go

    This book is designed to introduce you to writing programs with the Go programming languag..., download free Go tutorial in PDF (447 pages) created by Cory LaNou ....

  • Fundamentals of Python Programming

    This book does not attempt to cover all the facets of the Python programming language. Exp..., download free Python tutorial in PDF (669 pages) created by ....

  • Cobol programmer's guide

    Download a complet PDF tutorial about Cobol for programmers ,it shows you how to develop COBOL programs that use the database languages SQL and PL/SQL....