Understanding Machine Learning: From Theory to Algorithms

Download Understanding Machine Learning tutorial, a complete eBook created by Shai Shalev-Shwartz and Shai Ben-David.

Machine learning is one of the fastest growing areas of computer science, with far-reaching applications. The aim of this textbook is to introduce machine learning, and the algorithmic paradigms it offers, in a principled way. The book provides an extensive theoretical account of the fundamental ideas underlying machine learning and the mathematical derivations that transform these principles into practical algorithms.

Following a presentation of the basics of the field, the book covers a wide array of central topics that have not been addressed by previous textbooks.

Table of contents

  • Introduction
  • What Is Learning?
  • When Do We Need Machine Learning?
  • Types of Learning
  • Relations to Other Fields
  • How to Read This Book
  • Possible Course Plans Based on This Book
  • Notation
  • Part I Foundations
  • A Formal Learning Model
  • PAC Learning
  • A More General Learning Model
  • Releasing the Realizability Assumption – Agnostic PAC
  • Learning
  • The Scope of Learning Problems Modeled
  • Summary
  • Bibliographic Remarks
  • Exercises
  • Learning via Uniform Convergence
  • Uniform Convergence Is Sufficient for Learnability
  • Examples
  • Threshold Functions
  • Intervals
  • Axis Aligned Rectangles
  • Finite Classes
  • VC-Dimension and the Number of Parameters
  • The Fundamental Theorem of PAC learning
  • Proof of Theorem
  • Characterizing Nonuniform Learnability
  • Structural Risk Minimization
  • Minimum Description Length and Occam’s Razor
  • Occam’s Razor
  • Other Notions of Learnability – Consistency
  • Discussing the Different Notions of Learnability
  • The No-Free-Lunch Theorem Revisited
  • Summary
  • Bibliographic Remarks
  • Exercises
  • The Runtime of Learning
  • Learning -Term DNF
  • Efficiently Learnable, but Not by a Proper ERM
  • Hardness of Learning*
  • Bibliographic Remarks
  • Exercises
  • Part II From Theory to Algorithms
  • Linear Regression
  • Least Squares
  • Linear Regression for Polynomial Regression Tasks
  • Logistic Regression
  • Bibliographic Remarks
  • Exercises
  • The VC-Dimension of L(B, T)
  • AdaBoost for Face Recognition
  • Bibliographic Re
  • xii Contents
  • k-Fold Cross Validation
  • Train-Validation-Test Split
  • What to Do If Learning Fails
  • Bibliographic Remarks
  • Exercises
  • Controlling the Fitting-Stability Tradeoff
  • Bibliographic Remarks
  • Exercises
  • Stochastic Gradient Descent
  • Gradient Descent
  • Analysis of GD for Convex-Lipschitz Functions
  • Stochastic Gradient Descent (SGD)
  • Analysis of SGD for Convex-Lipschitz-Bounded Functions
  • Learning with SGD
  • SGD for Risk Minimization
  • Analyzing SGD for Convex-Smooth Learning Problems
  • SGD for Regularized Loss Minimization
  • Bibliographic Remarks
  • Exercises
  • Support Vector Machines
  • Margin and Hard-SVM
  • Bibliographic Remarks
  • Exercises
  • Kernel Methods
  • Embeddings into Feature Spaces
  • The Kernel Trick
  • Kernels as a Way to Express Prior Knowledge
  • Characterizing Kernel Functions*
  • Implementing Soft-SVM with Kernels
  • Summary
  • Bibliographic Remarks
  • Exercises
  • Multiclass, Ranking, and Complex Prediction Problems
  • One-versus-All and All-Pairs
  • Linear Predictors for Ranking
  • Bipartite Ranking and Multivariate Performance Measures
  • Linear Predictors for Bipartite Ranking
  • Bibliographic Remarks
  • Exercises
  • Nearest Neighbor
  • Analysis
  • A Generalization Bound for the -NN Rule
  • Feedforward Neural Networks
  • Learning Neural Networks
  • The Expressive Power of Neural Networks
  • Geometric Intuition
  • The Sample Complexity of Neural Networks
  • The Runtime of Learning Neural Networks
  • SGD and Backpropagation
  • Contents xv
  • Online Learnability
  • Online Classification in the Unrealizable Case
  • Weighted-Majority
  • Online Convex Optimization
  • The Online Perceptron Algorithm
  • Summary
  • Bibliographic Remarks
  • The k-Means Algorithm
  • Spectral Clustering
  • Graph Cut
  • Graph Laplacian and Relaxed Graph Cuts
  • Unnormalized Spectral Clustering
  • Information Bottleneck*
  • Maximum Likelihood Estimation for Continuous Random Variables
  • Maximum Likelihood and Empirical Risk Minimization
  • Linear Discriminant Analysis
  • Latent Variables and the EM Algorithm

 

Size : 2540.539 Kb
File type : pdf
Downloads: 280
Created: 2019-05-01
Understanding Machine Learning: From Theory to Algorithms

Others Machine Learning Tutorials

Machine Learning for Cyber Physical Systems

Overview of Machine Learning

Understanding Machine Learning

Interpretable Machine Learning

Machine Learning: The Complete Guide

Others related eBooks about Understanding Machine Learning: From Theory to Algorithms

Made With Creative Commons

Download free course Made With Creative Commons, pdf file on 176 pages by Paul Stacey, Sarah Hinchliff Pearson....

Notes on Diffy Qs: Differential Equations for Engineers

An introductory course on differential equations aimed at engineers. The book covers first order ODEs, higher order linear ODEs, systems of ODEs, Fourier series and PDEs, eigenvalue problems, the Laplace transform, and power series methods. The book originated as class notes for Math 286 at the Univ...

The DSC Book

Download free course The DSC Book, pdf file on 12 pages by Don Jones, Steve Murawski....

How To Code in Go

Download free course How To Code in Go, pdf file on 447 pages by Mark Bates, Cory LaNou, Tim Raymond....

iOS Developer Notes for Professionals

Download free course iOS Developer Notes for Professionals, pdf file on 893 pages by Stack Overflow Community....

Essential iOS

This book written to provide clear and concise explanation of topics for programmers both starting to learn the iOS programming as well as those diving in more complex topics. Most examples are linked to online playground that allows you to change the code and re-run it....

Exploring Cloud Computing

Cloud Computing is enabling many trends in IT today: microservices, pay-as-you-go pricing,..., download free Cloud Computing tutorial in PDF (121 pages) created by ....

Open Source Systems: Towards Robust Practices

Download free course Open Source Systems: Towards Robust Practices, pdf file on 225 pages by Federico Balaguer, Roberto Di Cosmo, Alejandra Garrido, Fabio Kon, Gregorio Robles, Stefano Zacchiroli....

LaTeX in 24 Hours

Download free course LaTeX in 24 Hours, pdf file on 309 pages by Dilip Datta....

Yet Another Introductory Number Theory Textbook (Cryptology Emphasis Version)

This introductory number theory textbook has a particular emphasis on connections to cryptology. ...