Deep Learning Rita Singh and Bhiksha Raj First published: August 2020 Publisher: IDL Scientific Press Copyright © 2020 Rita Singh, Bhiksha Raj ISBN: 978-1-7344465-8-6

New Note from 2022: We have resumed writing this book in July 2022, after a long setback that hit us when Chapter 4 was midway. We will try to finish this book blazingly fast for you now. Please support us by citing it, or citing its chapters whenever you can. They may not be fully polished, but enough to chew on.

Old Note from 2020: Note: This book is being written in tandem with the Fall 2020 IDL course. Since writing a book is generally a (very) slow process, chapters will appear here as and when they are completed. Realistically speaking, since this book is expected to have 26 chapters and well over 1000 pages, it unfortunately can't be completed in one semester. We will put up the chapters right from their very first drafts (which are usually very rough), to maximize the benefits to students. Cosmetic issues will be fixed once the book is complete. All book-related comments (thanks in advance for spotting and reporting mistakes) can be emailed to rsingh@cs.cmu.edu

Chapter pdfs have clickable cross-referencing, will show up when you read them on Adobe reader. Please check periodically for updates. The dates mentioned will only pertain to subject content updates, and not to cosmetic updates (formatting, figure quality etc.).

Chapters

Part I Introduction

1. Chapter 1: Introduction to neural networks To cite this chapter use: Introduction to neural networks, Rita Singh and Bhiksha Raj, In Deep Learning, Part I, Chapter 1. September 2020. DOI: 10.5281/zenodo.6848037

2. Chapter 2: Neural networks as universal approximators, and the issue of depth To cite this chapter use: Neural networks as universal approximators, and the issue of depth, Rita Singh and Bhiksha Raj, In Deep Learning, Part I, Chapter 2. September 2020. DOI: 0.5281/zenodo.6849375

Part II Training

3. Chapter 3: Learning a neural network: Part 1 To cite this chapter use: Learning a neural network: Part 1, Rita Singh and Bhiksha Raj, In Deep Learning, Part II, Chapter 3. October 2020. DOI: 0.5281/zenodo.6969128

4. Learning a neural network: Part 2 Coming up next...