Week 2: Neural network training

This week, you'll learn how to train your model in TensorFlow, and also learn about other important activation functions (besides the sigmoid function), and where to use each type in a neural network. You'll also learn how to go beyond binary...

Learning Objectives

• Train a neural network on data using TensorFlow

• Understand the difference between various activation functions (sigmoid, ReLU, and linear)

• Understand which activation functions to use for which type of layer

• Understand why we need non-linear activation functions

• Understand multiclass classification

• Calculate the softmax activation for implementing multiclass classification

• Use the categorical cross entropy loss function for multiclass classification

• Use the recommended method for implementing multiclass classification in code

• (Optional): Explain the difference between multi-label and multiclass classification

• Overview of Machine Learning

Neural Network Training

TensorFlow implementation - Video • Duration: 3 min Training Details - Video • Duration: 13 min

Practice quiz: Neural Network Training

Practice quiz: Neural Network Training

Activation Functions

Alternatives to the sigmoid activation - Video • Duration: 5 min Choosing activation functions - Video • Duration: 8 min Why do we need activation functions? - Video • Duration: 5 min ReLU activation - Lab • Duration: 1 H

Practice quiz: Activation Functions

Practice quiz: Activation Functions

Multiclass Classification

Multiclass - Video • Duration: 3 min Softmax - Video • Duration: 11 min Neural Network with Softmax output - Video • Duration: 7 min Improved implementation of softmax - Video • Duration: 9 min Classification with multiple outputs (Optional) - Video • Duration: 4 min Softmax - Lab • Duration: 1 H Multiclass - Lab • Duration: 15 min

Practice quiz: Multiclass Classification

Practice quiz: Multiclass Classification

Additional Neural Network Concepts

Advanced Optimization - Video • Duration: 6 min Additional Layer Types - Video • Duration: 8 min

Practice quiz: Additional Neural Network Concepts

Practice quiz: Additional Neural Network Concepts

Practice Lab: Neural Networks for Multiclass classification

Practice Lab: Neural Networks for Multiclass classification