Deep Learning: Recurrent Neural Networks in Python
MP4 | Video: 1280x720 | Duration: 5 Hours | 600 MB | Source Files
Author: Lazy Programmer Inc | Language: English | Skill level: Intermediate
GRU, LSTM, + more modern deep learning, machine learning, and data science for sequences

We are going to revisit the XOR problem, but we're going to extend it so that it becomes the parity problem - you'll see that regular feedforward neural networks will have trouble solving this problem but recurrent networks will work because the key is to treat the input as a sequence.

In the next section of the course, we are going to revisit one of the most popular applications of recurrent neural networks - language modeling.

You saw when we studied Markov Models that we could do things like generate poetry and it didn't look too bad. We could even discriminate between 2 different poets just from the sequence of parts-of-speech tags they used.

In this course, we are going to extend our language model so that it no longer makes the Markov assumption.
Another popular application of neural networks for language is word vectors or word embeddings. The most common technique for this is called Word2Vec, but I'll show you how recurrent neural networks can also be used for creating word vectors.

In the section after, we'll look at the very popular LSTM, or long short-term memory unit, and the more modern and efficient GRU, or gated recurrent unit, which has been proven to yield comparable performance.

We'll apply these to some more practical problems, such as learning a language model from Wikipedia data and visualizing the word embeddings we get as a result.

This course focuses on "how to build and understand", not just "how to use". Anyone can learn to use an API in 15 minutes after reading some documentation. It's not about "remembering facts", it's about "seeing for yourself" via experimentation. It will teach you how to visualize what's happening in the model internally. If you want more than just a superficial look at machine learning models, this course is for you.

Requirements:
Calculus
Linear algebra
Python, Numpy, MatDescriptionlib
Write a neural network in Theano
Understand backpropagation
Probability (conditional and joint distributions)
Write a neural network in Tensorflow