Advanced Deep Learning - Week 7


Course starts soon..


QUIZ


We will start now with a quiz based on the first week material

You have 6 minutes to answer the quiz.

The quiz link:
Quiz Link
It will be copied in Mattermost and in the Zoom chat.

Sessions

  • 07 June: Natural Language Processing and Word Embeddings
  • 14 June: Sequence Models and Attention Mechanism
  • 21 June: Transformer Network
  • 28 June: Final Presentation

Waterkant

03-12 June

Hackathon

04-05 June

Schedule

The Challenges

Open Questions (10 Minutes)


  1. Why were RNN so important for the development in neural network, what characteristics did they have, that previous architecture did not have?
  2. What is the fundamental problem LSTM are tackling and how is this solved?
  3. What are the advantages and disadvantages of bidirectional RNNs? When would you use them and when not?

Discussion


The unreasonable effectiveness of RNNs

Understanding LSTMs

Bidirectional RNNs

Homeworks

Building a RNN - Step by Step

Character Level Language Model

Jazz Improvisation with LSTM

Register your project

Fill out this Form

For the next week

  • Homework on Operations on Word Vectors
  • Homework on Emojifying