2022-12 CESI - Deep Learning

What does NLP stand for?

Answer explanation

Natural Language Processing

What is NLP in French?

Answer explanation

TAL -Traitement Automatique du Langage

What can you use to model sentences?

Answer explanation

Bag of words

Word embeddings

What is the main disadvantage of

bag of words?

Answer explanation

Does not model the order.

Which of these sequence modeling problems can be handle by RNN?

• One to Many

• Many to Many

• Many to One

• One to One

In a RNN cell, what is the equation to update h_t ?

• tanh(W . x_t + W.h_t-1)

• tanh(W_hx.x_t + W_hh.h_t-1)

• tanh(W_hx.x_t) + tanh(W_hh.h_t-1)

• sigmoid(W_hx.x_t + W_hh.h_t-1)

How many weight matrices do we have in a basic RNN cell?

• 1

• 2

• 3

• 4

Answer explanation

What are the advantages of a RNN about sequence modeling?

• Track short-term dependencies

• Share parameters across the sequence

• Handle variable-length sequences

• Maintain information about order

• Handle fixed-length sequences

Name one disadvantage of a basic RNN

Name one trick to mitigate vanishing gradients