2022-12 CESI - Deep Learning

What does NLP stand for?

Evaluate responses using AI:

OFF

Answer explanation

Natural Language Processing

What is NLP in French?

Evaluate responses using AI:

OFF

Answer explanation

TAL -Traitement Automatique du Langage

What can you use to model sentences?

Evaluate responses using AI:

OFF

Answer explanation

Bag of words

Word embeddings

What is the main disadvantage of

bag of words?

Evaluate responses using AI:

OFF

Answer explanation

Does not model the order.

Which of these sequence modeling problems can be handle by RNN?

• One to Many

• Many to Many

• Many to One

• One to One

In a RNN cell, what is the equation to update h_t ?

• tanh(W . x_t + W.h_t-1)

• tanh(W_hx.x_t + W_hh.h_t-1)

• tanh(W_hx.x_t) + tanh(W_hh.h_t-1)

• sigmoid(W_hx.x_t + W_hh.h_t-1)

How many weight matrices do we have in a basic RNN cell?

• 1

• 2

• 3

• 4

Answer explanation

What are the advantages of a RNN about sequence modeling?

• Track short-term dependencies

• Share parameters across the sequence

• Handle variable-length sequences

• Maintain information about order

• Handle fixed-length sequences

Name one disadvantage of a basic RNN

Evaluate responses using AI:

OFF

Name one trick to mitigate vanishing gradients

Evaluate responses using AI:

OFF