AI Model Pre-training Flashcard

Front

What is the main aim of pre-training in AI models?

Back

To build a general model that can be adapted to various tasks

Front

Which is the most common method used in pre-training GPAI models? Options: Decision trees, Monte Carlo methods, Reinforcement Learning with Human Feedback (RLHF), Self-supervised learning

Back

Self-supervised learning

Front

Which three fundamental components are typically referred to as the AI triad, crucial for determining an AI model's capabilities?

Back

Data, compute, and algorithms

Front

What data type is typically used in pre-training large language models?

Back

Both structured and unstructured internet-scale data

Front

What is the difference between pre-training and fine-tuning?

Back

Pre-training creates general representations, while fine-tuning adapts the model to particular tasks.

Front

Which is a key challenge in pre-training AI models?

Back

Resource requirements and computational cost

Front

Which of these is least likely to be treated as a single token by a large language model? The, 5, Mississippi, Alex

Back

Mississippi

Front

Which choice best describes the distinctions among the different training stages: Pre-training, Supervised Fine-Tuning (SFT), and Reinforcement Learning from Human Feedback (RLHF)?

Back

Pre-training uses a large unlabeled text corpus, SFT fine-tunes on labeled examples, and RLHF optimizes model behavior using human preference signals.

Front

Which neural network architecture forms the backbone of most state-of-the-art LLMs?

Back

Transformers

Front

Why is pre-training computationally expensive?

Back

The models have billions of parameters, and they process trillions of tokens of data