Fine-Tuning Data Preparation Quiz

5 questions Pass: 70% +25 pts (50 with Pro)

Quiz covering Fine-Tuning Language Models

What you'll be asked

  1. When preparing a dataset for supervised fine-tuning (SFT), what is the primary purpose of the 'prompt' or 'instruction' field?
  2. Why is it important to perform data deduplication before fine-tuning a language model?
  3. When formatting data for a chat-based model, which structure is considered standard practice?
  4. What is the primary risk of including low-quality or 'noisy' data in your fine-tuning dataset?
  5. When fine-tuning on a small, domain-specific dataset, why might you choose to use a 'system prompt' that is identical across all training examples?

Answers and explanations come after you submit.