Model Bias and Fairness Quiz

5 questions Pass: 70% +25 pts (50 with Pro)

Quiz covering Model Evaluation and AI Safety

What you'll be asked

  1. What is the primary goal of conducting a 'bias audit' on a language model before deployment?
  2. If a model consistently associates specific professions with a particular gender, which type of bias is this primarily demonstrating?
  3. You are fine-tuning a model on a dataset of customer support tickets. You notice the model is less accurate when responding to dialects used by marginalized communities. What is the most effective strategy to improve fairness?
  4. Which of the following is a common limitation of using automated 'toxicity classifiers' to ensure AI safety?
  5. When evaluating fairness using 'Equalized Odds' as a metric, what condition must be satisfied?

Answers and explanations come after you submit.