Monitor Model Performance Quiz

What you'll be asked

1. Which Azure service is primarily used to collect and analyze telemetry data from your AI applications to monitor performance?
2. You have deployed a model and notice a gradual decline in prediction accuracy over time. What is this phenomenon called?
3. When configuring Model Data Collection in Azure Machine Learning, where is the captured inference data (inputs and predictions) stored?
4. Your team wants to receive an immediate alert when the latency of your deployed AI model exceeds a specific threshold. What is the correct workflow to achieve this?
5. You are monitoring a model for feature drift using Azure Machine Learning. You observe that the distribution of a specific input feature has shifted significantly compared to the baseline training dataset. Which statistical method does Azure ML typically use to detect this change?

Answers and explanations come after you submit.