Token Usage Monitoring Quiz

What you'll be asked

1. Which of the following metrics is the most direct indicator of the immediate financial cost associated with a Large Language Model API call?
2. In the context of observability, why is it important to track input (prompt) tokens separately from output (completion) tokens?
3. You notice a sudden spike in token usage costs without an increase in user traffic. Which of the following is the most likely cause?
4. When implementing observability for a RAG (Retrieval-Augmented Generation) pipeline, what is the best practice for tracking token usage?
5. If your observability platform shows high 'Tokens Per Second' (TPS) but low 'Tokens Per Request' during peak hours, what does this suggest about your application's performance?

Answers and explanations come after you submit.