Reference Duplicate Quiz

What you'll be asked

1. What is the primary purpose of identifying duplicates during the data transformation phase?
2. When cleaning a customer dataset, you find multiple entries for the same person with slightly different email formatting. Which action is the most appropriate approach to deduplication?
3. You are performing an ETL process and notice that a 'TransactionID' column has duplicate values. What should be your first step before deleting these rows?
4. In a SQL-based transformation, which clause or function is most commonly used to identify duplicate records based on a specific subset of columns?
5. When handling duplicates in a large-scale streaming data pipeline, why is 'fuzzy matching' often preferred over exact matching?

Answers and explanations come after you submit.