Skip to content
Play · 1 h 15 min

Data · Data analysis with Python

Cleaning data with pandas

Lesson 2 of 4 · 1 h 15 min · with Lucía Moreno

Fix dates, missing values and duplicates, the unglamorous work behind every analysis.

Real data is messy. Most of an analyst’s time goes into cleaning it, and getting this part right is what makes the results trustworthy.

Common problems

  • Dates stored as text in three different formats
  • Prices with and without tax in the same column
  • The same booking recorded twice

We fix each one with a few lines of pandas, and write down every change so someone else can check our work.