remove duplicates row_number code example
Example 1: remove duplicate row in df
df = df.drop_duplicates()
Example 2: drop row with duplicate value
import pandas as pd
df = pd.DataFrame({"A":["foo", "foo", "foo", "bar"], "B":[0,1,1,1], "C":["A","A","B","A"]})
df.drop_duplicates(subset=['A', 'C'], keep=False)