python drop duplicates based on all columns keep one code example
Example 1: python: remove duplicate in a specific column
df = df.drop_duplicates(subset=['Column1', 'Column2'], keep='first')
Example 2: remove duplicates based on two columns in dataframe
df.drop_duplicates(['A','B'],keep= 'last')