remove duplicate rows python code example

Example 1: python: remove duplicate in a specific column

df = df.drop_duplicates(subset=['Column1', 'Column2'], keep='first')

Example 2: remove duplicates function python

def remove_dupiclates(list_):
	new_list = []
	for a in list_:
    	if a not in new_list:
        	new_list.append(a)
	return new_list

Example 3: df remove duplicate rows

df = df.drop_duplicates()
p