duplicate in python code example

Example 1: python remove duplicates from a list

# HOW TO REMOVE DUPLICATES FROM A LIST:
# 1) CREATE A LIST
my_list = [1, 2, 3, 4, 5, 5, 5, 1]
# 2) CONVERT IT TO A SET AND THEN BACK INTO A LIST
my_list = list(set(my_list))
# 3) DONE! 
print(my_list) #WILL PRINT: [1, 2, 3, 4, 5]

Example 2: duplicate in list python

a = [1,2,3,2,1,5,6,5,5,5]

import collections
print([item for item, count in collections.Counter(a).items() if count > 1])

## [1, 2, 5]

Example 3: python - show repeted values in a column

df = df[df.duplicated(subset=['val1','val2'], keep=False)]