how to check duplicate rows in pandas code example
Example 1: find duplicated rows with respect to multiple columns pandas
df = df[df.duplicated(subset=['val1','val2'], keep=False)]
print (df)
id val1 val2
0 1 1.1 2.2
1 1 1.1 2.2
3 3 8.8 6.2
4 4 1.1 2.2
5 5 8.8 6.2
Example 2: print duplicates elements in column pandas
mask = df.columnname.duplicated(keep=False)
print (df[mask])
Example 3: how to check for duplicates in a column in python
boolean = df['Student'].duplicated().any()
Example 4: count duplicates in one column pandas
df.pivot_table(index=['DataFrame Column'], aggfunc='size')