pandas drop NAs based on a column code example
Example 1: remove rows or columns with NaN value
df.dropna() #drop all rows that have any NaN values
df.dropna(how='all')
Example 2: dropna threshold
#dropping columns having more than 50% missing values(1994/2==1000)
df=df.dropna(thresh=1000,axis=1)