Drop column using Dask dataframe

You can separate into two operations:

# dask operation
raw_data = raw_data.drop('some_great_column', axis=1)

# conversion to pandas
df = raw_data.compute()

Then export the Pandas dataframe to a CSV file:

df.to_csv(r'out.csv', index=False)

I assume you want to keep "raw data" in a Dask DF. In that case the following will do the trick:

new_raw_df = raw_data.drop('some_great_column', axis=1).copy()

where type(new_raw_df) is dask.dataframe.core.DataFrame and you can delete the original DF.

Related