breaking big csv into chunks pandas code example
Example: breaking big csv into chunks pandas
for i, chunk in enumerate(pd.read_csv(csv_file, chunksize=1000000)):
chunk.to_csv('ACTIVITY_EMAIL_OPEN_{}.csv'.format(i), index=False)
for i, chunk in enumerate(pd.read_csv(csv_file, chunksize=1000000)):
chunk.to_csv('ACTIVITY_EMAIL_OPEN_{}.csv'.format(i), index=False)