Including double quotes while writing CSV using apache commons in java

This is a known issue. You can vote for it in the apache commons csv issue tracker:

https://issues.apache.org/jira/browse/CSV-63

Mentioned in lars issue tracking, try to set the CSVFormat to the following,

final CSVFormat csvFileFormat = CSVFormat.DEFAULT.withEscape('\\').withQuoteMode(QuoteMode.NONE);