What is the pythonic way to read CSV file data as rows of namedtuples?
Please have a look at csv.DictReader
. Basically, it provides the ability to get the column names from the first row as you're looking for and, after that, lets you access to each column in a row by name using a dictionary.
If for some reason you still need to access the rows as a collections.namedtuple
, it should be easy to transform the dictionaries to named tuples as follows:
with open('data_file.txt') as infile:
reader = csv.DictReader(infile)
Data = collections.namedtuple('Data', reader.fieldnames)
tuples = [Data(**row) for row in reader]
Use:
Data = namedtuple("Data", next(reader))
and omit the line:
next(reader)
Combining this with an iterative version based on martineau's comment below, the example becomes for Python 2
import csv
from collections import namedtuple
from itertools import imap
with open("data_file.txt", mode="rb") as infile:
reader = csv.reader(infile)
Data = namedtuple("Data", next(reader)) # get names from column headers
for data in imap(Data._make, reader):
print data.foo
# ...further processing of a line...
and for Python 3
import csv
from collections import namedtuple
with open("data_file.txt", newline="") as infile:
reader = csv.reader(infile)
Data = namedtuple("Data", next(reader)) # get names from column headers
for data in map(Data._make, reader):
print(data.foo)
# ...further processing of a line...