Python BeautifulSoup scrape tables
Loop over table rows (tr
tag) and get the text of cells (td
tag) inside:
for tr in soup.find_all('tr')[2:]:
tds = tr.find_all('td')
print "Nome: %s, Cognome: %s, Email: %s" % \
(tds[0].text, tds[1].text, tds[2].text)
prints:
Nome: Massimo, Cognome: Allegri, Email: [email protected]
Nome: Alessandra, Cognome: Anastasia, Email: [email protected]
...
FYI, [2:]
slice here is to skip two header rows.
UPD, here's how you can save results into txt file:
with open('output.txt', 'w') as f:
for tr in soup.find_all('tr')[2:]:
tds = tr.find_all('td')
f.write("Nome: %s, Cognome: %s, Email: %s\n" % \
(tds[0].text, tds[1].text, tds[2].text))