scrapy css selector code example

Example 1: get href scrapy xpath

# with xpath
//div[@class='image']/a[1]/@href

# using css
Link = response.css('span.title a::attr(href)').getall()

Example 2: scrapy get inside attribute value

#Given 
<time datetime="2020-09-01T11:48:24-03:00" itemprop="datePublished">a given text</time>

# to get the attribute value datetime:
getData = response.css('time::attr(datetime)').get()

# output
'2020-09-01T11:48:24-03:00'

Example 3: scrapy get raw html content of selector innerhtml

response.xpath('//*').get()

Tags:

Misc Example