Python Web 爬取
Thomas Laetsch
Data Scientist, NYU
/ 替换为 >(首字符除外)/html/body/divhtml > body > div// 替换为空格(首字符除外)//div/span//pdiv > span p[N] 替换为 :nth-of-type(N)//div/p[2]div > p:nth-of-type(2)XPATH
xpath = '/html/body//div/p[2]'
CSS
css = 'html > body div > p:nth-of-type(2)'
.p.class-1 选择属于 class-1 的所有段落元素#div#uid 选择 id 等于 uid 的 div 元素选择类为 class1 内的段落元素:
css_locator = 'div#uid > p.class1'
选择所有类属性属于 class1 的元素:
css_locator = '.class1'
css = '.class1'

xpath = '//*[@class="class1"]'

xpath = '//*[contains(@class,"class1")]'

from scrapy import Selector
html = '''
<html>
<body>
<div class="hello datacamp">
<p>Hello World!</p>
</div>
<p>Enjoy DataCamp!</p>
</body>
</html>
'''
sel = Selector( text = html )
>>> sel.css("div > p")
out: [<Selector xpath='...' data='<p>Hello World!</p>'>]
>>> sel.css("div > p").extract()
out: [ '<p>Hello World!</p>' ]
Python Web 爬取