Scrapy：如何使用 CSS 和 XPath 获取地址？

Question

如何使用 CSS 和 XPath 获取地址？我尝试使用 CSS：response.css('.office-address::text').extract()<span class="office-address" itemprop="address" itemscope="" itemtype="http://schema.org/PostalAddress">                <span itemprop="streetAddress">                    <span class="address-line1">5835 Post Rd.</span>                        <span class="address-line2">Suite 217</span>                </span>                <span class="city-state-zip">                    <span itemprop="addressLocality">East Greenwich</span>, <span itemprop="addressRegion">RI</span> <span itemprop="postalCode">02818</span>                </span>            </span>

Answer 1

带有scrapy的CSS选择器选项：

address = response.css("span.address-line1::text, span.address-line2::text, span[itemprop=addressLocality]::text, span[itemprop=addressRegion]::text, span[itemprop=postalCode]::text").extract() # should return list

if address:

    address = ", ".

Answer 2

使用单行 XPath 的肮脏解决方案：

concat(//span[@class='address-line1']/text(),' ',//span[@class='address-line2']/text(),' ',//span[@itemprop='addressLocality']/text(),', ',//span[@itemprop='addressRegion']/text(),//span[@itemprop='postalCode']/text())

输出 ：

"5835 Post Rd. Suite 217 East Greenwich, RI02818"

Answer 3

试试这个response.css('.office-address ::text').extract()之前添加的空间::text




Answer 4

这是面向未来的想法，因为 ids/classes 可以在此期间发生变化：

from re import sub

from bs4 import BeautifulSoup as bs

teststr = """<span class="office-address" itemprop="address" itemscope="" itemtype="http://schema.org/PostalAddress">

                <span itemprop="streetAddress">

                    <span class="address-line1">5835 Post Rd.</span>

                        <span class="address-line2">Suite 217</span>

                </span>

                <span class="city-state-zip">

                    <span itemprop="addressLocality">East Greenwich</span>, <span itemprop="addressRegion">RI</span> <span itemprop="postalCode">02818</span>

                </span>

            </span>"""

r = bs(teststr,"lxml").getText().strip()

r = sub( r"\n", ", ", r)

r = sub( r"[, ]{2,}", ", ", r)

print ( r ) 

结果：

5835 Post Rd., Suite 217, East Greenwich, RI 02818