如何使用 beautiful soup 从脚本标签中提取 json？

Question

reviewCount我想使用 beautiful soup 从脚本标签中提取。尝试了不同的方法但没有成功。<script type="application/json" data-initial-state="review-filter">{"languages":[{"isoCode":"all","displayName":"Toutes les langues","reviewCount":"573"},{"isoCode":"fr","displayName":"français","reviewCount":"567"},{"isoCode":"en","displayName":"English","reviewCount":"6"}],"selectedLanguages":["all"],"selectedStars":null,"selectedLocationId":null}</script>

Answer 1

这应该可行，我绝对确定有一种更优雅的方法：

import json

from bs4 import BeautifulSoup

html = '''

<script type="application/json" data-initial-state="review-filter">

{"languages":[{"isoCode":"all","displayName":"Toutes les langues","reviewCount":"573"},{"isoCode":"fr","displayName":"français","reviewCount":"567"},{"isoCode":"en","displayName":"English","reviewCount":"6"}],"selectedLanguages":["all"],"selectedStars":null,"selectedLocationId":null}

</script>

'''

soup = BeautifulSoup(html, 'html.parser')

res = soup.find('script')

json_object = json.loads(res.contents[0])

for language in json_object['languages']:

    print('{}: {}'.format(language['displayName'], language['reviewCount']))

输出：

Toutes les langues: 573

français: 567

English: 6

Answer 2

导入 json 并加载数据json，然后 iterarte 获取所有reviewCount.

import json

html='''<script type="application/json" data-initial-state="review-filter">

{"languages":[{"isoCode":"all","displayName":"Toutes les langues","reviewCount":"573"},{"isoCode":"fr","displayName":"français","reviewCount":"567"},{"isoCode":"en","displayName":"English","reviewCount":"6"}],"selectedLanguages":["all"],"selectedStars":null,"selectedLocationId":null}

</script>'''

soup=BeautifulSoup(html,"html.parser")

item=soup.select_one('script[data-initial-state="review-filter"]').text

jsondata=json.loads(item)

for item in jsondata['languages']:

    print(item['reviewCount'])

输出：

573

567

6

Answer 3

import re

html = '''<script type="application/json" data-initial-state="review-filter">

{"languages":[{"isoCode":"all","displayName":"Toutes les langues","reviewCount":"573"},{"isoCode":"fr","displayName":"français","reviewCount":"567"},{"isoCode":"en","displayName":"English","reviewCount":"6"}],"selectedLanguages":["all"],"selectedStars":null,"selectedLocationId":null}

</script>'''

match = [item.group(1) for item in re.finditer('reviewCount":"(.+?)"', html)]

print(match)

输出：

['573', '567', '6']