2-9 豆瓣豆列下所有书籍 - 图1

抓取的结果信息包含:

  • 书名
  • 书籍主页链接
  • 评分
  • 评价数
  • 出版社信息
  • 评论
  • 时间

    结果示例图:

    2-9 豆瓣豆列下所有书籍 - 图2

    模板:

    1. {"_id":"doulie1","startUrl":
    2. ["https://www.douban.com/doulist/44889839/"],"selectors":[{"id":"outer","type":"SelectorElement","parentSelectors":
    3. ["_root"],"selector":"div:nth-of-type(n+7) div.mod","multiple":true,"delay":"2000"},{"id":"title","type":"SelectorLink","parentSelectors":
    4. ["outer"],"selector":"div.title a","multiple":false,"delay":0},{"id":"rating","type":"SelectorText","parentSelectors":["outer"],"selector":"span.rating_nums","multiple":false,"regex":"","delay":0},{"id":"comment","type":"SelectorText","parentSelectors":
    5. ["outer"],"selector":"span:nth-of-type(3)","multiple":false,"regex":"","delay":0},{"id":"publishDate","type":"SelectorText","parentSelectors":["outer"],"selector":"div.abstract","multiple":false,"regex":"","delay":0},{"id":"comments","type":"SelectorText","parentSelectors":["outer"],"selector":"blockquote","multiple":false,"regex":"","delay":0},{"id":"time","type":"SelectorText","parentSelectors":
    6. ["outer"],"selector":".time span","multiple":false,"regex":"","delay":0}]}

    模板套用步骤:

    (1)进入需要抓取豆列页面,例如:https://www.douban.com/doulist/44889839/
    (2)导入模板
    (3)替换 Start URL为要抓取的网页链接,(抓取多页需修改 Start URL 里的页码数)
    (4)开始抓取