2-13 豆瓣小组某个讨论的所有回应 - 图1

抓取的结果信息包含:

  • 回应人名字
  • 回应时间
  • 回应内容
  • 点赞数

    结果示例图:

    2-13 豆瓣小组某个讨论的所有回应 - 图2

    模板:

    1. {"_id":"doubangroup","startUrl":["https://www.douban.com/group/topic/140793419//?start=[0-200:100]"],"selectors":
    2. [{"id":"element","type":"SelectorElement","parentSelectors":["_root"],"selector":"li.clearfix","multiple":true,"delay":0},{"id":"name","type":"SelectorText","parentSelectors":
    3. ["element"],"selector":"h4 a","multiple":false,"regex":"","delay":0},{"id":"time","type":"SelectorText","parentSelectors":["element"],"selector":"span","multiple":false,"regex":"","delay":0},{"id":"content","type":"SelectorText","parentSelectors":["element"],"selector":"p","multiple":false,"regex":"","delay":0},{"id":"like","type":"SelectorText","parentSelectors":
    4. ["element"],"selector":"a.comment-vote","multiple":false,"regex":"","delay":0}]}

    模板套用步骤:

    (1)进入需要抓取的讨论回应页面,例如:https://www.douban.com/group/topic/140793419/?start=200
    (2)导入模板
    (3)替换 Start URL为要抓取的网页链接,(抓取多页需修改 Start URL 里的页码数)
    (4)开始抓取