3-3 贴吧某个帖子所有内容 - 图1

抓取的结果信息包含:

  • 作者名字
  • 内容
  • 内容来自哪里
  • 几楼
  • 时间

    结果示例图:

    3-3 贴吧某个帖子所有内容 - 图2

    模板:

    1. {"_id":"tieba-one","startUrl":["http://tieba.baidu.com/p/6289672951?pn=[1-5]"],"selectors":[{"id":"info","type":"SelectorElement","parentSelectors":
    2. ["_root"],"selector":"div[data-pid]","multiple":true,"delay":0},{"id":"author","type":"SelectorText","parentSelectors":["info"],"selector":"a.p_author_name","multiple":false,"regex":"","delay":0},{"id":"content","type":"SelectorText","parentSelectors":["info"],"selector":"div.d_post_content","multiple":false,"regex":"","delay":0},{"id":"from","type":"SelectorText","parentSelectors":["info"],"selector":"ul.p_mtail","multiple":false,"regex":"","delay":0},{"id":"lou","type":"SelectorText","parentSelectors":
    3. ["info"],"selector":"ul.p_tail span:nth-of-type(1)","multiple":false,"regex":"","delay":0},{"id":"time","type":"SelectorText","parentSelectors":
    4. ["info"],"selector":".p_tail li:nth-of-type(2) span","multiple":false,"regex":"","delay":0}]}

    模板套用步骤:

    (1)进入需要抓取的帖子页面,例如:http://tieba.baidu.com/p/6289672951?pn=1
    (2)导入模板
    (3)替换 Start URL为要抓取的网页链接,(抓取多页需修改 Start URL 里的页码数)
    (4)开始抓取