3-2 贴吧搜索结果所有帖子 - 图1

抓取的结果信息包含：

  • 帖子标题
  • 帖子内容链接
  • 来自哪个贴吧
  • 作者名字
  • 日期

    结果示例图：

    3-2 贴吧搜索结果所有帖子 - 图2

    模板：

    1. {"_id":"tieba-search","startUrl":["http://tieba.baidu.com/f/search/res?isnew=1&kw=&qw=%C8%E7%BA%CE%D0%B4%CE%C4%D5%C2&rn=10&un=&only_thread=0&sm=1&sd=&ed=&pn=[1-5]"],"selectors":[{"id":"info","type":"SelectorElement","parentSelectors":["_root"],"selector":"div.s_post","multiple":true,"delay":0},{"id":"title","type":"SelectorLink","parentSelectors":["info"],"selector":"a.bluelink","multiple":false,"delay":0},{"id":"intro","type":"SelectorText","parentSelectors":["info"],"selector":"div.p_content","multiple":false,"regex":"","delay":0},
    2. {"id":"ba-name","type":"SelectorText","parentSelectors":
    3. ["info"],"selector":".p_forum font","multiple":false,"regex":"","delay":0},{"id":"author","type":"SelectorText","parentSelectors":
    4. ["info"],"selector":"a:nth-of-type(2) font","multiple":false,"regex":"","delay":0},{"id":"time","type":"SelectorText","parentSelectors":["info"],"selector":"font.p_green","multiple":false,"regex":"","delay":0}]}

    模板套用步骤：

    （1）进入需要抓取的帖子搜索结果页，例如：http://tieba.baidu.com/f/search/res?isnew=1&kw=&qw=%C8%E7%BA%CE%D0%B4%CE%C4%D5%C2&rn=10&un=&only_thread=0&sm=1&sd=&ed=&pn=1
    （2）导入模板
    （3）替换 Start URL为要抓取的网页链接，（抓取多页需修改 Start URL 里的页码数）
    （4）开始抓取