4-3 百度知道问题列表所有问题 - 图1

抓取的结果信息包含：

  • 问题标题
  • 问题链接
  • 问题标签
  • 回答数
  • 发布时间
  • 悬赏数

    结果示例图：

    4-3 百度知道问题列表所有问题 - 图2

    模板：

    1. {"_id":"zhidao-list","startUrl":["https://zhidao.baidu.com/list"],"selectors":[{"id":"info","type":"SelectorElementClick","parentSelectors":["_root"],"selector":"div.question-title-section","multiple":true,"delay":"3000","clickElementSelector":"a.next","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueCSSSelector"},{"id":"title","type":"SelectorLink","parentSelectors":
    2. ["info"],"selector":"a.title-link","multiple":false,"delay":0},{"id":"category","type":"SelectorText","parentSelectors":
    3. ["info"],"selector":"div.question-tags","multiple":false,"regex":"","delay":0},{"id":"answers","type":"SelectorText","parentSelectors":
    4. ["info"],"selector":"div.answer-num","multiple":false,"regex":"","delay":0},{"id":"time","type":"SelectorText","parentSelectors":
    5. ["info"],"selector":"div.question-time","multiple":false,"regex":"","delay":0},{"id":"money","type":"SelectorText","parentSelectors":
    6. ["info"],"selector":"span.coin-count","multiple":false,"regex":"","delay":0}]}

    模板套用步骤：

    （1）进入需要抓取的问题列表页面，例如：https://zhidao.baidu.com/list?type=highScore
    （2）导入模板
    （3）替换 Start URL为要抓取的网页链接
    （4）开始抓取