16-1 腾讯课堂课程搜索结果信息 - 图1

抓取的结果信息包含:

  • 课程名字
  • 课程链接
  • 价格
  • 课程人数
  • 作者
  • 课程标签

    结果示例图:

    16-1 腾讯课堂课程搜索结果信息 - 图2

    模板:

    1. {"_id":"tengxun-sosou","startUrl":
    2. ["https://ke.qq.com/course/list/%E8%B5%9A%E9%92%B1?page=[1-5]"],"selectors":[{"id":"info","type":"SelectorElement","parentSelectors":["_root"],
    3. "selector":"li.course-card-item--v3","multiple":true,"delay":0},{"id":"name","type":"SelectorLink","parentSelectors":
    4. ["info"],"selector":"a.item-tt-link","multiple":false,"delay":0},{"id":"tag","type":"SelectorText","parentSelectors":["info"],"selector":"ul","multiple":false,"regex":"","delay":0},{"id":"class","type":"SelectorText","parentSelectors":
    5. ["info"],"selector":"span.item-task","multiple":false,"regex":"","delay":0},
    6. {"id":"class-name","type":"SelectorText","parentSelectors":
    7. ["info"],"selector":"a.line-cell","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":
    8. ["info"],"selector":"span.item-price","multiple":false,"regex":"","delay":0},
    9. {"id":"recent-students","type":"SelectorText","parentSelectors":["info"],"selector":"span.item-user","multiple":false,"regex":"","delay":0}]}

    模板套用步骤:

    (1)进入需要抓取的课程搜索结果页面,例如:https://ke.qq.com/course/list/%E8%B5%9A%E9%92%B1?page=1
    (2)导入模板
    (3)替换 Start URL为要抓取的网页链接,(抓取多页需修改 Start URL 里的页码数)
    (4)开始抓取