15-2 网易云课堂某类课程信息 - 图1

抓取的结果信息包含:

  • 课程名字
  • 课程链接
  • 价格
  • 课程人数
  • 作者
  • 课程简介

    结果示例图:

    15-2 网易云课堂某类课程信息 - 图2

    模板:

    1. {"_id":"wangyi-fenlei","startUrl":
    2. ["https://study.163.com/category/480000003121024#/?p=[1-2]"],"selectors":[{"id":"name","type":"SelectorLink","parentSelectors":
    3. ["_root"],"selector":".uc-recomend-ykt a, .uc-coursecard a","multiple":true,"delay":""},{"id":"students","type":"SelectorText","parentSelectors":["name"],"selector":"span.hot","multiple":false,"regex":"","delay":0},{"id":"author","type":"SelectorText","parentSelectors":["name"],"selector":"div.teacher","multiple":false,"regex":"","delay":0},{"id":"price","type":"SelectorText","parentSelectors":
    4. ["name"],"selector":"div.price-section","multiple":false,"regex":"","delay":0},{"id":"intro","type":"SelectorText","parentSelectors":
    5. ["name"],"selector":"div.m-cbi","multiple":false,"regex":"","delay":0}]}

    模板套用步骤:

    (1)进入需要抓取的课程类别页面,例如:https://study.163.com/category/480000003121024#/
    (2)导入模板
    (3)替换 Start URL为要抓取的网页链接,(抓取多页需修改 Start URL 里的页码数)
    (4)开始抓取