13-2 有讲搜索结果直播信息 - 图1

抓取的结果信息包含:

  • 课程名字
  • 课程链接
  • 课程热度

    结果示例图:

    13-2 有讲搜索结果直播信息 - 图2

    模板:

    1. {"_id":"youjiang-souso","startUrl":
    2. ["https://v.yojiang.cn/live/search?kw=%E9%98%85%E8%AF%BB"],"selectors":[{"id":"info","type":"SelectorElement","parentSelectors":
    3. ["_root"],"selector":"dl:nth-of-type(1) dd.r-item","multiple":true,"delay":"0"},{"id":"name","type":"SelectorLink","parentSelectors":["info"],"selector":"a","multiple":false,"delay":0},{"id":"redu","type":"SelectorText","parentSelectors":
    4. ["info"],"selector":"span.i-learned","multiple":false,"regex":"","delay":0}]}

    模板套用步骤:

    (1)进入需要抓取的课程搜索结果页面,例如:https://v.yojiang.cn/live/search?kw=%E5%86%99%E4%BD%9C
    (2)导入模板
    (3)替换 Start URL为要抓取的网页链接
    (4)点击直播栏底部“查看更多”,展开更多课程
    (5)点击”data preview“
    (6)全选 -> 复制 ->粘贴到 excel 文件里
    (7)删除杂乱数据