课程链接
结果示例图:
模板:
{"_id":"youjiang-souso-jingpin","startUrl":["https://v.yojiang.cn/live/search?kw=%E9%98%85%E8%AF%BB"],"selectors":[{"id":"info","type":"SelectorElement","parentSelectors":
["_root"],"selector":"dd.result-feature","multiple":true,"delay":"0"},{"id":"name","type":"SelectorText","parentSelectors":["info"],"selector":"h4","multiple":false,"regex":"","delay":0},{"id":"redu","type":"SelectorText","parentSelectors":["info"],"selector":"div.learned","multiple":false,"regex":"","delay":0},{"id":"author","type":"SelectorText","parentSelectors":
["info"],"selector":"div.teacher-zone","multiple":false,"regex":"","delay":0},{"id":"style","type":"SelectorText","parentSelectors":["info"],"selector":"div.duration","multiple":false,"regex":"","delay":0},{"id":"link","type":"SelectorLink","parentSelectors":["info"],"selector":"a","multiple":false,"delay":0}]}
模板套用步骤:
(1)进入需要抓取的课程搜索结果页面,例如:https://m.qlchat.com/wechat/page/recommend?shareSourceId=45x9dr16f9789c5ea&tagId=2000002423045279&userSourceId=befe8324fc6d#subItem
(2)导入模板
(3)替换 Start URL为要抓取的网页链接
(4)点击直播栏底部“查看更多”,展开更多课程
(5)点击”data preview“
(6)全选 -> 复制 ->粘贴到 excel 文件里
(7)删除杂乱数据