抓取的结果信息包含:
- 结果标题
- 结果链接
结果示例图:
模板:
{"_id":"baidu-search","startUrl":["https://www.baidu.com/s?ie=utf-8&f=8&rsv_bp=1&rsv_idx=1&tn=baidu&wd=%E5%A4%9A%E5%85%83%E6%80%9D%E7%BB%B4&oq=%25E8%25BF%2590%25E8%2590%25A5&rsv_pq=ca38fe39000dfb71&rsv_t=bd12H7iHt%2B1L9ZjnuJMTiuviYe4UEj7OZsqVHIs6xk3FVTqI0GVNNA7SUt0&rqlang=cn&rsv_enter=1&rsv_dl=tb&inputT=17568&rsv_sug3=64&rsv_sug1=40&rsv_sug7=101&rsv_sug2=0&rsv_sug4=21796"],"selectors":[{"id":"info","type":"SelectorElement","parentSelectors":["_root","pagination"],"selector":"div.c-container","multiple":true,"delay":""},{"id":"title","type":"SelectorLink","parentSelectors":
["info"],"selector":"h3 a","multiple":false,"delay":0},{"id":"pagination","type":"SelectorLink","parentSelectors":["_root","pagination"],"selector":"a.n","multiple":true,"delay":0}]}
模板套用步骤:
(1)进入需要抓取的搜索结果页面,例如:https://www.baidu.com/s?ie=utf-8&f=8&rsv_bp=1&rsv_idx=1&tn=baidu&wd=%E5%A4%9A%E5%85%83%E6%80%9D%E7%BB%B4&oq=%25E5%25A4%259A%25E5%2585%2583%25E6%2580%259D%25E7%25BB%25B4&rsv_pq=c18d2b1c004cd265&rsv_t=1dadsp%2Bh3uM7GuS6Kw8R9IeILxagaegpG96RwdA65HOSlFl%2F4euQ2mXSqOU&rqlang=cn&rsv_enter=0&rsv_dl=tb
(2)导入模板
(3)替换 Start URL为要抓取的网页链接
(4)开始抓取