请求库 request

get 请求

  1. - `result = reuqest("http://www.wise.xmu.edu.cn/people/faculty")` #发起网络请求

get 请求中添加 params 参数

  1. - `result = request("http://www.wise.xmu.edu.cn/people/faculty",params = ={'q': 'python', 'cat': '1001'})`

设置请求头

  1. - result = request( [url网址], headers={'User-Agent': 'Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit'} )

设置cookie

  1. >>> cs = {'token': '12345', 'status': 'working'}
  2. >>> r = requests.get(url, cookies=cs)

post请求

  1. params = {'key': 'value'}
  2. r = requests.post(url, json=params) # 内部自动序列化为JSONs

获取返回状态码 ressult.status_code
请求的体 result.cotent
查看编码 result.encoding
获取cookie result.cookie['cookie名称']

html解析器

BeautifulSoup
引入模块 :

  1. - from bs4 import BeautifulSoup 应为BeautifulSoup 是 bs4 的一个子模块

html解析

  1. - `result = reuqest("http://www.wise.xmu.edu.cn/people/faculty")`
  2. - `div_list = BeautifulSoup(html.content,"html.parser")`

<br />

元素查找