目标

爬取当前时间段豆瓣电影中正在上映的电影的相关信息，如电影名、导演、演员表、上映时间、制作方等信息，然后再通过字典的方式，将其保存在本地文件当中，以便我们查询；

Code

  1. #!/usr/bin/python3
  2. # -*- coding:utf-8 -*-
  3. # @Time    : 2018-11-15 8:24
  4. # @Author  : Manu
  5. # @Site    : 
  6. # @File    : doubanMovie.py
  7. # @Software: PyCharm
  9. import pprint
  10. import requests
  11. from lxml import etree
  14. '''
  15. 爬取豆瓣电影上当前正在上映的电影信息，并保存到文件中
  16. '''
  18. HEADERS = {
  19.     'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) '
  20.                  'AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36',
  21.     'Refer':'https://movie.douban.com/'
  22. }
  24. url = 'https://movie.douban.com/cinema/nowplaying/'
  25. response = requests.get(url, headers=HEADERS)
  27. print(response.text)
  28. text = response.text
  30. html = etree.HTML(text)
  31. ul = html.xpath("//ul[@class='lists']")[0]
  32. lis = ul.xpath('./li')
  33. movies = []
  34. for li in lis:
  35.     title = li.xpath('@data-title')[0]
  36.     score = li.xpath('@data-score')[0]
  37.     release = li.xpath('@data-release')[0]
  38.     duration = li.xpath('@data-duration')[0]
  39.     region = li.xpath('@data-region')[0]
  40.     director = li.xpath('@data-director')[0]
  41.     actors = li.xpath('@data-actors')[0]
  42.     thumbnail = li.xpath('.//img/@src')[0]
  43.     movie = {
  44.         '电影名':title,
  45.         '评分':score,
  46.         "上映时间":release,
  47.         '片长':duration,
  48.         '制片国家':region,
  49.         '导演':director,
  50.         '演员表':actors,
  51.         '海报':thumbnail
  52.     }
  53.     movies.append(movie)
  54. pprint.pprint(movies)
  55. with open('豆瓣正在上映.txt', 'w', encoding='utf-8') as movie_file:
  56.     for movie in movies:
  57.         movie_file.write('电影名：' + movie['电影名'] + '\n')
  58.         movie_file.write('评分：' + movie['评分'] + '\n')
  59.         movie_file.write('上映时间：' + movie['上映时间'] + '\n')
  60.         movie_file.write('片长：' + movie['片长'] + '\n')
  61.         movie_file.write('制片国家：' + movie['制片国家'] + '\n')
  62.         movie_file.write('导演：' + movie['导演'] + '\n')
  63.         movie_file.write('演员表：' + movie['演员表'] + '\n')
  64.         movie_file.write('海报：' + movie['海报'] + '\n')
  65.         movie_file.write('\n')

结果

爬取豆瓣当前上映电影信息 - 图1