日常需要传递几G或者十几G的fastq数据，在cp或者rysnc完后，是需要对复制的数据进行md5码检验的。本文先获取源文件md5码再获取目标文件md5码，最后检验两者是否一致，从而判断复制是否完整。更多知识分享请到 https://zouhua.top/。

获取md5码

  1. md5sum  RawData/filename > RawData_md5sum.tsv 
  2. md5sum  Rename/filename > Rename_md5sum.tsv

主程序

  1. #!/usr/bin/python
  3. import sys
  4. import re
  5. import os
  6. import argparse as ap
  9. def parse_argument(args):
  10.     parser = ap.ArgumentParser(description='check')
  11.     parser.add_argument('-f1', '--file1', metavar='<file1>', type=str)
  12.     parser.add_argument('-f2', '--file2', metavar='<file2>', type=str)
  13.     parser.add_argument('-o', '--out', metavar='<out>', type=str)
  15.     return parser.parse_args()
  18. def main():
  19.     args = parse_argument(sys.argv)
  21.     dict_f1 = {}
  22.     with open(args.file1, 'r') as f:
  23.         lines = f.readlines()
  24.     for line in lines:
  25.         line = line.strip().split()
  26.         dict_f1[line[0]] = line[1]
  27.     out_f = open(args.out, 'w')
  28.     with open(args.file2, 'r') as f2:
  29.         lines2 = f2.readlines()
  30.     for line2 in lines2:
  31.         line2 = line2.strip().split()
  32.         if line2[0] in dict_f1.keys():
  33.             res = "\t".join([line2[1], dict_f1[line2[0]], str(line2[0]), "Correct"])
  34.             out_f.write(res + "\n")
  35.         else:
  36.             res = "\t".join([line2[1], line[0], "Wrong"])
  37.             out_f.write(res + "\n")
  38.     out_f.close()
  41. main()

运行

  1. python check_md5.py -f1 RawData_md5sum.tsv -f2 Rename_md5sum.tsv  -o Checkout_md5.tsv