用df命令查看发现磁盘空间几乎被占满了

    1. [root@172-16-101-253 ~]# df -hl
    2. 文件系统                 容量  已用  可用 已用% 挂载点
    3. /dev/mapper/centos-root   36G   35G  789M   98% /
    4. devtmpfs                 7.8G     0  7.8G    0% /dev
    5. tmpfs                    7.8G     0  7.8G    0% /dev/shm
    6. tmpfs                    7.8G   41M  7.8G    1% /run
    7. tmpfs                    7.8G     0  7.8G    0% /sys/fs/cgroup
    8. /dev/vda1               1014M  142M  873M   14% /boot
    9. /dev/sda1                296G  5.6G  275G    2% /data
    10. tmpfs                    1.6G     0  1.6G    0% /run/user/0
    11. tmpfs                    1.6G     0  1.6G    0% /run/user/1000

    清理了一些文件之后用du命令查询，发现与df命令结果不一致，df查询根目录被占用35G，但du查询根目录被占用15G

    1. [root@172-16-101-253 app]# du -h / --max-depth=1
    2. 110M    /boot
    3. 0       /dev
    4. du: 无法访问"/proc/29830": 没有那个文件或目录
    5. du: 无法访问"/proc/29846": 没有那个文件或目录
    6. du: 无法访问"/proc/29847/task/29847/fd/4": 没有那个文件或目录
    7. du: 无法访问"/proc/29847/task/29847/fdinfo/4": 没有那个文件或目录
    8. du: 无法访问"/proc/29847/fd/3": 没有那个文件或目录
    9. du: 无法访问"/proc/29847/fdinfo/3": 没有那个文件或目录
    10. 0       /proc
    11. 41M     /run
    12. 0       /sys
    13. 30M     /etc
    14. 64K     /root
    15. 177M    /var
    16. 288K    /tmp
    17. 1.5G    /usr
    18. 5.6G    /home
    19. 0       /media
    20. 0       /mnt
    21. 1.9G    /opt
    22. 0       /srv
    23. 5.5G    /data
    24. 15G     /

    用df -i查询inode利用率，inode不够用也会有这个问题，但是inode也是够用的

    1. [root@172-16-101-253 app]# df -i
    2. 文件系统                   Inode 已用(I)  可用(I) 已用(I)% 挂载点
    3. /dev/mapper/centos-root  1064648   43871  1020777       5% /
    4. devtmpfs                 2030258     441  2029817       1% /dev
    5. tmpfs                    2033299       1  2033298       1% /dev/shm
    6. tmpfs                    2033299     641  2032658       1% /run
    7. tmpfs                    2033299      16  2033283       1% /sys/fs/cgroup
    8. /dev/vda1                 524288     327   523961       1% /boot
    9. /dev/sda1               19660800  106003 19554797       1% /data
    10. tmpfs                    2033299       1  2033298       1% /run/user/0
    11. tmpfs                    2033299       1  2033298       1% /run/user/1000

    用lsof |grep delete检查是否存在已删除的文件被占用的情况

    1. [root@172-16-101-253 app]# lsof |grep delete
    2. tuned       962          root    7u      REG              253,0        4096   33565759 /tmp/ffiQAZuAc (deleted)
    3. gmain       962  2634    root    7u      REG              253,0        4096   33565759 /tmp/ffiQAZuAc (deleted)
    4. tuned       962  2635    root    7u      REG              253,0        4096   33565759 /tmp/ffiQAZuAc (deleted)
    5. tuned       962  2636    root    7u      REG              253,0        4096   33565759 /tmp/ffiQAZuAc (deleted)
    6. tuned       962  2674    root    7u      REG              253,0        4096   33565759 /tmp/ffiQAZuAc (deleted)
    7. java      15408         admin    1w      REG              253,0 27188723880    5232071 /home/admin/app/dt-center-task/logs/rdos_task.stdout (deleted)
    8. java      15408         admin    2w      REG              253,0       15722    5232072 /home/admin/app/dt-center-task/logs/rdos_task.err (deleted)
    9. java      15408         admin    3w      REG              253,0    16895030    5232069 /home/admin/app/dt-center-task/logs/vertx.gc (deleted)
    10. java      15408         admin    8w      REG              253,0     3535802    1651950 /home/admin/app/dt-center-task/logs/task_server.log (deleted)
    11. java      15408         admin    9w      REG              253,0      564784    5232076 /home/admin/app/dt-center-task/logs/task_master.log (deleted)
    12. java      15408         admin   10w      REG              253,0     8224694    5232075 /home/admin/app/dt-center-task/logs/task_executor.log (deleted)
    13. java      15408  5439   admin    1w      REG              253,0 27188718604    5232071 /home/admin/app/dt-center-task/logs/rdos_task.stdout (deleted)
    14. java      15408  5439   admin    2w      REG              253,0       15722    5232072 /home/admin/app/dt-center-task/logs/rdos_task.err (deleted)
    15. java      15408  5439   admin    3w      REG              253,0    16895030    5232069 /home/admin/app/dt-center-task/logs/vertx.gc (deleted)
    16. java      15408  5439   admin    8w      REG              253,0     3535802    1651950 /home/admin/app/dt-center-task/logs/task_server.log (deleted)
    17. java      15408  5439   admin    9w      REG              253,0      564784    5232076 /home/admin/app/dt-center-task/logs/task_master.log (deleted)
    18. java      15408  5439   admin   10w      REG              253,0     8224694    5232075 /home/admin/app/dt-center-task/logs/task_executor.log (deleted)
    19. java      15408 10986   admin    1w      REG              253,0 27188718604    5232071 /home/admin/app/dt-center-task/logs/rdos_task.stdout (deleted)
    20. java      15408 10986   admin    2w      REG              253,0       15722    5232072 /home/admin/app/dt-center-task/logs/rdos_task.err (deleted)
    21. java      15408 10986   admin    3w      REG              253,0    16895030    5232069 /home/admin/app/dt-center-task/logs/vertx.gc (deleted)
    22. 此处省略N行

    检查后发现删除的日志文件仍然处于被占用的状态，此时只需kill对应的进程（此处只需要重启task应用），删除日志之前最好先停止应用