hadoop一直开机一直处于安全模式
2020-05-01 本文已影响0人
晨冉1688
查询集群健康状态
hdfs fsck
发现有1860个快损坏
/weblog/dim_time.dat: MISSING 1 blocks of total size 601 B.Status: CORRUPT
Total size: 27258959146 B (Total open files size: 435679 B)
Total dirs: 1211
Total files: 2050
Total symlinks: 0 (Files currently being written: 1)
Total blocks (validated): 2044 (avg. block size 13336085 B) (Total open file blocks (not validated): 1)
********************************
UNDER MIN REPL'D BLOCKS: 1860 (90.99804 %)
dfs.namenode.replication.min: 1
CORRUPT FILES: 1860
MISSING BLOCKS: 1860
MISSING SIZE: 24467172505 B
CORRUPT BLOCKS: 1860
********************************
Minimally replicated blocks: 184 (9.001957 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 0 (0.0 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 3
Average block replication: 0.27005872
Corrupt blocks: 1860
Missing replicas: 0 (0.0 %)
Number of data-nodes: 3
Number of racks: 1
FSCK ended at Mon Mar 09 05:51:52 CST 2020 in 629 milliseconds
The filesystem under path '/' is CORRUPT
解决方法：
离开安全模式(处于安全模式是无法删除损坏块的)
hadoop dfsadmin -safemode leave
删除损坏块
如果是生产请尝试使用hdfs debug
hdfs fsck / -delete
