通过文件系统检查(fsck)确保数据完整性
作者：尹正杰
版权声明：原创作品，谢绝转载！否则将追究法律责任。
一.HDFS文件系统检查概述
Linux系统管理员运行fsck命令以修复ext3或者ext4文件系统上的损坏文件。fsck命令检查磁盘结构，如果它们已损坏，可以修复它们。HDFS提供了类似的fsck命令，来帮助确定文件丢失快或损坏的块。 与Linux fsck命令不同，hdfs fsck命令不会尝试修复错误，但提供了修复损坏块的选项。 [root@hadoop101.yinzhengjie.com ~]# hdfs fsck Usage: hdfs fsck <path> [-list-corruptfileblocks | [-move | -delete | -openforwrite] [-files [-blocks [-locations | -racks | -replicaDetails | -upgradedomains]]]] [-includeSnapshots] [-stor agepolicies] [-maintenance] [-blockId <blk_Id>] <path> start checking from this path -move move corrupted files to /lost+found -delete delete corrupted files -files print out files being checked -openforwrite print out files opened for write -includeSnapshots include snapshot data if the given path indicates a snapshottable directory or there are snapshottable directories under it -list-corruptfileblocks print out list of missing blocks and files they belong to -files -blocks print out block report -files -blocks -locations print out locations for every block -files -blocks -racks print out network topology for data-node locations -files -blocks -replicaDetails print out each replica details -files -blocks -upgradedomains print out upgrade domains for every block -storagepolicies print out storage policy summary for the blocks -maintenance print out maintenance state node details -blockId print out which file this blockId belongs to, locations (nodes, racks) of this block, and other diagnostics info (under replicated, corrupted or not, etc) Please Note: 1. By default fsck ignores files opened for write, use -openforwrite to report such files. They are usually tagged CORRUPT or HEALTHY depending on their block allocation status 2. Option -includeSnapshots should not be used for comparing stats, should be used only for HEALTH check, as this may contain duplicates if the same file present in both original fs tree and inside snapshots. Generic options supported are: -conf <configuration file> specify an application configuration file -D <property=value> define a value for a given property -fs <file:///|hdfs://namenode:port> specify default filesystem URL to use, overrides 'fs.defaultFS' property from configurations. -jt <local|resourcemanager:port> specify a ResourceManager -files <file1,...> specify a comma-separated list of files to be copied to the map reduce cluster -libjars <jar1,...> specify a comma-separated list of jar files to be included in the classpath -archives <archive1,...> specify a comma-separated list of archives to be unarchived on the compute machines The general command line syntax is: command [genericOptions] [commandOptions] [root@hadoop101.yinzhengjie.com ~]#
二.hdfs fsck常用命令选项案例
1>.执行HDFS文件系统检查
[root@hadoop101.yinzhengjie.com ~]# hdfs fsck / Connecting to namenode via http://hadoop101.yinzhengjie.com:50070/fsck?ugi=root&path=%2F FSCK started by root (auth:SIMPLE) from /172.200.6.101 for path / at Fri Aug 21 18:18:07 CST 2020 ...............Status: HEALTHY #很明显，当前的状态是"HEALTHY" Total size: 392718079 B #HDFS文件系统使用的实际大小，并不包含副本因子。 Total dirs: 12 #总的目录数是12个 Total files: 15 #总的文件数是15个 Total symlinks: 0 #总的符号连接数0个 Total blocks (validated): 16 (avg. block size 24544879 B) #总的块数16个(平均快大小是24MB左右) Minimally replicated blocks: 16 (100.0 %) #最小副本块数 Over-replicated blocks: 0 (0.0 %) #过度复制的副本块数 Under-replicated blocks: 0 (0.0 %) #正在复制的副本块数 Mis-replicated blocks: 0 (0.0 %) #错误副本块数 Default replication factor: 3 #默认的副本因子 Average block replication: 2.0 #平均的复制块 Corrupt blocks: 0 #损坏的块 Missing replicas: 0 (0.0 %) #缺少的副本 Number of data-nodes: 5 #DataNode的数量 Number of racks: 3 #机架的数量 FSCK ended at Fri Aug 21 18:18:07 CST 2020 in 1 milliseconds The filesystem under path '/' is HEALTHY [root@hadoop101.yinzhengjie.com ~]#
[root@hadoop101.yinzhengjie.com ~]# hdfs fsck / | grep -v "replicated" #检测某路径时，您也可以按关键字来进行过滤 Connecting to namenode via http://hadoop101.yinzhengjie.com:50070/fsck?ugi=root&path=%2F FSCK started by root (auth:SIMPLE) from /172.200.6.101 for path / at Fri Aug 21 18:17:37 CST 2020 ...............Status: HEALTHY Total size: 392718079 B Total dirs: 12 Total files: 15 Total symlinks: 0 Total blocks (validated): 16 (avg. block size 24544879 B) Default replication factor: 3 Average block replication: 2.0 Corrupt blocks: 0 Missing replicas: 0 (0.0 %) Number of data-nodes: 5 Number of racks: 3 FSCK ended at Fri Aug 21 18:17:37 CST 2020 in 1 milliseconds The filesystem under path '/' is HEALTHY [root@hadoop101.yinzhengjie.com ~]#
2>.显示正在检查的文件
[root@hadoop101.yinzhengjie.com ~]# hdfs fsck / -files Connecting to namenode via http://hadoop101.yinzhengjie.com:50070/fsck?ugi=root&files=1&path=%2F FSCK started by root (auth:SIMPLE) from /172.200.6.101 for path / at Fri Aug 21 18:31:30 CST 2020 / <dir> /bigdata <dir> /system <dir> /user <dir> /user/root <dir> /user/root/.Trash <dir> /user/root/.Trash/200821150442 <dir> /user/root/.Trash/200821150442/hosts 316968 bytes, 1 block(s): OK /user/root/.Trash/Current <dir> /user/root/.Trash/Current/yinzhengjie <dir> /user/root/a.txt 0 bytes, 0 block(s): OK /user/root/hadoop-2.10.0.tar.gz 392115733 bytes, 3 block(s): OK /user/root/messages 271339 bytes, 1 block(s): OK /user/root/test <dir> /yinzhengjie <dir> /yinzhengjie/hosts 371 bytes, 1 block(s): OK /yinzhengjie/wc.txt.gz 69 bytes, 1 block(s): OK /yinzhengjie/yum.repos.d <dir> /yinzhengjie/yum.repos.d/CentOS-Base.repo 1664 bytes, 1 block(s): OK /yinzhengjie/yum.repos.d/CentOS-CR.repo 1309 bytes, 1 block(s): OK /yinzhengjie/yum.repos.d/CentOS-Debuginfo.repo 649 bytes, 1 block(s): OK /yinzhengjie/yum.repos.d/CentOS-Media.repo 630 bytes, 1 block(s): OK /yinzhengjie/yum.repos.d/CentOS-Sources.repo 1331 bytes, 1 block(s): OK /yinzhengjie/yum.repos.d/CentOS-Vault.repo 5701 bytes, 1 block(s): OK /yinzhengjie/yum.repos.d/CentOS-fasttrack.repo 314 bytes, 1 block(s): OK /yinzhengjie/yum.repos.d/epel-testing.repo 1050 bytes, 1 block(s): OK /yinzhengjie/yum.repos.d/epel.repo 951 bytes, 1 block(s): OK Status: HEALTHY Total size: 392718079 B Total dirs: 12 Total files: 15 Total symlinks: 0 Total blocks (validated): 16 (avg. block size 24544879 B) Minimally replicated blocks: 16 (100.0 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 0 (0.0 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 3 Average block replication: 2.0 Corrupt blocks: 0 Missing replicas: 0 (0.0 %) Number of data-nodes: 5 Number of racks: 3 FSCK ended at Fri Aug 21 18:31:30 CST 2020 in 1 milliseconds The filesystem under path '/' is HEALTHY [root@hadoop101.yinzhengjie.com ~]#
3>.显示正在检查的文件及其对应的块信息
[root@hadoop101.yinzhengjie.com ~]# hdfs fsck / -files -blocks Connecting to namenode via http://hadoop101.yinzhengjie.com:50070/fsck?ugi=root&files=1&blocks=1&path=%2F FSCK started by root (auth:SIMPLE) from /172.200.6.101 for path / at Fri Aug 21 18:35:37 CST 2020 / <dir> /bigdata <dir> /system <dir> /user <dir> /user/root <dir> /user/root/.Trash <dir> /user/root/.Trash/200821150442 <dir> /user/root/.Trash/200821150442/hosts 316968 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741838_1892 len=316968 Live_repl=2 /user/root/.Trash/Current <dir> /user/root/.Trash/Current/yinzhengjie <dir> /user/root/a.txt 0 bytes, 0 block(s): OK /user/root/hadoop-2.10.0.tar.gz 392115733 bytes, 3 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741885_1915 len=134217728 Live_repl=1 1. BP-110925747-172.200.6.101-1597215213173:blk_1073741886_1916 len=134217728 Live_repl=1 2. BP-110925747-172.200.6.101-1597215213173:blk_1073741887_1917 len=123680277 Live_repl=1 /user/root/messages 271339 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741881_1911 len=271339 Live_repl=3 /user/root/test <dir> /yinzhengjie <dir> /yinzhengjie/hosts 371 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741898_1928 len=371 Live_repl=3 /yinzhengjie/wc.txt.gz 69 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741899_1929 len=69 Live_repl=3 /yinzhengjie/yum.repos.d <dir> /yinzhengjie/yum.repos.d/CentOS-Base.repo 1664 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741839_1015 len=1664 Live_repl=2 /yinzhengjie/yum.repos.d/CentOS-CR.repo 1309 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741840_1016 len=1309 Live_repl=2 /yinzhengjie/yum.repos.d/CentOS-Debuginfo.repo 649 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741841_1017 len=649 Live_repl=2 /yinzhengjie/yum.repos.d/CentOS-Media.repo 630 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741842_1018 len=630 Live_repl=2 /yinzhengjie/yum.repos.d/CentOS-Sources.repo 1331 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741843_1019 len=1331 Live_repl=2 /yinzhengjie/yum.repos.d/CentOS-Vault.repo 5701 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741844_1020 len=5701 Live_repl=2 /yinzhengjie/yum.repos.d/CentOS-fasttrack.repo 314 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741845_1021 len=314 Live_repl=2 /yinzhengjie/yum.repos.d/epel-testing.repo 1050 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741846_1022 len=1050 Live_repl=2 /yinzhengjie/yum.repos.d/epel.repo 951 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741847_1023 len=951 Live_repl=2 Status: HEALTHY Total size: 392718079 B Total dirs: 12 Total files: 15 Total symlinks: 0 Total blocks (validated): 16 (avg. block size 24544879 B) Minimally replicated blocks: 16 (100.0 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 0 (0.0 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 3 Average block replication: 2.0 Corrupt blocks: 0 Missing replicas: 0 (0.0 %) Number of data-nodes: 5 Number of racks: 3 FSCK ended at Fri Aug 21 18:35:37 CST 2020 in 1 milliseconds The filesystem under path '/' is HEALTHY [root@hadoop101.yinzhengjie.com ~]#
4>.显示正在检查的文件，块及其位置信息
[root@hadoop101.yinzhengjie.com ~]# hdfs fsck / -files -blocks -locations Connecting to namenode via http://hadoop101.yinzhengjie.com:50070/fsck?ugi=root&files=1&blocks=1&locations=1&path=%2F FSCK started by root (auth:SIMPLE) from /172.200.6.101 for path / at Fri Aug 21 18:39:21 CST 2020 / <dir> /bigdata <dir> /system <dir> /user <dir> /user/root <dir> /user/root/.Trash <dir> /user/root/.Trash/200821150442 <dir> /user/root/.Trash/200821150442/hosts 316968 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741838_1892 len=316968 Live_repl=2 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ca481097-2f96-4656-86ce-7c508ebc862a,DISK], DatanodeIn foWithStorage[172.200.6.102:50010,DS-08774d77-a5d0-4442-8b19-91924ee8f413,DISK]] /user/root/.Trash/Current <dir> /user/root/.Trash/Current/yinzhengjie <dir> /user/root/a.txt 0 bytes, 0 block(s): OK /user/root/hadoop-2.10.0.tar.gz 392115733 bytes, 3 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741885_1915 len=134217728 Live_repl=1 [DatanodeInfoWithStorage[172.200.6.102:50010,DS-08774d77-a5d0-4442-8b19-91924ee8f413,DISK]] 1. BP-110925747-172.200.6.101-1597215213173:blk_1073741886_1916 len=134217728 Live_repl=1 [DatanodeInfoWithStorage[172.200.6.102:50010,DS-db3faa5c-87ee-4df3-ad65-ae44d1239bc3,DISK]] 2. BP-110925747-172.200.6.101-1597215213173:blk_1073741887_1917 len=123680277 Live_repl=1 [DatanodeInfoWithStorage[172.200.6.102:50010,DS-08774d77-a5d0-4442-8b19-91924ee8f413,DISK]] /user/root/messages 271339 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741881_1911 len=271339 Live_repl=3 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ae05d8da-dc8f-42a1-8965-bf1033c4802e,DISK], DatanodeIn foWithStorage[172.200.6.104:50010,DS-ff7e2587-7848-474e-84e4-b086e04af40b,DISK], DatanodeInfoWithStorage[172.200.6.102:50010,DS-db3faa5c-87ee-4df3-ad65-ae44d1239bc3,DISK]] /user/root/test <dir> /yinzhengjie <dir> /yinzhengjie/hosts 371 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741898_1928 len=371 Live_repl=3 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ae05d8da-dc8f-42a1-8965-bf1033c4802e,DISK], DatanodeInfoW ithStorage[172.200.6.104:50010,DS-ff7e2587-7848-474e-84e4-b086e04af40b,DISK], DatanodeInfoWithStorage[172.200.6.102:50010,DS-db3faa5c-87ee-4df3-ad65-ae44d1239bc3,DISK]] /yinzhengjie/wc.txt.gz 69 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741899_1929 len=69 Live_repl=3 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ca481097-2f96-4656-86ce-7c508ebc862a,DISK], DatanodeInfoWi thStorage[172.200.6.104:50010,DS-3ae3a2ae-f716-4bec-b113-4b92243a0592,DISK], DatanodeInfoWithStorage[172.200.6.102:50010,DS-08774d77-a5d0-4442-8b19-91924ee8f413,DISK]] /yinzhengjie/yum.repos.d <dir> /yinzhengjie/yum.repos.d/CentOS-Base.repo 1664 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741839_1015 len=1664 Live_repl=2 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ae05d8da-dc8f-42a1-8965-bf1033c4802e,DISK], DatanodeInfo WithStorage[172.200.6.102:50010,DS-08774d77-a5d0-4442-8b19-91924ee8f413,DISK]] /yinzhengjie/yum.repos.d/CentOS-CR.repo 1309 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741840_1016 len=1309 Live_repl=2 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ae05d8da-dc8f-42a1-8965-bf1033c4802e,DISK], DatanodeInfo WithStorage[172.200.6.102:50010,DS-08774d77-a5d0-4442-8b19-91924ee8f413,DISK]] /yinzhengjie/yum.repos.d/CentOS-Debuginfo.repo 649 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741841_1017 len=649 Live_repl=2 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ae05d8da-dc8f-42a1-8965-bf1033c4802e,DISK], DatanodeInfoW ithStorage[172.200.6.102:50010,DS-db3faa5c-87ee-4df3-ad65-ae44d1239bc3,DISK]] /yinzhengjie/yum.repos.d/CentOS-Media.repo 630 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741842_1018 len=630 Live_repl=2 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ae05d8da-dc8f-42a1-8965-bf1033c4802e,DISK], DatanodeInfoW ithStorage[172.200.6.102:50010,DS-db3faa5c-87ee-4df3-ad65-ae44d1239bc3,DISK]] /yinzhengjie/yum.repos.d/CentOS-Sources.repo 1331 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741843_1019 len=1331 Live_repl=2 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ca481097-2f96-4656-86ce-7c508ebc862a,DISK], DatanodeInfo WithStorage[172.200.6.102:50010,DS-08774d77-a5d0-4442-8b19-91924ee8f413,DISK]] /yinzhengjie/yum.repos.d/CentOS-Vault.repo 5701 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741844_1020 len=5701 Live_repl=2 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ca481097-2f96-4656-86ce-7c508ebc862a,DISK], DatanodeInfo WithStorage[172.200.6.102:50010,DS-db3faa5c-87ee-4df3-ad65-ae44d1239bc3,DISK]] /yinzhengjie/yum.repos.d/CentOS-fasttrack.repo 314 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741845_1021 len=314 Live_repl=2 [DatanodeInfoWithStorage[172.200.6.104:50010,DS-ff7e2587-7848-474e-84e4-b086e04af40b,DISK], DatanodeInfoW ithStorage[172.200.6.102:50010,DS-08774d77-a5d0-4442-8b19-91924ee8f413,DISK]] /yinzhengjie/yum.repos.d/epel-testing.repo 1050 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741846_1022 len=1050 Live_repl=2 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ca481097-2f96-4656-86ce-7c508ebc862a,DISK], DatanodeInfo WithStorage[172.200.6.102:50010,DS-db3faa5c-87ee-4df3-ad65-ae44d1239bc3,DISK]] /yinzhengjie/yum.repos.d/epel.repo 951 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741847_1023 len=951 Live_repl=2 [DatanodeInfoWithStorage[172.200.6.103:50010,DS-ae05d8da-dc8f-42a1-8965-bf1033c4802e,DISK], DatanodeInfoW ithStorage[172.200.6.102:50010,DS-db3faa5c-87ee-4df3-ad65-ae44d1239bc3,DISK]] Status: HEALTHY Total size: 392718079 B Total dirs: 12 Total files: 15 Total symlinks: 0 Total blocks (validated): 16 (avg. block size 24544879 B) Minimally replicated blocks: 16 (100.0 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 0 (0.0 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 3 Average block replication: 2.0 Corrupt blocks: 0 Missing replicas: 0 (0.0 %) Number of data-nodes: 5 Number of racks: 3 FSCK ended at Fri Aug 21 18:39:21 CST 2020 in 1 milliseconds The filesystem under path '/' is HEALTHY [root@hadoop101.yinzhengjie.com ~]#
5>.显示正在检查的文件，块，位置和所在机架信息
[root@hadoop101.yinzhengjie.com ~]# hdfs fsck / -files -blocks -locations -racks Connecting to namenode via http://hadoop101.yinzhengjie.com:50070/fsck?ugi=root&files=1&blocks=1&locations=1&racks=1&path=%2F FSCK started by root (auth:SIMPLE) from /172.200.6.101 for path / at Fri Aug 21 18:44:43 CST 2020 / <dir> /bigdata <dir> /system <dir> /user <dir> /user/root <dir> /user/root/.Trash <dir> /user/root/.Trash/200821150442 <dir> /user/root/.Trash/200821150442/hosts 316968 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741838_1892 len=316968 Live_repl=2 [/rack002/172.200.6.103:50010, /rack001/172.200.6.102:50010] /user/root/.Trash/Current <dir> /user/root/.Trash/Current/yinzhengjie <dir> /user/root/a.txt 0 bytes, 0 block(s): OK /user/root/hadoop-2.10.0.tar.gz 392115733 bytes, 3 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741885_1915 len=134217728 Live_repl=1 [/rack001/172.200.6.102:50010] 1. BP-110925747-172.200.6.101-1597215213173:blk_1073741886_1916 len=134217728 Live_repl=1 [/rack001/172.200.6.102:50010] 2. BP-110925747-172.200.6.101-1597215213173:blk_1073741887_1917 len=123680277 Live_repl=1 [/rack001/172.200.6.102:50010] /user/root/messages 271339 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741881_1911 len=271339 Live_repl=3 [/rack002/172.200.6.103:50010, /rack002/172.200.6.104:50010, /rack001/172.200.6.102:50010] /user/root/test <dir> /yinzhengjie <dir> /yinzhengjie/hosts 371 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741898_1928 len=371 Live_repl=3 [/rack002/172.200.6.103:50010, /rack002/172.200.6.104:50010, /rack001/172.200.6.102:50010] /yinzhengjie/wc.txt.gz 69 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741899_1929 len=69 Live_repl=3 [/rack002/172.200.6.103:50010, /rack002/172.200.6.104:50010, /rack001/172.200.6.102:50010] /yinzhengjie/yum.repos.d <dir> /yinzhengjie/yum.repos.d/CentOS-Base.repo 1664 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741839_1015 len=1664 Live_repl=2 [/rack002/172.200.6.103:50010, /rack001/172.200.6.102:50010] /yinzhengjie/yum.repos.d/CentOS-CR.repo 1309 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741840_1016 len=1309 Live_repl=2 [/rack002/172.200.6.103:50010, /rack001/172.200.6.102:50010] /yinzhengjie/yum.repos.d/CentOS-Debuginfo.repo 649 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741841_1017 len=649 Live_repl=2 [/rack002/172.200.6.103:50010, /rack001/172.200.6.102:50010] /yinzhengjie/yum.repos.d/CentOS-Media.repo 630 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741842_1018 len=630 Live_repl=2 [/rack002/172.200.6.103:50010, /rack001/172.200.6.102:50010] /yinzhengjie/yum.repos.d/CentOS-Sources.repo 1331 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741843_1019 len=1331 Live_repl=2 [/rack002/172.200.6.103:50010, /rack001/172.200.6.102:50010] /yinzhengjie/yum.repos.d/CentOS-Vault.repo 5701 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741844_1020 len=5701 Live_repl=2 [/rack002/172.200.6.103:50010, /rack001/172.200.6.102:50010] /yinzhengjie/yum.repos.d/CentOS-fasttrack.repo 314 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741845_1021 len=314 Live_repl=2 [/rack002/172.200.6.104:50010, /rack001/172.200.6.102:50010] /yinzhengjie/yum.repos.d/epel-testing.repo 1050 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741846_1022 len=1050 Live_repl=2 [/rack002/172.200.6.103:50010, /rack001/172.200.6.102:50010] /yinzhengjie/yum.repos.d/epel.repo 951 bytes, 1 block(s): OK 0. BP-110925747-172.200.6.101-1597215213173:blk_1073741847_1023 len=951 Live_repl=2 [/rack002/172.200.6.103:50010, /rack001/172.200.6.102:50010] Status: HEALTHY Total size: 392718079 B Total dirs: 12 Total files: 15 Total symlinks: 0 Total blocks (validated): 16 (avg. block size 24544879 B) Minimally replicated blocks: 16 (100.0 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 0 (0.0 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 3 Average block replication: 2.0 Corrupt blocks: 0 Missing replicas: 0 (0.0 %) Number of data-nodes: 5 Number of racks: 3 FSCK ended at Fri Aug 21 18:44:43 CST 2020 in 1 milliseconds The filesystem under path '/' is HEALTHY [root@hadoop101.yinzhengjie.com ~]#
6>.列出缺少的块及其所述的文件
[root@hadoop101.yinzhengjie.com ~]# hdfs fsck -list-corruptfileblocks #如果你的集群是健康的，就不会有损坏块的消息提示。如果你的集群是不健康的(比如有丢失的块)，则可能如下图所示。 Connecting to namenode via http://hadoop101.yinzhengjie.com:50070/fsck?ugi=root&listcorruptfileblocks=1&path=%2F The filesystem under path '/' has 0 CORRUPT files [root@hadoop101.yinzhengjie.com ~]#
三.处理HDFS损坏文件的案例
1>.列出缺少的块及其所属的文件
[root@hadoop101.yinzhengjie.org.cn ~]# hdfs fsck -list-corruptfileblocks Connecting to namenode via http://hadoop101.yinzhengjie.org.cn:50070/fsck?ugi=root&listcorruptfileblocks=1&path=%2F The list of corrupt files under path '/' are: blk_1073742846 /tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660 The filesystem under path '/' has 1 CORRUPT files [root@hadoop101.yinzhengjie.org.cn ~]#
2>.处理HDFS损坏文件的方法
有两种方法处理损坏的文件，即move或者delete(hdfs dfs -rm)。 使用"-move"选项允许fsck命令将损坏的文件移动到"/lost+found"目录。这比使用"hdfs dfs -rm"命令从HDFS文件系统删除损坏的文件更好(需要注意的是，当使用rm命令从HDFS删除损坏的文件时，损坏的文件显示为已损坏，如果配置了回收站功能，它将进入trash目录)。
删除损坏的文件更好的方法时使用fsck命令并指定"-delete"选项。
3>.尝试修复已损坏的块
如下图所示，我们可以尝试找到损坏块在集群中哪个节点上，然后可以使用块号到NameNode上检查其日志以查看块处于的位置。如果发现问题是由于DataNode已关闭引起的，则一旦修复该问题，将不再标记为损坏块。
但我下面的这种情况下是无法恢复的文件，因此建议使用"-delete"选项进行删除该块。
[root@hadoop101.yinzhengjie.org.cn ~]# hdfs fsck -list-corruptfileblocks Connecting to namenode via http://hadoop101.yinzhengjie.org.cn:50070/fsck?ugi=root&listcorruptfileblocks=1&path=%2F The list of corrupt files under path '/' are: blk_1073742846 /tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660 The filesystem under path '/' has 1 CORRUPT files [root@hadoop101.yinzhengjie.org.cn ~]# [root@hadoop101.yinzhengjie.org.cn ~]# hdfs fsck /tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660 -blocks -locations Connecting to namenode via http://hadoop101.yinzhengjie.org.cn:50070/fsck?ugi=root&blocks=1&locations=1&path=%2Ftmp%2Flogs%2Froot%2Flogs%2Fapplication_15933 89957653_0002%2Fhadoop101.yinzhengjie.org.cn_11660FSCK started by root (auth:SIMPLE) from /172.200.4.101 for path /tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660 at Fri Aug 21 03:27:50 CST 2020. /tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660: CORRUPT blockpool BP-536854561-172.200.4.101-1589326197709 block blk_ 1073742846 /tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660: MISSING 1 blocks of total size 6148 B.Status: CORRUPT Total size: 6148 B Total dirs: 0 Total files: 1 Total symlinks: 0 Total blocks (validated): 1 (avg. block size 6148 B) ******************************** UNDER MIN REPL'D BLOCKS: 1 (100.0 %) dfs.namenode.replication.min: 1 CORRUPT FILES: 1 MISSING BLOCKS: 1 MISSING SIZE: 6148 B CORRUPT BLOCKS: 1 ******************************** Minimally replicated blocks: 0 (0.0 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 0 (0.0 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 3 Average block replication: 0.0 Corrupt blocks: 1 Missing replicas: 0 Number of data-nodes: 6 Number of racks: 1 FSCK ended at Fri Aug 21 03:27:50 CST 2020 in 4 milliseconds The filesystem under path '/tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660' is CORRUPT [root@hadoop101.yinzhengjie.org.cn ~]#
4>.使用"hdfs fsck -move"命令将所有损坏的块移动到/lost+found
[root@hadoop101.yinzhengjie.org.cn ~]# hdfs dfs -ls / #注意观察夏安有目录结构 Found 5 items drwxr-xr-x - root supergroup 0 2020-05-30 11:57 /hbase drwxr-xr-x - root supergroup 0 2020-05-29 18:55 /input_fruit drwx------ - root supergroup 0 2020-06-29 08:50 /tmp drwxr-xr-x - root supergroup 0 2020-06-29 08:22 /user drwxr-xr-x - root supergroup 0 2020-07-03 04:33 /yinzhengjie [root@hadoop101.yinzhengjie.org.cn ~]#
[root@hadoop101.yinzhengjie.org.cn ~]# hdfs fsck -move Connecting to namenode via http://hadoop101.yinzhengjie.org.cn:50070/fsck?ugi=root&move=1&path=%2F FSCK started by root (auth:SIMPLE) from /172.200.4.101 for path / at Fri Aug 21 03:43:00 CST 2020 .................................................................................................... .................................................................................................... ...................................................... /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/job.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742288_1480. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/job.split: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742289_1481. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)........ /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/commons-lang3-3.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742278_1470. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hadoop-common-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742282_14 74. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hadoop-mapreduce-client-core-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:bl k_1073742279_1471. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-client-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742281_1473 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-common-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742269_1461 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-hadoop-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_10737422 70_1462. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-hadoop2-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742 273_1465. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-mapreduce-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742285_1 477. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-metrics-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742274_146 6. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-metrics-api-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742268 _1460. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-protocol-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742276_14 68. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-protocol-shaded-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2284_1476. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-server-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742277_1469 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-shaded-miscellaneous-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1 073742286_1478. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-shaded-netty-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374227 2_1464. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-shaded-protobuf-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2283_1475. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-zookeeper-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742280_1 472. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/htrace-core4-4.1.0-incubating.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073 742271_1463. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/metrics-core-3.0.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742267_1459 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/protobuf-java-2.5.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742275_146 7. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/zookeeper-3.4.9.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742287_1479. T arget Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/job.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742319_1511. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/job.split: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742320_1512. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)........ /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/commons-lang3-3.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742309_1501. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hadoop-common-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742313_15 05. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hadoop-mapreduce-client-core-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:bl k_1073742310_1502. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-client-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742312_1504 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-common-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742300_1492 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-hadoop-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_10737423 01_1493. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-hadoop2-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742 304_1496. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-mapreduce-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742316_1 508. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-metrics-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742305_149 7. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-metrics-api-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742299 _1491. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-protocol-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742307_14 99. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-protocol-shaded-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2315_1507. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-server-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742308_1500 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-shaded-miscellaneous-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1 073742317_1509. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-shaded-netty-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374230 3_1495. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-shaded-protobuf-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2314_1506. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-zookeeper-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742311_1 503. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/htrace-core4-4.1.0-incubating.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073 742302_1494. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/metrics-core-3.0.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742298_1490 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/protobuf-java-2.5.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742306_149 8. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/zookeeper-3.4.9.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742318_1510. T arget Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/job.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742353_1545. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/job.split: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742354_1546. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)........ /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/commons-lang3-3.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742343_1535. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hadoop-common-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742347_15 39. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hadoop-mapreduce-client-core-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:bl k_1073742344_1536. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-client-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742346_1538 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-common-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742334_1526 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-hadoop-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_10737423 35_1527. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-hadoop2-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742 338_1530. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-mapreduce-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742350_1 542. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-metrics-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742339_153 1. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-metrics-api-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742333 _1525. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-protocol-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742341_15 33. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-protocol-shaded-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2349_1541. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-server-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742342_1534 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-shaded-miscellaneous-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1 073742351_1543. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-shaded-netty-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374233 7_1529. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-shaded-protobuf-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2348_1540. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-zookeeper-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742345_1 537. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/htrace-core4-4.1.0-incubating.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073 742336_1528. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/metrics-core-3.0.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742332_1524 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/protobuf-java-2.5.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742340_153 2. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/zookeeper-3.4.9.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742352_1544. T arget Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/job.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742405_1606. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/job.split: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742406_1607. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)........ /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/commons-lang3-3.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742395_1596. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hadoop-common-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742399_16 00. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hadoop-mapreduce-client-core-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:bl k_1073742396_1597. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-client-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742398_1599 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-common-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742386_1587 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-hadoop-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_10737423 87_1588. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-hadoop2-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742 390_1591. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-mapreduce-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742402_1 603. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-metrics-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742391_159 2. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-metrics-api-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742385 _1586. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-protocol-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742393_15 94. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-protocol-shaded-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2401_1602. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-server-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742394_1595 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-shaded-miscellaneous-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1 073742403_1604. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-shaded-netty-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374238 9_1590. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-shaded-protobuf-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2400_1601. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-zookeeper-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742397_1 598. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/htrace-core4-4.1.0-incubating.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073 742388_1589. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/metrics-core-3.0.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742384_1585 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/protobuf-java-2.5.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742392_159 3. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/zookeeper-3.4.9.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742404_1605. T arget Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/job.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742454_1663. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/job.split: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742455_1664. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)........ /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/commons-lang3-3.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742444_1653. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hadoop-common-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742448_16 57. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hadoop-mapreduce-client-core-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:bl k_1073742445_1654. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-client-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742447_1656 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-common-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742435_1644 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-hadoop-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_10737424 36_1645. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-hadoop2-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742 439_1648. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-mapreduce-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742451_1 660. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-metrics-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742440_164 9. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-metrics-api-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742434 _1643. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-protocol-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742442_16 51. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-protocol-shaded-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2450_1659. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-server-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742443_1652 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-shaded-miscellaneous-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1 073742452_1661. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-shaded-netty-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374243 8_1647. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-shaded-protobuf-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2449_1658. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-zookeeper-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742446_1 655. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/htrace-core4-4.1.0-incubating.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073 742437_1646. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/metrics-core-3.0.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742433_1642 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/protobuf-java-2.5.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742441_165 0. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/zookeeper-3.4.9.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742453_1662. T arget Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)... .......... /tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660: CORRUPT blockpool BP-536854561-172.200.4.101-1589326197709 block blk_1073742846 /tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660: MISSING 1 blocks of total size 6148 B.......Status: CORRUPT Total size: 434686501 B Total dirs: 273 Total files: 416 Total symlinks: 0 Total blocks (validated): 367 (avg. block size 1184431 B) ******************************** UNDER MIN REPL'D BLOCKS: 1 (0.27247956 %) dfs.namenode.replication.min: 1 CORRUPT FILES: 1 MISSING BLOCKS: 1 MISSING SIZE: 6148 B CORRUPT BLOCKS: 1 ******************************** Minimally replicated blocks: 366 (99.72752 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 115 (31.33515 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 3 Average block replication: 3.93188 Corrupt blocks: 1 Missing replicas: 460 (24.134314 %) Number of data-nodes: 6 Number of racks: 1 FSCK ended at Fri Aug 21 03:43:01 CST 2020 in 262 milliseconds The filesystem under path '/' is CORRUPT [root@hadoop101.yinzhengjie.org.cn ~]#
[root@hadoop101.yinzhengjie.org.cn ~]# hdfs dfs -ls / Found 6 items drwxr-xr-x - root supergroup 0 2020-05-30 11:57 /hbase drwxr-xr-x - root supergroup 0 2020-05-29 18:55 /input_fruit drw-r--r-- - root supergroup 0 2020-08-21 03:43 /lost+found drwx------ - root supergroup 0 2020-06-29 08:50 /tmp drwxr-xr-x - root supergroup 0 2020-06-29 08:22 /user drwxr-xr-x - root supergroup 0 2020-07-03 04:33 /yinzhengjie [root@hadoop101.yinzhengjie.org.cn ~]# [root@hadoop101.yinzhengjie.org.cn ~]# hdfs dfs -ls /lost+found #不难发现执行"-move"命令后，会自动生成"/lost+found"目录 Found 1 items drwxr----- - root supergroup 0 2020-08-21 03:43 /lost+found/tmp [root@hadoop101.yinzhengjie.org.cn ~]# [root@hadoop101.yinzhengjie.org.cn ~]# hdfs dfs -ls -R /lost+found drwxr----- - root supergroup 0 2020-08-21 03:43 /lost+found/tmp drwxr----- - root supergroup 0 2020-08-21 03:43 /lost+found/tmp/logs drwxr----- - root supergroup 0 2020-08-21 03:43 /lost+found/tmp/logs/root drwxr----- - root supergroup 0 2020-08-21 03:43 /lost+found/tmp/logs/root/logs drwxr----- - root supergroup 0 2020-08-21 03:43 /lost+found/tmp/logs/root/logs/application_1593389957653_0002 drw-r----- - root supergroup 0 2020-08-21 03:43 /lost+found/tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660 [root@hadoop101.yinzhengjie.org.cn ~]#
5>.使用"hdfs fsck -delete"命令删除损坏文件
[root@hadoop101.yinzhengjie.org.cn ~]# hdfs fsck -list-corruptfileblocks Connecting to namenode via http://hadoop101.yinzhengjie.org.cn:50070/fsck?ugi=root&listcorruptfileblocks=1&path=%2F The list of corrupt files under path '/' are: blk_1073742846 /tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660 The filesystem under path '/' has 1 CORRUPT files [root@hadoop101.yinzhengjie.org.cn ~]# [root@hadoop101.yinzhengjie.org.cn ~]# hdfs fsck -delete Connecting to namenode via http://hadoop101.yinzhengjie.org.cn:50070/fsck?ugi=root&delete=1&path=%2F FSCK started by root (auth:SIMPLE) from /172.200.4.101 for path / at Fri Aug 21 03:53:25 CST 2020 .................................................................................................... .................................................................................................... ...................................................... /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/job.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742288_1480. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/job.split: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742289_1481. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)........ /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/commons-lang3-3.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742278_1470. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hadoop-common-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742282_14 74. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hadoop-mapreduce-client-core-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:bl k_1073742279_1471. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-client-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742281_1473 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-common-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742269_1461 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-hadoop-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_10737422 70_1462. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-hadoop2-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742 273_1465. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-mapreduce-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742285_1 477. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-metrics-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742274_146 6. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-metrics-api-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742268 _1460. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-protocol-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742276_14 68. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-protocol-shaded-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2284_1476. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-server-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742277_1469 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-shaded-miscellaneous-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1 073742286_1478. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-shaded-netty-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374227 2_1464. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-shaded-protobuf-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2283_1475. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/hbase-zookeeper-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742280_1 472. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/htrace-core4-4.1.0-incubating.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073 742271_1463. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/metrics-core-3.0.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742267_1459 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/protobuf-java-2.5.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742275_146 7. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0001/libjars/zookeeper-3.4.9.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742287_1479. T arget Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/job.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742319_1511. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/job.split: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742320_1512. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)........ /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/commons-lang3-3.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742309_1501. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hadoop-common-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742313_15 05. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hadoop-mapreduce-client-core-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:bl k_1073742310_1502. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-client-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742312_1504 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-common-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742300_1492 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-hadoop-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_10737423 01_1493. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-hadoop2-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742 304_1496. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-mapreduce-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742316_1 508. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-metrics-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742305_149 7. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-metrics-api-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742299 _1491. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-protocol-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742307_14 99. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-protocol-shaded-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2315_1507. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-server-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742308_1500 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-shaded-miscellaneous-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1 073742317_1509. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-shaded-netty-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374230 3_1495. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-shaded-protobuf-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2314_1506. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/hbase-zookeeper-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742311_1 503. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/htrace-core4-4.1.0-incubating.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073 742302_1494. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/metrics-core-3.0.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742298_1490 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/protobuf-java-2.5.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742306_149 8. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0002/libjars/zookeeper-3.4.9.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742318_1510. T arget Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/job.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742353_1545. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/job.split: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742354_1546. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)........ /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/commons-lang3-3.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742343_1535. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hadoop-common-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742347_15 39. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hadoop-mapreduce-client-core-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:bl k_1073742344_1536. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-client-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742346_1538 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-common-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742334_1526 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-hadoop-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_10737423 35_1527. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-hadoop2-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742 338_1530. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-mapreduce-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742350_1 542. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-metrics-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742339_153 1. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-metrics-api-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742333 _1525. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-protocol-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742341_15 33. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-protocol-shaded-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2349_1541. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-server-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742342_1534 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-shaded-miscellaneous-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1 073742351_1543. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-shaded-netty-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374233 7_1529. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-shaded-protobuf-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2348_1540. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/hbase-zookeeper-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742345_1 537. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/htrace-core4-4.1.0-incubating.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073 742336_1528. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/metrics-core-3.0.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742332_1524 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/protobuf-java-2.5.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742340_153 2. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590748317397_0003/libjars/zookeeper-3.4.9.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742352_1544. T arget Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/job.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742405_1606. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/job.split: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742406_1607. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)........ /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/commons-lang3-3.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742395_1596. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hadoop-common-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742399_16 00. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hadoop-mapreduce-client-core-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:bl k_1073742396_1597. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-client-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742398_1599 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-common-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742386_1587 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-hadoop-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_10737423 87_1588. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-hadoop2-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742 390_1591. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-mapreduce-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742402_1 603. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-metrics-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742391_159 2. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-metrics-api-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742385 _1586. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-protocol-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742393_15 94. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-protocol-shaded-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2401_1602. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-server-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742394_1595 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-shaded-miscellaneous-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1 073742403_1604. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-shaded-netty-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374238 9_1590. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-shaded-protobuf-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2400_1601. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/hbase-zookeeper-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742397_1 598. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/htrace-core4-4.1.0-incubating.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073 742388_1589. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/metrics-core-3.0.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742384_1585 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/protobuf-java-2.5.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742392_159 3. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590749076365_0001/libjars/zookeeper-3.4.9.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742404_1605. T arget Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/job.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742454_1663. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/job.split: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742455_1664. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)........ /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/commons-lang3-3.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742444_1653. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hadoop-common-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742448_16 57. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hadoop-mapreduce-client-core-2.10.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:bl k_1073742445_1654. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-client-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742447_1656 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-common-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742435_1644 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-hadoop-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_10737424 36_1645. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-hadoop2-compat-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742 439_1648. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-mapreduce-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742451_1 660. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-metrics-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742440_164 9. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-metrics-api-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742434 _1643. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-protocol-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742442_16 51. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-protocol-shaded-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2450_1659. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-server-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742443_1652 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-shaded-miscellaneous-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1 073742452_1661. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-shaded-netty-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374243 8_1647. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-shaded-protobuf-2.2.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_107374 2449_1658. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/hbase-zookeeper-2.2.4.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742446_1 655. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/htrace-core4-4.1.0-incubating.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073 742437_1646. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/metrics-core-3.0.1.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742433_1642 . Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/protobuf-java-2.5.0.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742441_165 0. Target Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).. /tmp/hadoop-yarn/staging/root/.staging/job_1590781316348_0001/libjars/zookeeper-3.4.9.jar: Under replicated BP-536854561-172.200.4.101-1589326197709:blk_1073742453_1662. T arget Replicas is 10 but found 6 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s)... .......... /tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660: CORRUPT blockpool BP-536854561-172.200.4.101-1589326197709 block blk_1073742846 /tmp/logs/root/logs/application_1593389957653_0002/hadoop101.yinzhengjie.org.cn_11660: MISSING 1 blocks of total size 6148 B.......Status: CORRUPT Total size: 434686501 B Total dirs: 280 Total files: 416 Total symlinks: 0 Total blocks (validated): 367 (avg. block size 1184431 B) ******************************** UNDER MIN REPL'D BLOCKS: 1 (0.27247956 %) dfs.namenode.replication.min: 1 CORRUPT FILES: 1 MISSING BLOCKS: 1 MISSING SIZE: 6148 B CORRUPT BLOCKS: 1 ******************************** Minimally replicated blocks: 366 (99.72752 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 115 (31.33515 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 3 Average block replication: 3.93188 Corrupt blocks: 1 Missing replicas: 460 (24.134314 %) Number of data-nodes: 6 Number of racks: 1 FSCK ended at Fri Aug 21 03:53:25 CST 2020 in 53 milliseconds The filesystem under path '/' is CORRUPT [root@hadoop101.yinzhengjie.org.cn ~]# [root@hadoop101.yinzhengjie.org.cn ~]# hdfs fsck -list-corruptfileblocks Connecting to namenode via http://hadoop101.yinzhengjie.org.cn:50070/fsck?ugi=root&listcorruptfileblocks=1&path=%2F The filesystem under path '/' has 0 CORRUPT files [root@hadoop101.yinzhengjie.org.cn ~]#
四.处理HDFS无法恢复的文件
如果数据块的所有副本丢失或损坏，则意味着没有可读的副本，即数据块上的无法被读取。缺少的数据块没有活副本。这可能是由于损坏或因为块所在的DataNode离线引起的。
如果同时看到许多块的文件系统损坏信息，则意味着几个DataNode不能同时使用。
如果存储的数据的复制因子为1，那么即使一个节点丢失或运行不正确，也会看到丢失的块信息。
通过运行"fsck -delete"命令，可确保从HDFS元数据中永久删除丢失的数据。如果不删除它们，则可能发生一个进程卡在那里试图读取丢失的文件的情况。
就像我们上面的案例，当我们执行"fsck -move"命令时，对于已经损坏(无法恢复)的文件是不好使的，这个时候必须使用"fsck -delete"来永久删除损坏块在NameNode所对应的元数据信息。
温馨提示:
要主动捕获潜在的HDFS换坏信息，请定期运行hdfs fsck明朗了，就像cron作业运行HDFS平衡器命令一样。
fsck检查文件的开销并不重要，但是在繁忙的集群上，也可以在非高峰时间调度作业，就像调度平衡器作业一样。
五.处理HDFS副本不足的文件
Hadoop的在复制块(Under-replicated blocks)以满足配置的文件复制因子方面做的很好。当DataNode崩溃时，该节点上的文件通常在短时间内被复制。
Hadoop可以感知丢失的DataNode，因为它们不再从DataNode获取心跳。在DataNode崩溃后的十多分钟内开始复制。