Slow ReadProcessor read fields t

Job container log

2020-11-05 09:07:12,462 WARN [ResponseProcessor for block BP-667861252-192.168.7.168-1429868078957:blk_3532879628_2526082425] org.apache.hadoop.hdfs.DFSClient: Slow ReadProcessor read fields took 84320ms (threshold=30000ms); ack: seqno: 21828 reply: 0 reply: 0 reply: 0 downstreamAckTimeNanos: 2221353, targets: [DatanodeInfoWithStorage[192.168.9.42:50010,DS-fc30f0a6-a6b3-4b5a-b2a5-0264be9d0b4a,DISK], DatanodeInfoWithStorage[192.168.9.37:50010,DS-c5286401-a47a-4da1-a1c5-d97d96eddb2a,DISK], DatanodeInfoWithStorage[192.168.9.43:50010,DS-4ab015fa-8b7c-4399-9793-dbe257b82e65,DISK]]
2020-11-05 09:26:17,241 WARN [ResponseProcessor for block BP-667861252-192.168.7.168-1429868078957:blk_3532879628_2526082425] org.apache.hadoop.hdfs.DFSClient: Slow ReadProcessor read fields took 64254ms (threshold=30000ms); ack: seqno: 22754 reply: 0 reply: 0 reply: 0 downstreamAckTimeNanos: 2150979, targets: [DatanodeInfoWithStorage[192.168.9.42:50010,DS-fc30f0a6-a6b3-4b5a-b2a5-0264be9d0b4a,DISK], DatanodeInfoWithStorage[192.168.9.37:50010,DS-c5286401-a47a-4da1-a1c5-d97d96eddb2a,DISK], DatanodeInfoWithStorage[192.168.9.43:50010,DS-4ab015fa-8b7c-4399-9793-dbe257b82e65,DISK]]

节点日志

2020-08-15 07:42:31,211 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Slow BlockReceiver write packet to mirror took 831ms (threshold=300ms)
2020-08-15 07:42:31,627 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Slow BlockReceiver write packet to mirror took 415ms (threshold=300ms)
2020-08-15 07:42:32,459 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Slow BlockReceiver write packet to mirror took 624ms (threshold=300ms)
2020-08-15 07:42:32,875 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Slow BlockReceiver write packet to mirror took 415ms (threshold=300ms)
2020-08-15 07:42:33,499 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Slow BlockReceiver write packet to mirror took 623ms (threshold=300ms)
2020-08-15 07:42:34,331 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Slow BlockReceiver write packet to mirror took 625ms (threshold=300ms)
2020-08-15 07:42:34,955 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Slow BlockReceiver write packet to mirror took 623ms (threshold=300ms)

for i in `cat g2_hosts`;
do
ssh -p 333 -t $i "echo -ne $i,;
egrep -o 'Slow.*?(took|cost)'  /hadoop_file/logs/hadoop-mfw_hadoop-datanode-*.log | wc -l";
done

awk -F "," '{print $1,$2}' 1.txt |sort -nr -k 2 |head -30| awk -F " " '{print "IP: "$1,"slow count: " $2}'

参考自
https://blog.csdn.net/hadoopp/article/details/100159617
https://community.cloudera.com/t5/Support-Questions/Solution-for-quot-slow-readprocessor-quot-warnings/td-p/122046