Sum of sizes of files in a list of directories in Hadoop
# hadoop fs -du -s /orc-hive-staging/*/year=2017/month=9/day=[1-8] | awk '{ sum += $1 } END { print sum }'
1310397076941
Techie Jibes
Techie Jibes
# hadoop fs -du -s /orc-hive-staging/*/year=2017/month=9/day=[1-8] | awk '{ sum += $1 } END { print sum }'
1310397076941
0 Comments