s3cmd is an usual and handy tool for dealing with data in S3 from the command line. Usage Doc.For simple…
Dealing with ‘Blocks with no live replicas’ in the HDFS
In a previous post, we dealt about ‘Under-replicated blocks in the HDFS‘. However, while decommissioning a couple of worker nodes,…
How to exclude certain column(s) while exporting a Hive Table to local file?
In a previous post, I documented How to export complete Hive table to a local file? While being required to get…
How to export complete Hive table to a local file?
Generally, solutions provided over the internet point towards: hive -e ‘select * from dbname.tablename;’ > /path/to/datadump.csv However, this will not…
How to color code ‘diff’ output on CLI?
TL;DR : vim -d <file1> <file2> Comparing changes in files from time to time is very much the part and…
How to change mysql version for ambari connections?
CentOS generally comes with mysql-connector-java-5.1.17.jar. However, there are many known bugs with the same. Hortonworks suggests updating the jar to…
Notes: DevOps Practices
DevOps is the culture of collaboration between Development and Operations. Some essential Devops concepts include: Build Automation (BA) : It…
Dividing folder contents into subfolders
Recently, I came across a problem of dividing a folder with N number of files into sub-folders with almost equal…
