s3cmd is an usual and handy tool for dealing with data in S3 from the command line. Usage Doc.For simple … More
Author: Piyush
Dealing with ‘Blocks with no live replicas’ in the HDFS
In a previous post, we dealt about ‘Under-replicated blocks in the HDFS‘. However, while decommissioning a couple of worker nodes, … More
How to exclude certain column(s) while exporting a Hive Table to local file?
In a previous post, I documented How to export complete Hive table to a local file? While being required to get … More
How to export complete Hive table to a local file?
Generally, solutions provided over the internet point towards: hive -e ‘select * from dbname.tablename;’ > /path/to/datadump.csv However, this will not … More
How to color code ‘diff’ output on CLI?
TL;DR : vim -d <file1> <file2> Comparing changes in files from time to time is very much the part and … More
How to change mysql version for ambari connections?
CentOS generally comes with mysql-connector-java-5.1.17.jar. However, there are many known bugs with the same. Hortonworks suggests updating the jar to … More
Notes: DevOps Practices
DevOps is the culture of collaboration between Development and Operations. Some essential Devops concepts include: Build Automation (BA) : It … More
Dividing folder contents into subfolders
Recently, I came across a problem of dividing a folder with N number of files into sub-folders with almost equal … More
