To copy “Folder1/Folder2/file1” to “Folder3” source structure: Folder1/FolderA ………………….(not to be copied)Folder1/fileX…………………………(not to be copied)Folder1/Folder2/file1 desired destination structure: Folder3/Folder1/Folder2/file1 P.S. … More
Author: Piyush
Copying different S3 bucket folders with space(s) in their names.
s3cmd is an usual and handy tool for dealing with data in S3 from the command line. Usage Doc.For simple … More
Dealing with ‘Blocks with no live replicas’ in the HDFS
In a previous post, we dealt about ‘Under-replicated blocks in the HDFS‘. However, while decommissioning a couple of worker nodes, … More
How to exclude certain column(s) while exporting a Hive Table to local file?
In a previous post, I documented How to export complete Hive table to a local file? While being required to get … More
How to export complete Hive table to a local file?
Generally, solutions provided over the internet point towards: hive -e ‘select * from dbname.tablename;’ > /path/to/datadump.csv However, this will not … More
How to color code ‘diff’ output on CLI?
TL;DR : vim -d <file1> <file2> Comparing changes in files from time to time is very much the part and … More
How to change mysql version for ambari connections?
CentOS generally comes with mysql-connector-java-5.1.17.jar. However, there are many known bugs with the same. Hortonworks suggests updating the jar to … More
Notes: DevOps Practices
DevOps is the culture of collaboration between Development and Operations. Some essential Devops concepts include: Build Automation (BA) : It … More
