Skip to content

Piyush Routray

  • Twitter
  • LinkedIn
  • About Piyush

Category: Scripts

Weekdays cron job, but for a particular date range.

Cron is a very simple, yet useful job scheduler on linux. To schedule a job for weekdays, one can easily … More

cron, linux

How to encrypt files before sharing online?

As a Data Engineer, one faces the need to share files securely over the internet. An easy way of doing … More

Data Engineering, PGP, security

How to copy a file, recreating the directory structure, using python?

To copy “Folder1/Folder2/file1” to “Folder3” source structure: Folder1/FolderA ………………….(not to be copied)Folder1/fileX…………………………(not to be copied)Folder1/Folder2/file1 desired destination structure: Folder3/Folder1/Folder2/file1 P.S. … More

Python, stackoverflow

How to exclude certain column(s) while exporting a Hive Table to local file?

In a previous post, I documented How to export complete Hive table to a local file? While being required to get … More

hive

How to export complete Hive table to a local file?

Generally, solutions provided over the internet point towards: hive -e ‘select * from dbname.tablename;’ > /path/to/datadump.csv However, this will not … More

hive

How to color code ‘diff’ output on CLI?

TL;DR :  vim -d <file1> <file2> Comparing changes in files from time to time is very much the part and … More

Dividing folder contents into subfolders

Recently, I came across a problem of dividing a folder with N number of files into sub-folders with almost equal … More

Browse by Category

ambari AWS Firehose AWS S3 centOS 7 cloudera cron Databricks Data Engineering datanode DevOps docker hadoop HDP hive Hortonworks java jenkins kubernetes linux OpenJDK OracleJDK PGP PySpark Python s3cmd security Snowflake stackoverflow Windows

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 433 other subscribers
My Tweets
Create a website or blog at WordPress.com
  • Follow Following
    • Piyush Routray
    • Already have a WordPress.com account? Log in now.
    • Piyush Routray
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...