Working on a project to implement LLM in Databricks using Hugging face, I faced issue of being unable to download … More
Tag: Databricks
Managing Databricks Secrets using Windows.
Databricks has a method of Secret Management which allows users to save sensitive data such as JDBC connection or Snowflake … More
PySpark DataFrame ordering based on multiple columns
How to deal with the requirement to order a DataFrame using more than one column simultaneously? Also, consider some values … More
How to retain the first row of each ‘group’ in a PySpark DataFrame?
For a given dataframe, with multiple occurrence of a particular column value, one may desire to retain only one (or … More
Piyush Routray 