Here is Something !

Lets  ​ calculate current year minus 3 years data using   pySpark       You can achieve this using   F.add_months ( current_ date ( ),- 36) ...

Spark is designed to write out multiple files in parallel. So there may be cases where we need to merge all the part files, remove the succe...

You can read and write to DBFS files using ' d butils ' Lets see one example dbutils.fs.put( "dbfs:///mnt/sample.txt" , ...

Delta tables can be accessed either by specifying the path on DBFS or by table name. You can check my previous blog to see how to write delt...

  You can read files into Dataframe and write out in delta format Step 1 : Read the input csv Step 2 : Write the csv to ADLS location using ...

  There may be cases where we need to initialize a Dataframe without specifying a schema. Let's see how to do that empty_DF = sqlContext...

 In order to get some inputs from user we will require widgets in our Azure Databricks notebook. This blog helps you to create a text based ...