lakehouse.databricks.common.create_folder_structure

lakehouse.databricks.common.create_folder_structure(spark, lake_file_struct)

A function to create the folder depth structure for querying nested files based on the lake file structof the data being queried

Parameters

sparkspark context

spark context passed from the calling spark instance

lake_file_struct: string

the file structure to generate the depth string for, eg 'yyyy/yyyy-MM/yyyy-MM-dd'

Returns

string:

for passed in lake_file_struct, 'yyyy/yyyy-MM/yyyy-MM-dd', return would be /*/*/*