lakehouse.databricks.common.create_aggregate_dataframe

lakehouse.databricks.common.create_aggregate_dataframe(spark, dataframe, aggregation_def)

This function aggregates a dataframe based on the aggregation definition provided

returning the aggregated dataframe

Parameters

sparkspark context

Spark context object passed from the calling Spark instance.

dataframedataframe

the dataframe to be aggregated

aggregation_defobject

json object describing how the dataframe should be aggregated

Returns

dataframe :

the aggregated dataframe