lakehouse.databricks.common.create_anti_merge_predicate

lakehouse.databricks.common.create_anti_merge_predicate(spark, merge_predicate) → str

Creates the anti-merge key based on the 'merge_predicate' provided and logs the function's start and end time using 'post_la_data'.

Parameters

sparkspark context

Spark context object passed from the calling Spark instance.

merge_predicateList[str]

List of columns to be used as anti-merge keys.

Returns

str:

A string in the format "source.col1 <> dest.col1 and source.col2 <> dest.col2 ...", where "col1", "col2", etc. are the columns in 'merge_predicate'.