Snippets

Python — Alinear dtypes (Arrow/Delta)

def align_dtypes(df, schema):
    for col, dtype in schema.items():
        if col in df.columns:
            df[col] = df[col].astype(dtype)
    return df

SQL — MERGE Delta

MERGE INTO gold.runs AS g
USING silver.runs_delta AS s
ON g.id = s.id
WHEN MATCHED THEN UPDATE SET *
WHEN NOT MATCHED THEN INSERT *;