Category: Databricks

05/04/2023

Why the pig?

Someone had noticed the logo change in my blog and asked why there is a pig in the logo now? Well, because originally I was gonna name this blog SQL Oinks. Why SQL Oinks? Here is the story: I had the pleasure to be in the room when my brilliant colleague Mike (amazing human and solution architect, who also writes SQL...

Databricks/Lakehouse/Misc

31/03/2023

Copy from/into Unity Catalog Tables using Copy Data Tool in Azure Data Factory

Those of you who have adopted Unity Catalog in Databricks and are using Azure Data Factory(ADF) in conjunction might have noticed that ADF’s delta lake connector has not been fully updated for Unity Catalog tables yet. You can only select database name and table name when creating a dataset using the connector, which means the three-level namespace Unity Catalog tables...

Azure Data Factory/Databricks/Uncategorized