Data Platform – Page 2

05/04/2023

Why the pig?

Someone had noticed the logo change in my blog and asked why there is a pig in the logo now? Well, because originally I was gonna name this blog SQL Oinks. Why SQL Oinks? Here is the story: I had the pleasure to be in the room when my brilliant colleague Mike (amazing human and solution architect, who also writes SQL...

Databricks/Lakehouse/Misc

31/03/2023

Copy from/into Unity Catalog Tables using Copy Data Tool in Azure Data Factory

Those of you who have adopted Unity Catalog in Databricks and are using Azure Data Factory(ADF) in conjunction might have noticed that ADF’s delta lake connector has not been fully updated for Unity Catalog tables yet. You can only select database name and table name when creating a dataset using the connector, which means the three-level namespace Unity Catalog tables...

Azure Data Factory/Databricks/Uncategorized

13/08/2022

5 ways to integrate Azure Synapse Analytics with Azure Machine Learning

Before the integration between Synapse and AML (Azure Machine Learning) was possible, when you wanted to bring Azure Machine Learning capability into your data platform, you would store your data in the data lake, set the lake up as a datastore in AML, do all the training and scoring of machine learning models in AML, push the scoring back to...

Azure Machine Learning/Synapse

Category: Data Platform

Why the pig?

Copy from/into Unity Catalog Tables using Copy Data Tool in Azure Data Factory

5 ways to integrate Azure Synapse Analytics with Azure Machine Learning