Tag Archives: Spark

Microsoft Inspire 2021- A 2-day announcement roundup

Microsoft Inspire 2021- A 2-day announcement roundup   Recently Microsoft’s annual Inspire partner conference kicked

Getting started with Azure Data Factory Mapping Data Flows

Azure Data Factory V2 is the go-to service for moving large amounts of data within

2 Comments

Injecting Databricks DataFrame into a Power BI Push Dataset

Using Python and the Power BI REST API Now, why would you want to do

5 Comments

PySpark DataFrame Transformation Chaining

After working with Databricks and PySpark for a while now, its clear there needs to

1 Comment

Implementing Enterprise Security in Azure Databricks – Part 2

Following on from my last blog on the topic of security within Azure Databricks which

Implementing Enterprise Security in Azure Databricks – Part 1

In recent weeks, I’ve spent a fair chunk of time working with different aspects of

Spark Streaming in Azure Databricks

Real-time stream processing is becoming more prevalent on modern day data platforms, and with a

Introduction to Spark-Part 1: Installing Spark on Windows

This is the first post in a series on Introduction To Spark. For those wanting

Introduction to Spark

Spark is all the rage at the moment (and has been for a while) in

My Experience of the Microsoft Professional Program for Data Science

(Image 1 – Microsoft 2017 – https://academy.microsoft.com/en-us/professional-program/data-science) In 2016 I was talking to Andrew Fryer

3 Comments