Runtime 1.1, based on Apache Spark 3.3, will be retired and disabled as of March 31, 2025
Microsoft Fabric Runtime 1.1 will be retired and disabled as of March 2025. End of support for Microsoft Fabric Runtime 1.1 was announced July 12, 2024. We recommend that you upgrade your Fabric workspace and environments to use Runtime 1.3 (Apache Spark 3.5 and Delta Lake 3.2). This latest Fabric Runtime 1.3 also offers a Native Execution Engine to boost performance and flexibility at no additional cost. Learn more about Native Execution Engine here. For the complete lifecycle and support policies of Apache Spark runtimes in Fabric, refer to Lifecycle of Apache Spark runtimes in Fabric.Synapse pipelines storage event trigger security deep dive
ADF and Synapse Pipelines offer a feature that allows pipeline execution to be triggered based on various events, such as storage blob creation or deletion. This can be used by customers to implement event-driven pipeline orchestration. In this blog post, we will address some common security questions and challenges that may arise during storage event trigger creation.Improve Spark pool utilization with Synapse Genie
Synapse Genie Framework improves Spark pool utilization by executing multiple Synapse notebooks on the same Spark pool instance. It considers the sequence and dependencies between notebook activities in an ETL pipeline, which results in higher usage of a full cluster for resources available in a Spark pool.
How Data Exfiltration Protection (DEP) impacts Azure Synapse Analytics Pipelines
Do you want to know how enabling Data Exfiltration Protection (DEP) against a Synapse Workspace will impact Synapse Pipelines? This article discusses the impacts of DEP on Synapse Pipelines and potential workarounds. If you are considering enabling DEP in your Synapse deployment - this is a must read.How to – Advanced Properties of Linked Services
Azure Data Factory and Synapse Pipelines have a wealth of linked service connection types that allow them to connect and interact with many services and data stores. The Workspace UI provides the most important properties that are needed for the connection. However, at times we need more control that the UI doesn’t offer. In this tutorial, we will focus on customer scenario to see how you can find all the available properties for the Linked Service you are working with, then how to incorporate that property into your Linked Service directly from within the UI.
