Forum Discussion
manuj
Apr 29, 2025Copper Contributor
What Are the Ways to Dynamically Invoke Pipelines in ADF from Another Pipeline?
I am exploring different approaches to dynamically invoke ADF pipelines from within another pipeline as part of a modular and scalable orchestration strategy.
My use case involves having multiple reusable pipelines that can be called conditionally or in sequence, based on configuration stored externally (such as in a SQL Managed Instance or another Azure-native source).
I am aware of a few patterns like using the Execute Pipeline activity within a ForEach loop, but I would like to understand the full range of available and supported options for dynamically invoking pipelines from within ADF.
Could you please clarify the possible approaches for achieving this? Specifically, I am interested in:
Using ForEach with Execute Pipeline activity
- How to structure the control flow for calling multiple pipelines in sequence or parallel.
- How to pass pipeline names dynamically.
Dynamic pipeline name resolution
- Is it possible to pass the pipeline name as a parameter to the Execute Pipeline activity?
- How to handle validation when the pipeline name is dynamic?
Parameterized execution
- Best practices for passing dynamic parameters to each pipeline when calling them in a loop or based on external config.
Calling ADF pipelines via REST API or Web Activity
- When would this be preferred over native Execute Pipeline?
- How to handle authentication and response handling?
If there are any recommendations, gotchas, or best practices related to dynamic pipeline orchestration in ADF, I would greatly appreciate your insights.
Thanks!
No RepliesBe the first to reply