Forum Discussion

manuj's avatar
manuj
Copper Contributor
Apr 29, 2025

What Are the Ways to Dynamically Invoke Pipelines in ADF from Another Pipeline?

I am exploring different approaches to dynamically invoke ADF pipelines from within another pipeline as part of a modular and scalable orchestration strategy.

 

My use case involves having multiple reusable pipelines that can be called conditionally or in sequence, based on configuration stored externally (such as in a SQL Managed Instance or another Azure-native source).

 

I am aware of a few patterns like using the Execute Pipeline activity within a ForEach loop, but I would like to understand the full range of available and supported options for dynamically invoking pipelines from within ADF.

 

Could you please clarify the possible approaches for achieving this? Specifically, I am interested in:

 

Using ForEach with Execute Pipeline activity

  • How to structure the control flow for calling multiple pipelines in sequence or parallel.
  • How to pass pipeline names dynamically.

 

Dynamic pipeline name resolution

  • Is it possible to pass the pipeline name as a parameter to the Execute Pipeline activity?
  • How to handle validation when the pipeline name is dynamic?

 

Parameterized execution

  • Best practices for passing dynamic parameters to each pipeline when calling them in a loop or based on external config.

 

Calling ADF pipelines via REST API or Web Activity

  • When would this be preferred over native Execute Pipeline?
  • How to handle authentication and response handling?

 

If there are any recommendations, gotchas, or best practices related to dynamic pipeline orchestration in ADF, I would greatly appreciate your insights.

 

Thanks!

No RepliesBe the first to reply

Resources