Topics tagged subflows

Topic	Replies	Views	Activity
Flows and Subflows Tags, can it be propagated accross the execution? Deployments & DevOps subflows	0	10	March 30, 2023
How to create a mapped flow run with some parameters unmapped Workflow Orchestration prefect-1-0 , create_flow_run , subflows , mapping , unmapped	0	59	February 24, 2023
How can I run multiple subflows (or child flows) in parallel? Workflow Orchestration migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , parallel-processing , create_flow_run , orchestrator-pattern , subflows , async , mapping , local-dask-executor	13	2614	January 3, 2023
How to run conditional subflows and take action if a subflow fails or succeeds? DataflowOps for Prefect 2.0 prefect-2-0 , conditional-logic , state-dependencies , subflows	0	229	December 8, 2022
Subflows and backfilling Usage Questions prefect-2-0 , backfill , subflows	3	310	September 21, 2022
Subflow error - PrefectHTTPStatusError - Client error '403 Forbidden' Usage Questions prefect-2-0 , storage , subflows	1	218	September 8, 2022
How can I create a subflow? Workflow Orchestration migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , getting-started	0	1052	January 27, 2022
How to pass data between subflows? Workflow Orchestration prefect-2-0 , subflows , data-dependencies	0	368	April 8, 2022
Migrating to Prefect 2.0: From Flow of Flows to Subflows Tutorials & Resources migration-guide , flow-of-flows , subflows	0	1159	August 3, 2022
How to map over flows with various parameter values? Workflow Orchestration prefect-1-0 , parameters , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , mapping	1	1144	July 25, 2022
Persist context of LOOP tasks for flow restarts Usage Questions prefect-1-0 , subflows , looping , persistent-service	8	424	July 4, 2022
Are there any guidelines when to use flow vs task decorator? Which part of my workflow should be defined at a task, subflow vs. flow-level? Workflow Orchestration migration-guide , prefect-2-0 , dag-flow-structure , subflows , getting-started , task-decorator , best-practices , flow-decorator	0	504	March 17, 2022
Best way to create a DAG with tasks that should occur repeatedly at different time intervals Usage Questions prefect-1-0 , prefect-2-0 , flow-of-flows , scheduling , subflows	9	411	June 17, 2022
How can I create a subflow and block until it’s completed? Workflow Orchestration migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , to-review , start_flow_run	0	1207	January 28, 2022
How to handle custom resource (CPU vs. GPU) and code dependencies across various tasks and flows? Workflow Orchestration prefect-1-0 , prefect-2-0 , flow-of-flows , kubernetes , aws , orchestrator-pattern , subflows , infrastructure , cpu_request , kubernetes-agent , aws-eks , radar-view , gpu-intensive-workflows , cpu-memory-resource-allocation	2	1261	March 15, 2022
How to customize how the name of a task triggering a child flow run is displayed in the parent DAG? (i.e. how to override the default task name create_flow_run) Workflow Orchestration prefect-1-0 , dag-flow-structure , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , flow_run_name , task-decorator	0	602	March 11, 2022
Can my subflow use a different task runner than my parent flow? Workflow Orchestration migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , executor , task-runner , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run	0	393	January 31, 2022
How to build a parametrized flow of flows using GCS storage and Docker agent? Deployments & DevOps prefect-1-0 , parameters , flow-of-flows , gcp , docker , orchestrator-pattern , subflows , data-dependencies , local-agent , docker-agent , docker-run	0	295	February 26, 2022
How to pass data from a child flow to another task in a parent flow? Workflow Orchestration prefect-1-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , data-dependencies , get_task_run_result	0	711	January 31, 2022
How to fix the error: "ValueError: Could not infer an active Flow context while creating edge to <Task: create_flow_run>" Workflow Orchestration prefect-1-0 , flow-of-flows , gcp , secrets , orchestrator-pattern , subflows , graphql , api-payload-limits , gcs	0	611	February 18, 2022
How to build a conditional flow-of-flows, i.e. trigger a different child flow depending on the upstream flow's state? Workflow Orchestration prefect-1-0 , flow-of-flows , states , reference-tasks , conditional-logic , state-dependencies , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , triggers	0	991	February 7, 2022
How can I navigate to the child flow run from a parent flow? UI prefect-1-0 , flow-of-flows , orchestrator-pattern , subflows	0	355	February 4, 2022

Flows and Subflows Tags, can it be propagated accross the execution?

Deployments & DevOps

subflows

0

10

March 30, 2023

How to create a mapped flow run with some parameters unmapped

Workflow Orchestration

prefect-1-0 , create_flow_run , subflows , mapping , unmapped

0

59

February 24, 2023

How can I run multiple subflows (or child flows) in parallel?

Workflow Orchestration

migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , parallel-processing , create_flow_run , orchestrator-pattern , subflows , async , mapping , local-dask-executor

13

2614

January 3, 2023

How to run conditional subflows and take action if a subflow fails or succeeds?

DataflowOps for Prefect 2.0

prefect-2-0 , conditional-logic , state-dependencies , subflows

0

229

December 8, 2022

Subflows and backfilling

Usage Questions

prefect-2-0 , backfill , subflows

3

310

September 21, 2022

Subflow error - PrefectHTTPStatusError - Client error '403 Forbidden'

Usage Questions

prefect-2-0 , storage , subflows

1

218

September 8, 2022

How can I create a subflow?

Workflow Orchestration

migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , getting-started

0

1052

January 27, 2022

How to pass data between subflows?

Workflow Orchestration

prefect-2-0 , subflows , data-dependencies

0

368

April 8, 2022

Migrating to Prefect 2.0: From Flow of Flows to Subflows

Tutorials & Resources

migration-guide , flow-of-flows , subflows

0

1159

August 3, 2022

How to map over flows with various parameter values?

Workflow Orchestration

prefect-1-0 , parameters , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , mapping

1

1144

July 25, 2022

Persist context of LOOP tasks for flow restarts

Usage Questions

prefect-1-0 , subflows , looping , persistent-service

8

424

July 4, 2022

Are there any guidelines when to use flow vs task decorator? Which part of my workflow should be defined at a task, subflow vs. flow-level?

Workflow Orchestration

migration-guide , prefect-2-0 , dag-flow-structure , subflows , getting-started , task-decorator , best-practices , flow-decorator

0

504

March 17, 2022

Best way to create a DAG with tasks that should occur repeatedly at different time intervals

Usage Questions

prefect-1-0 , prefect-2-0 , flow-of-flows , scheduling , subflows

9

411

June 17, 2022

How can I create a subflow and block until it’s completed?

Workflow Orchestration

migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , to-review , start_flow_run

0

1207

January 28, 2022

How to handle custom resource (CPU vs. GPU) and code dependencies across various tasks and flows?

Workflow Orchestration

prefect-1-0 , prefect-2-0 , flow-of-flows , kubernetes , aws , orchestrator-pattern , subflows , infrastructure , cpu_request , kubernetes-agent , aws-eks , radar-view , gpu-intensive-workflows , cpu-memory-resource-allocation

2

1261

March 15, 2022

How to customize how the name of a task triggering a child flow run is displayed in the parent DAG? (i.e. how to override the default task name create_flow_run)

Workflow Orchestration

prefect-1-0 , dag-flow-structure , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , flow_run_name , task-decorator

0

602

March 11, 2022

Can my subflow use a different task runner than my parent flow?

Workflow Orchestration

migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , executor , task-runner , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run

0

393

January 31, 2022

How to build a parametrized flow of flows using GCS storage and Docker agent?

Deployments & DevOps

prefect-1-0 , parameters , flow-of-flows , gcp , docker , orchestrator-pattern , subflows , data-dependencies , local-agent , docker-agent , docker-run

0

295

February 26, 2022

How to pass data from a child flow to another task in a parent flow?

Workflow Orchestration

prefect-1-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , data-dependencies , get_task_run_result

0

711

January 31, 2022

How to fix the error: "ValueError: Could not infer an active Flow context while creating edge to <Task: create_flow_run>"

Workflow Orchestration

prefect-1-0 , flow-of-flows , gcp , secrets , orchestrator-pattern , subflows , graphql , api-payload-limits , gcs

0

611

February 18, 2022

How to build a conditional flow-of-flows, i.e. trigger a different child flow depending on the upstream flow's state?

Workflow Orchestration

prefect-1-0 , flow-of-flows , states , reference-tasks , conditional-logic , state-dependencies , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , triggers

0

991

February 7, 2022

How can I navigate to the child flow run from a parent flow?

UI

prefect-1-0 , flow-of-flows , orchestrator-pattern , subflows

0

355

February 4, 2022

subflows

Don't Panic

Read our Privacy Policy