Topics tagged subflows

Topic	Replies	Views	Activity
Can prefect run each subflow in different machine? Help prefect-2-0 , deployment , flow-of-flows , task-runner , subflows , infrastructure	0	38	June 25, 2024
Subflow specified work_pool Help prefect-2-0 , task-runner , subflows	1	32	June 25, 2024
Delay in creating subflow Help prefect-2-0 , subflows , troubleshooting	0	74	June 5, 2024
How can I run multiple subflows (or child flows) in parallel? Help migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , parallel-processing , create_flow_run , orchestrator-pattern , subflows , async , mapping , local-dask-executor , marvin	25	10684	April 20, 2024
Architecture Design Problem Best Practice Help docker , scheduling , subflows , run_deployment	0	226	February 22, 2024
Concurrent subflows with conditionnal execution at runtime Help prefect-2-0 , parallel-processing , subflows	0	330	February 9, 2024
Subflows logs do not appear in Parent Flow Help prefect-2-0 , logging , flow-of-flows , subflows	1	466	November 1, 2023
Not possible to share data between subflows Help prefect-2-0 , flow-of-flows , results , subflows	1	410	July 20, 2023
How to handle custom resource (CPU vs. GPU) and code dependencies across various tasks and flows? Archive prefect-1-0 , prefect-2-0 , flow-of-flows , kubernetes , aws , orchestrator-pattern , subflows , infrastructure , cpu_request , kubernetes-agent , aws-eks , radar-view , gpu-intensive-workflows , cpu-memory-resource-allocation	3	3045	July 17, 2023
Sub flow context Help prefect-2-0 , context , subflows	0	328	June 19, 2023
Flows and Subflows Tags, can it be propagated accross the execution? Help subflows	0	276	March 30, 2023
How to create a mapped flow run with some parameters unmapped Archive prefect-1-0 , create_flow_run , subflows , mapping , unmapped	0	522	February 24, 2023
Subflows and backfilling Archive prefect-2-0 , backfill , subflows	3	1206	September 21, 2022
Subflow error - PrefectHTTPStatusError - Client error '403 Forbidden' Archive prefect-2-0 , storage , subflows	1	824	September 8, 2022
How can I create a subflow? Archive migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , getting-started	0	2513	January 27, 2022
How to pass data between subflows? Archive prefect-2-0 , subflows , data-dependencies	0	1005	April 8, 2022
Migrating to Prefect 2.0: From Flow of Flows to Subflows Archive migration-guide , flow-of-flows , subflows	0	4437	August 3, 2022
How to map over flows with various parameter values? Archive prefect-1-0 , parameters , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , mapping	1	2640	July 25, 2022
Persist context of LOOP tasks for flow restarts Archive prefect-1-0 , subflows , looping , persistent-service	8	1465	July 4, 2022
Are there any guidelines when to use flow vs task decorator? Which part of my workflow should be defined at a task, subflow vs. flow-level? Archive migration-guide , prefect-2-0 , dag-flow-structure , subflows , getting-started , task-decorator , best-practices , flow-decorator	0	1758	March 17, 2022
Best way to create a DAG with tasks that should occur repeatedly at different time intervals Archive prefect-1-0 , prefect-2-0 , flow-of-flows , scheduling , subflows	9	1603	June 17, 2022
How can I create a subflow and block until it’s completed? Archive migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , to-review , start_flow_run	0	2608	January 28, 2022
How to customize how the name of a task triggering a child flow run is displayed in the parent DAG? (i.e. how to override the default task name create_flow_run) Archive prefect-1-0 , dag-flow-structure , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , flow_run_name , task-decorator	0	1298	March 11, 2022
Can my subflow use a different task runner than my parent flow? Archive migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , executor , task-runner , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run	0	1036	January 31, 2022
How to build a parametrized flow of flows using GCS storage and Docker agent? Archive prefect-1-0 , parameters , flow-of-flows , gcp , docker , orchestrator-pattern , subflows , data-dependencies , local-agent , docker-agent , docker-run	0	605	February 26, 2022
How to pass data from a child flow to another task in a parent flow? Archive prefect-1-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , data-dependencies , get_task_run_result	0	1773	January 31, 2022
How to fix the error: "ValueError: Could not infer an active Flow context while creating edge to <Task: create_flow_run>" Archive prefect-1-0 , flow-of-flows , gcp , secrets , orchestrator-pattern , subflows , graphql , api-payload-limits , gcs	0	1453	February 18, 2022
How to build a conditional flow-of-flows, i.e. trigger a different child flow depending on the upstream flow's state? Archive prefect-1-0 , flow-of-flows , states , reference-tasks , conditional-logic , state-dependencies , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , triggers	0	1935	February 7, 2022
How can I navigate to the child flow run from a parent flow? Archive prefect-1-0 , flow-of-flows , orchestrator-pattern , subflows	0	671	February 4, 2022

Can prefect run each subflow in different machine?

Help

prefect-2-0 , deployment , flow-of-flows , task-runner , subflows , infrastructure

0

38

June 25, 2024

Subflow specified work_pool

Help

prefect-2-0 , task-runner , subflows

1

32

June 25, 2024

Delay in creating subflow

Help

prefect-2-0 , subflows , troubleshooting

0

74

June 5, 2024

How can I run multiple subflows (or child flows) in parallel?

Help

migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , parallel-processing , create_flow_run , orchestrator-pattern , subflows , async , mapping , local-dask-executor , marvin

25

10684

April 20, 2024

Architecture Design Problem Best Practice

Help

docker , scheduling , subflows , run_deployment

0

226

February 22, 2024

Concurrent subflows with conditionnal execution at runtime

Help

prefect-2-0 , parallel-processing , subflows

0

330

February 9, 2024

Subflows logs do not appear in Parent Flow

Help

prefect-2-0 , logging , flow-of-flows , subflows

1

466

November 1, 2023

Not possible to share data between subflows

Help

prefect-2-0 , flow-of-flows , results , subflows

1

410

July 20, 2023

How to handle custom resource (CPU vs. GPU) and code dependencies across various tasks and flows?

Archive

prefect-1-0 , prefect-2-0 , flow-of-flows , kubernetes , aws , orchestrator-pattern , subflows , infrastructure , cpu_request , kubernetes-agent , aws-eks , radar-view , gpu-intensive-workflows , cpu-memory-resource-allocation

3

3045

July 17, 2023

Sub flow context

Help

prefect-2-0 , context , subflows

0

328

June 19, 2023

Flows and Subflows Tags, can it be propagated accross the execution?

Help

subflows

0

276

March 30, 2023

How to create a mapped flow run with some parameters unmapped

Archive

prefect-1-0 , create_flow_run , subflows , mapping , unmapped

0

522

February 24, 2023

Subflows and backfilling

Archive

prefect-2-0 , backfill , subflows

3

1206

September 21, 2022

Subflow error - PrefectHTTPStatusError - Client error '403 Forbidden'

Archive

prefect-2-0 , storage , subflows

1

824

September 8, 2022

How can I create a subflow?

Archive

migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , getting-started

0

2513

January 27, 2022

How to pass data between subflows?

Archive

prefect-2-0 , subflows , data-dependencies

0

1005

April 8, 2022

Migrating to Prefect 2.0: From Flow of Flows to Subflows

Archive

migration-guide , flow-of-flows , subflows

0

4437

August 3, 2022

How to map over flows with various parameter values?

Archive

prefect-1-0 , parameters , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , mapping

1

2640

July 25, 2022

Persist context of LOOP tasks for flow restarts

Archive

prefect-1-0 , subflows , looping , persistent-service

8

1465

July 4, 2022

Are there any guidelines when to use flow vs task decorator? Which part of my workflow should be defined at a task, subflow vs. flow-level?

Archive

migration-guide , prefect-2-0 , dag-flow-structure , subflows , getting-started , task-decorator , best-practices , flow-decorator

0

1758

March 17, 2022

Best way to create a DAG with tasks that should occur repeatedly at different time intervals

Archive

prefect-1-0 , prefect-2-0 , flow-of-flows , scheduling , subflows

9

1603

June 17, 2022

How can I create a subflow and block until it’s completed?

Archive

migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , to-review , start_flow_run

0

2608

January 28, 2022

How to customize how the name of a task triggering a child flow run is displayed in the parent DAG? (i.e. how to override the default task name create_flow_run)

Archive

prefect-1-0 , dag-flow-structure , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , flow_run_name , task-decorator

0

1298

March 11, 2022

Can my subflow use a different task runner than my parent flow?

Archive

migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , executor , task-runner , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run

0

1036

January 31, 2022

How to build a parametrized flow of flows using GCS storage and Docker agent?

Archive

prefect-1-0 , parameters , flow-of-flows , gcp , docker , orchestrator-pattern , subflows , data-dependencies , local-agent , docker-agent , docker-run

0

605

February 26, 2022

How to pass data from a child flow to another task in a parent flow?

Archive

prefect-1-0 , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , data-dependencies , get_task_run_result

0

1773

January 31, 2022

How to fix the error: "ValueError: Could not infer an active Flow context while creating edge to <Task: create_flow_run>"

Archive

prefect-1-0 , flow-of-flows , gcp , secrets , orchestrator-pattern , subflows , graphql , api-payload-limits , gcs

0

1453

February 18, 2022

How to build a conditional flow-of-flows, i.e. trigger a different child flow depending on the upstream flow's state?

Archive

prefect-1-0 , flow-of-flows , states , reference-tasks , conditional-logic , state-dependencies , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , triggers

0

1935

February 7, 2022

How can I navigate to the child flow run from a parent flow?

Archive

prefect-1-0 , flow-of-flows , orchestrator-pattern , subflows

0

671

February 4, 2022