Topics tagged mapping

Topic	Replies	Views	Activity
How can I run multiple subflows (or child flows) in parallel? Help migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , parallel-processing , create_flow_run , orchestrator-pattern , subflows , async , mapping , local-dask-executor , marvin	21	7121	November 13, 2023
Failure in mapped task prevents final cleanup Help prefect-2-0 , mapping , failure	0	202	July 17, 2023
Wait for Mapped Tasjs Help prefect-2-0 , dask , mapping , troubleshooting	0	199	June 29, 2023
Task name for map Help prefect-1-0 , mapping	0	221	April 27, 2023
How to create a mapped flow run with some parameters unmapped Archive prefect-1-0 , create_flow_run , subflows , mapping , unmapped	0	260	February 24, 2023
How can I map over a list of inputs? Archive migration-guide , prefect-1-0 , prefect-2-0 , dask , parallel-processing , dask-task-runner , mapping , local-dask-executor , getting-started , to-review	13	3632	November 30, 2022
Task.map interaction with optional arguments Archive prefect-2-0 , mapping , unmapped	6	818	August 11, 2022
How to map over flows with various parameter values? Archive prefect-1-0 , parameters , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , mapping	1	2043	July 25, 2022
Can I return a tuple from a mapped task? Archive prefect-1-0 , mapping , tuple	0	809	May 20, 2022
How to use Dask without mapping in Prefect 1.0: using Dask worker_client to call client.submit() inside a Prefect task Archive prefect-1-0 , resource-manager , dask , parallel-processing , checkpointing , mapping , resource-clean-up , dask-dataframes	13	1094	May 12, 2022
How to ensure that my flow run is considered failed when any of mapped tasks failed? Archive prefect-1-0 , reference-tasks , state-dependencies , mapping , unmapped	0	954	April 20, 2022
How to set upstream task dependencies between a ShellTask and downstream mapped tasks? Archive prefect-1-0 , state-dependencies , mapping , upstream_tasks , unmapped	0	684	April 20, 2022
Why are my mapped tasks running out of expected order when using multiple levels of mapped tasks? Archive prefect-1-0 , state-dependencies , mapping , local-dask-executor , upstream_tasks , unmapped	0	431	April 12, 2022
How to resume mapped task runs from failure at scale, or limit the amount of allowed runs that may fail? Archive prefect-1-0 , executor , retries , concurrency-limits , mapping , failure , restarts	0	531	April 7, 2022
How to set a list as parameter values in DeploymentSpec so that it can be used for parallel workflows? Archive prefect-2-0 , mapping , rename-flow-run , with_options	14	1522	March 26, 2022
Tips for Debugging apply_map Archive prefect-1-0 , dask , parallel-processing , conditional-logic , control-flow , mapping , dask-executor , apply_map	0	412	March 10, 2022
We want to create a mapped task that retries N times and then proceeds to the downstream task if "any_successful" - Is it possible? Archive prefect-1-0 , parallel-processing , state-dependencies , mapping , local-dask-executor , slack-notifications , notifications , failure	0	737	March 6, 2022
What is best way pass a list of files to a mapped task and save outputs to targets based on the filename? Archive prefect-1-0 , results , checkpointing , mapping , data-dependencies , targets , task-decorator , templating	3	507	March 3, 2022
Scale your Prefect + Dask Workflows to the Cloud - by Richard Pelgrim Archive prefect-1-0 , resource-manager , blog-post , dask , executor , parallel-processing , user-contribution , mapping , coiled , dask-executor	0	443	February 25, 2022
How to sequentially loop several cleanup tasks over a set of files to process for ETL Archive prefect-1-0 , dag-flow-structure , local-development , elt , mapping , looping , sequential-processing , etl	2	968	February 24, 2022
Why am I getting this error and how to fix it? - "KeyError('The secret <SECRET NAME> was not found. Please ensure that it was set correctly in your tenant" Archive prefect-1-0 , secrets , mapping	0	846	February 20, 2022
How to use targets with mapped tasks? Archive prefect-1-0 , results , mapping , targets	0	476	February 20, 2022
Can Prefect run multiple (distinct) mapped tasks at a time? Archive prefect-1-0 , dask , parallel-processing , mapping , local-dask-executor	0	1320	February 20, 2022
How to build conditional logic within mapped tasks? Archive prefect-1-0 , dag-flow-structure , parallel-processing , conditional-logic , control-flow , mapping , apply_map	0	869	February 16, 2022
Can I run acyclic workflows in Prefect (i.e. flows with cycles and loops)? Archive prefect-1-0 , dag-flow-structure , mapping , dynamicism , looping , dag	0	489	February 4, 2022

How can I run multiple subflows (or child flows) in parallel?

migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , parallel-processing , create_flow_run , orchestrator-pattern , subflows , async , mapping , local-dask-executor , marvin

21

7121

November 13, 2023

Failure in mapped task prevents final cleanup

Help

prefect-2-0 , mapping , failure

0

202

July 17, 2023

Wait for Mapped Tasjs

Help

prefect-2-0 , dask , mapping , troubleshooting

0

199

June 29, 2023

Task name for map

Help

prefect-1-0 , mapping

0

221

April 27, 2023

How to create a mapped flow run with some parameters unmapped

Archive

prefect-1-0 , create_flow_run , subflows , mapping , unmapped

0

260

February 24, 2023

How can I map over a list of inputs?

Archive

migration-guide , prefect-1-0 , prefect-2-0 , dask , parallel-processing , dask-task-runner , mapping , local-dask-executor , getting-started , to-review