Topics tagged mapping

Topic	Replies	Views	Activity
How to create a mapped flow run with some parameters unmapped Workflow Orchestration prefect-1-0 , create_flow_run , subflows , mapping , unmapped	0	49	February 24, 2023
How can I run multiple subflows (or child flows) in parallel? Workflow Orchestration migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , parallel-processing , create_flow_run , orchestrator-pattern , subflows , async , mapping , local-dask-executor	13	2417	January 3, 2023
How can I map over a list of inputs? Workflow Orchestration migration-guide , prefect-1-0 , prefect-2-0 , dask , parallel-processing , dask-task-runner , mapping , local-dask-executor , getting-started , to-review	13	885	November 30, 2022
Task.map interaction with optional arguments Usage Questions prefect-2-0 , mapping , unmapped	6	238	August 11, 2022
How to map over flows with various parameter values? Workflow Orchestration prefect-1-0 , parameters , flow-of-flows , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run , mapping	1	1096	July 25, 2022
Can I return a tuple from a mapped task? FAQ prefect-1-0 , mapping , tuple	0	333	May 20, 2022
How to use Dask without mapping in Prefect 1.0: using Dask worker_client to call client.submit() inside a Prefect task Distributed Computing prefect-1-0 , resource-manager , dask , parallel-processing , checkpointing , mapping , resource-clean-up , dask-dataframes	13	517	May 12, 2022
How to ensure that my flow run is considered failed when any of mapped tasks failed? Workflow Orchestration prefect-1-0 , reference-tasks , state-dependencies , mapping , unmapped	0	446	April 20, 2022
How to set upstream task dependencies between a ShellTask and downstream mapped tasks? Workflow Orchestration prefect-1-0 , state-dependencies , mapping , upstream_tasks , unmapped	0	225	April 20, 2022
Why are my mapped tasks running out of expected order when using multiple levels of mapped tasks? Distributed Computing prefect-1-0 , state-dependencies , mapping , local-dask-executor , upstream_tasks , unmapped	0	190	April 12, 2022
How to resume mapped task runs from failure at scale, or limit the amount of allowed runs that may fail? Workflow Orchestration prefect-1-0 , executor , retries , concurrency-limits , mapping , failure , restarts	0	268	April 7, 2022
How to set a list as parameter values in DeploymentSpec so that it can be used for parallel workflows? Workflow Orchestration prefect-2-0 , mapping , rename-flow-run , with_options	14	684	March 26, 2022
Tips for Debugging apply_map Workflow Orchestration prefect-1-0 , dask , parallel-processing , conditional-logic , control-flow , mapping , dask-executor , apply_map	0	199	March 10, 2022
We want to create a mapped task that retries N times and then proceeds to the downstream task if "any_successful" - Is it possible? Workflow Orchestration prefect-1-0 , parallel-processing , state-dependencies , mapping , local-dask-executor , slack-notifications , notifications , failure	0	467	March 6, 2022
What is best way pass a list of files to a mapped task and save outputs to targets based on the filename? Workflow Orchestration prefect-1-0 , results , checkpointing , mapping , data-dependencies , targets , task-decorator , templating	3	263	March 3, 2022
Scale your Prefect + Dask Workflows to the Cloud - by Richard Pelgrim Distributed Computing prefect-1-0 , resource-manager , blog-post , dask , executor , parallel-processing , user-contribution , mapping , coiled , dask-executor	0	268	February 25, 2022
How to sequentially loop several cleanup tasks over a set of files to process for ETL Workflow Orchestration prefect-1-0 , dag-flow-structure , local-development , elt , mapping , looping , sequential-processing , etl	2	371	February 24, 2022
Why am I getting this error and how to fix it? - "KeyError('The secret <SECRET NAME> was not found. Please ensure that it was set correctly in your tenant" FAQ prefect-1-0 , secrets , mapping	0	433	February 20, 2022
How to use targets with mapped tasks? FAQ prefect-1-0 , results , mapping , targets	0	253	February 20, 2022
Can Prefect run multiple (distinct) mapped tasks at a time? Distributed Computing prefect-1-0 , dask , parallel-processing , mapping , local-dask-executor	0	650	February 20, 2022
How to build conditional logic within mapped tasks? Workflow Orchestration prefect-1-0 , dag-flow-structure , parallel-processing , conditional-logic , control-flow , mapping , apply_map	0	491	February 16, 2022
Introducing Prefect-ML: Orchestrate a Distributed Hyperparameter Grid Search on Dask - by Kevin Kho Tutorials & Resources prefect-1-0 , dask , parallel-processing , mapping , dask-executor , data-science-workflows , artifacts-api	0	271	February 16, 2022
Can I run acyclic workflows in Prefect (i.e. flows with cycles and loops)? Workflow Orchestration prefect-1-0 , dag-flow-structure , mapping , dynamicism , looping , dag	0	297	February 4, 2022

How to create a mapped flow run with some parameters unmapped

Workflow Orchestration

0

49

February 24, 2023

How can I run multiple subflows (or child flows) in parallel?

Workflow Orchestration

migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , parallel-processing , create_flow_run , orchestrator-pattern , subflows , async , mapping , local-dask-executor

13

2417

January 3, 2023

How can I map over a list of inputs?

Workflow Orchestration

migration-guide , prefect-1-0 , prefect-2-0 , dask , parallel-processing , dask-task-runner , mapping , local-dask-executor , getting-started , to-review