Workflow Orchestration


Topic Replies Views Activity
How can I create a subflow and block until it’s completed?
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  flow-of-flows ,  create_flow_run ,  orchestrator-pattern ,  subflows ,  wait_for_flow_run ,  to-review ,  start_flow_run
0 221 January 28, 2022
How can we pause a task until a specified time and how to resume the same task before the timeout with some external triggers
task-library
4 63 April 14, 2022
How can I cancel several Submitted flow runs at once?
prefect-1-0 ,  graphql ,  cancellation ,  submitted-state
0 51 April 13, 2022
How to query for the latest flow run triggered with specific parameter values using a GraphQL API and a Python client?
prefect-1-0 ,  parameters ,  graphql
1 44 April 11, 2022
How to ensure that a flow with last task being Skipped will be considered Failed if some other important tasks fail?
prefect-1-0 ,  reference-tasks ,  state-dependencies
0 55 February 16, 2022
How can I define state dependencies between tasks?
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  dag-flow-structure ,  state-dependencies ,  getting-started ,  task-decorator ,  wait_for ,  upstream_tasks ,  basics
1 140 April 11, 2022
How can I parallelize execution across 8 CPU cores?
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  dask ,  executor ,  task-runner ,  parallel-processing ,  dask-task-runner ,  local-dask-executor ,  infrastructure ,  multithreading ,  multiprocessing
0 128 January 31, 2022
How to pass data between subflows?
prefect-2-0 ,  subflows ,  data-dependencies
0 77 April 8, 2022
How to properly manage external code dependencies in a Prefect 1.0 flow?
prefect-1-0 ,  local-development ,  code-dependencies ,  environments ,  repository-structure
5 272 April 8, 2022
How to resume mapped task runs from failure at scale, or limit the amount of allowed runs that may fail?
prefect-1-0 ,  executor ,  retries ,  concurrency-limits ,  mapping ,  failure ,  restarts
0 49 April 7, 2022
What are various ways to introduce a delay between flow and task runs?
prefect-2-0 ,  deployment ,  orion-client
0 52 April 6, 2022
How to get all deployments programmatically by using Orion client?
prefect-2-0 ,  deployment ,  orion-client
0 45 April 6, 2022
Why there is no Automation to send alerts when a flow run is stuck in a Submitted state for a given time?
prefect-1-0 ,  automations ,  stuck ,  submitted-state ,  lazarus
1 43 April 6, 2022
How can I dynamically set a flow owner and use it in a state handler to send a Slack alert on failure to that flow owner?
organizational ,  prefect-1-0 ,  parameters ,  state_handlers ,  failure-notification ,  flow-owner
0 43 April 6, 2022
I can't use secrets using GraphQL on Prefect Server - it throws an error GRAPHQL_VALIDATION_FAILED - why?
prefect-1-0 ,  server ,  secrets ,  graphql
0 48 April 6, 2022
How to use targets to cache task run results based on a presence of a specific file (i.e. how to use Makefile or Luigi type file-based caching)?
prefect-1-0 ,  caching ,  results ,  targets
7 211 April 5, 2022
Is there a Python API to get the flow version given a flow name?
prefect-1-0 ,  versioning ,  version_group_id
0 43 April 5, 2022
One Flow with Multiple Parameter Sets and Schedules
prefect-1-0 ,  storage ,  parameters ,  scheduling
0 107 April 5, 2022
Flow run states working different in a local run than in a backend run - can't use state results in a state-handlers the same way
prefect-1-0 ,  state_handlers ,  states ,  slack-notifications ,  failure ,  failure-notification ,  flow-run-view
1 51 April 5, 2022
Do Cloud Hooks work on a flow level or on a task level?
prefect-1-0 ,  cloud-hooks
0 40 April 5, 2022
How to schedule and orchestrate a flow-of-flows for a data warehousing (ETL) use case?
prefect-1-0 ,  flow-of-flows ,  scheduling ,  create_flow_run ,  orchestrator-pattern ,  wait_for_flow_run
0 183 April 5, 2022
Do I need multiple agent processes in order to set different concurrency limits for deployments with different tags?
prefect-2-0 ,  agent ,  concurrency-limits ,  work-queue
0 48 March 30, 2022
How to use work queues and agents in Prefect 2.0? I'm switching from Prefect 1.0 and wonder how agents differ between 1.0 and 2.0
migration-guide ,  prefect-2-0 ,  agent ,  work-queue ,  work-queue-agent-relationship
0 81 April 5, 2022
How do I restart a child flow run in a flow-of-flows?
prefect-1-0 ,  flow-of-flows ,  create_flow_run ,  wait_for_flow_run ,  idempotency-key ,  restarts
0 139 March 31, 2022
How to override default parameter values when creating a flow run from deployment?
prefect-2-0 ,  deployment ,  parameters ,  create_flow_run
3 53 March 30, 2022
Concurrency limits in Prefect 2.0 on a task-level vs. on a flow-level
prefect-2-0 ,  concurrency-limits ,  task-level ,  flow-level
0 54 March 30, 2022
How can I disable flow heartbeats?
prefect-1-0 ,  flow-heartbeat
0 44 March 28, 2022
How can I set task-level timeouts in Prefect 2?
prefect-2-0 ,  timeout ,  prefect-future ,  wait
0 60 March 28, 2022
How to set a list as parameter values in DeploymentSpec so that it can be used for parallel workflows?
prefect-2-0 ,  mapping ,  rename-flow-run ,  with_options
14 197 March 26, 2022
How to accomplish a never-ending flow or skip a new scheduled run if the previous flow run hasn't finished yet?
prefect-1-0 ,  state_handlers ,  scheduling
0 178 February 20, 2022