Workflow Orchestration


Topic Replies Views Activity
What are best practices to build unit tests and integration tests for Prefect flows and for data pipelines in general?
prefect-1-0 ,  prefect-2-0 ,  best-practices ,  data-quality ,  data-validation ,  unit-testing
0 418 May 10, 2022
How can I test flows and tasks in Prefect 2.0?
prefect-2-0 ,  unit-testing
2 151 May 5, 2022
Why results need to be configured in order to use retries?
prefect-1-0 ,  retries ,  results
0 119 May 3, 2022
How to rerun all flows in a project?
prefect-1-0 ,  projects ,  create_flow_run ,  graphql
0 81 May 3, 2022
How to print the next 10 scheduled dates to validate my schedule is set up correctly?
prefect-2-0 ,  local-development ,  scheduling ,  async ,  cron ,  unit-testing ,  rrule
0 114 April 29, 2022
How to create a flow run from deployment (orchestrator pattern)?
prefect-2-0 ,  deployment ,  flow-of-flows ,  create_flow_run ,  orchestrator-pattern ,  create_flow_run_from_deployment
8 612 April 27, 2022
How can I trigger data quality checks as soon as my data arrives in a data lake?
prefect-1-0 ,  prefect-2-0 ,  event-driven ,  data-quality ,  data-validation
0 233 April 26, 2022
How to get finished futures as soon as they complete in a non-blocking way?
prefect-2-0 ,  async
1 133 April 24, 2022
I have a flow run that got stuck in a Running state. How can I cancel it from the Orion client?
prefect-2-0 ,  states ,  cancellation ,  final-state
0 101 April 23, 2022
What is the setting PREFECT_ORION_DATABASE_CONNECTION_TIMEOUT used for and can this setting be used to mitigate my timeout errors?
prefect-2-0 ,  timeout
6 115 April 22, 2022
How to ensure that my flow run is considered failed when any of mapped tasks failed?
prefect-1-0 ,  reference-tasks ,  state-dependencies ,  mapping ,  unmapped
0 79 April 20, 2022
How to deserialize flow run results generated by default S3 storage?
prefect-2-0 ,  storage ,  aws ,  s3 ,  pickle ,  results ,  s3-storage
0 101 April 20, 2022
How to set upstream task dependencies between a ShellTask and downstream mapped tasks?
prefect-1-0 ,  state-dependencies ,  mapping ,  upstream_tasks ,  unmapped
0 97 April 20, 2022
How can I create a subflow and block until it’s completed?
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  flow-of-flows ,  create_flow_run ,  orchestrator-pattern ,  subflows ,  wait_for_flow_run ,  to-review ,  start_flow_run
0 507 January 28, 2022
How can we pause a task until a specified time and how to resume the same task before the timeout with some external triggers
task-library
4 130 April 14, 2022
How can I cancel several Submitted flow runs at once?
prefect-1-0 ,  graphql ,  cancellation ,  submitted-state
0 124 April 13, 2022
How to query for the latest flow run triggered with specific parameter values using a GraphQL API and a Python client?
prefect-1-0 ,  parameters ,  graphql
1 93 April 11, 2022
How to ensure that a flow with last task being Skipped will be considered Failed if some other important tasks fail?
prefect-1-0 ,  reference-tasks ,  state-dependencies
0 96 February 16, 2022
How can I define state dependencies between tasks?
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  dag-flow-structure ,  state-dependencies ,  getting-started ,  task-decorator ,  wait_for ,  upstream_tasks ,  basics
1 418 April 11, 2022
How to properly manage external code dependencies in a Prefect 1.0 flow?
prefect-1-0 ,  local-development ,  code-dependencies ,  environments ,  repository-structure
5 612 April 8, 2022
How to resume mapped task runs from failure at scale, or limit the amount of allowed runs that may fail?
prefect-1-0 ,  executor ,  retries ,  concurrency-limits ,  mapping ,  failure ,  restarts
0 110 April 7, 2022
What are various ways to introduce a delay between flow and task runs?
prefect-2-0 ,  deployment ,  orion-client
0 100 April 6, 2022
How to get all deployments programmatically by using Orion client?
prefect-2-0 ,  deployment ,  orion-client
0 80 April 6, 2022
Why there is no Automation to send alerts when a flow run is stuck in a Submitted state for a given time?
prefect-1-0 ,  automations ,  stuck ,  submitted-state ,  lazarus
1 92 April 6, 2022
How can I dynamically set a flow owner and use it in a state handler to send a Slack alert on failure to that flow owner?
organizational ,  prefect-1-0 ,  parameters ,  state_handlers ,  failure-notification ,  flow-owner
0 86 April 6, 2022
I can't use secrets using GraphQL on Prefect Server - it throws an error GRAPHQL_VALIDATION_FAILED - why?
prefect-1-0 ,  server ,  secrets ,  graphql
0 95 April 6, 2022
How to use targets to cache task run results based on a presence of a specific file (i.e. how to use Makefile or Luigi type file-based caching)?
prefect-1-0 ,  caching ,  results ,  targets
7 513 April 5, 2022
Is there a Python API to get the flow version given a flow name?
prefect-1-0 ,  versioning ,  version_group_id
0 89 April 5, 2022
One Flow with Multiple Parameter Sets and Schedules
prefect-1-0 ,  storage ,  parameters ,  scheduling
0 163 April 5, 2022
Flow run states working different in a local run than in a backend run - can't use state results in a state-handlers the same way
prefect-1-0 ,  state_handlers ,  states ,  slack-notifications ,  failure ,  failure-notification ,  flow-run-view
1 99 April 5, 2022