CI/CD for Prefect 2.0

Archive
, , , , , , ,
1

Here are some repository templates and resources to help you build a CI/CD pipeline for your flow deployments.

Prefect 2.0 and Cloud 2.0 recipes :cloud:

Repository templates

Repositories with code examples

Self-hosted Prefect 2.0 recipes :gear:

Creating a CI/CD pipeline for a self-hosted Orion instance is difficult since you would likely want to deploy this to private infrastructure, preventing using tools such as GitHub Actions.

You may explore:

  • custom GitHub Actions runners deployed to the same private infrastructure as your Prefect 2.0 orchestration layer and your execution layer
  • custom Gitlab or other Git server and corresponding pipelines

For the OSS Prefect 2.0 recipes, we’d love to see community contributions. If you have something worth sharing, we encourage you to create a Discourse topic or simply reply to this topic and share your approach. We don’t require your solution to be perfect or follow best practices (although this would be great) - feel free to share your approach as is - no judgement here, we are all learning along the way.

Thanks to everyone helping to build out this knowledge base about DataflowOps using Prefect.

3 Likes