Prefect 2.0 example repository with many examples a.o. using Dask, Ray, subflows, parametrization and various packagers - by Oliver Mannion

View in #show-us-what-you-got on Slack

Oliver_Mannion @Oliver_Mannion: Some Prefect Orion examples running self-contained in a local kubernetes cluster.

Flows
• Dask flow using a dask local cluster
• Dask kubes flow using an ephemeral dask cluster on Kubernetes
• Parameterized flow using a custom Docker image containing additional modules
• Ray flow that runs on an existing ray cluster
• Sub flow that is trigger by a parent flow

Deployments to Kubernetes using
• the default OrionPackager to store the flow source in Orion
• the default OrionPackager to store the flow import path in Orion
• the FilePackager to store the flow source in S3 (minio)
Batteries (mostly) included. :battery:

Anna_Geller @Anna_Geller: I love those examples, thank you for sharing @Oliver_Mannion - I’ll cross-post on Discourse

2 Likes