DataOps Tutorials for Prefect 2.0


Topic Replies Views Activity
Main topic: Flow Deployment Patterns & Recipes for Prefect 2.0
prefect-2-0 ,  deployment ,  ci-cd ,  event-driven ,  infrastructure ,  real-time-streaming ,  infrastructure-as-code ,  execution-layer-deployment-tutorial ,  list-of-resources ,  tbd

This list of resources will point you to any topic of your interest regarding how to build a reliable flow deployment process suitable to your use cases, your data stack, and your team. 1. Getting started - learn conc…

1 110 June 17, 2022
About the DataOps Tutorials for Prefect 2.0 category
todo
0 20 April 8, 2022
How to build real-time streaming workflows using Prefect 2.0 and AWS ECS
prefect-2-0 ,  aws ,  ecs ,  real-time-streaming ,  serverless ,  todo
0 21 June 19, 2022
How to list all deployments that have a specific tag using Python Orion client?
prefect-2-0 ,  deployment ,  orion-client
0 6 July 2, 2022
How to create a Kubernetes cluster on AWS EKS?
kubernetes ,  aws ,  aws-eks ,  execution-layer-deployment-tutorial ,  eksctl ,  todo
0 21 June 15, 2022
How to define dependencies between tasks and flows?
dag-flow-structure ,  state-dependencies ,  data-dependencies
0 7 June 29, 2022
Managing environments with Prefect 2.0 (dev, staging, prod)
prefect-2-0 ,  environments ,  todo
0 35 June 17, 2022
How to deploy a Prefect 2.0 agent as your flow execution layer - list of resources for various execution environments
prefect-2-0 ,  agent-setup ,  execution-layer-deployment-tutorial ,  todo
0 26 June 15, 2022
CI/CD for Prefect 2.0
prefect-2-0 ,  deployment ,  ci-cd ,  docker ,  infrastructure ,  environments ,  list-of-resources ,  todo
0 54 May 14, 2022
Event-driven workflows in Prefect 2.0 (serverless workflows triggered based on some action, rather than based on schedule)
prefect-2-0 ,  event-driven ,  aws-lambda ,  todo
0 34 June 15, 2022
How to build a Prefect 2.0 PoC on AWS
prefect-2-0 ,  aws ,  s3 ,  aws-eks ,  aws-ec2 ,  todo ,  poc
0 49 June 17, 2022
How to build a Prefect 2.0 PoC on GCP
prefect-2-0 ,  gcp ,  gke ,  gcs ,  todo ,  poc
0 47 June 17, 2022
Azure: How to deploy a Prefect 2.0 agent to an AKS Kubernetes cluster on Azure and connect it to Cloud 2.0 backend?
prefect-2-0 ,  azure ,  kubernetes-agent ,  aks ,  execution-layer-deployment-tutorial ,  todo
0 11 June 15, 2022
How to build a Prefect 2.0 PoC on a single server or VM instance
prefect-2-0 ,  vm ,  execution-layer-deployment-tutorial ,  todo ,  poc
0 13 June 17, 2022
Flow Runner vs. Task Runner - what are the differences? when to use which one and how?
prefect-2-0 ,  flow-runner ,  task-runner ,  todo
0 18 June 19, 2022
How to decide when to use the default ConcurrentTaskRunner vs. SequentialTaskRunner vs. DaskTaskRunner vs. RayTaskRunner? What are performance benchmarks for given use cases?
task-runner ,  dask-task-runner ,  async ,  ray-task-runner ,  todo ,  concurrent-task-runner
0 13 June 19, 2022
How to scale out Prefect 2.0 flows with Dask on AWS ECS Fargate using FargateCluster from dask_cloudprovider
prefect-2-0 ,  dask ,  parallel-processing ,  dask-task-runner ,  dask-cloud-provider ,  todo
0 13 June 19, 2022
How to scale out Prefect 2.0 flows with Dask on Kubernetes using KubeCluster
prefect-2-0 ,  dask ,  parallel-processing ,  dask-task-runner ,  kube-cluster ,  todo
0 10 June 19, 2022
How to scale out Prefect 2.0 flows with Dask on Coiled
prefect-2-0 ,  dask ,  parallel-processing ,  dask-task-runner ,  coiled ,  todo
0 13 June 19, 2022
How to customize Kubernetes jobs with KubernetesFlowRunner's customizations?
prefect-2-0 ,  kubernetes ,  kubernetes-flow-runner ,  kubernetes-job-template ,  customizations
0 14 June 30, 2022
How to build a Prefect 2.0 PoC on Azure
prefect-2-0 ,  azure ,  vm ,  aks ,  todo ,  poc
1 30 June 27, 2022
Getting-started repository templates for Prefect 2.0
prefect-2-0 ,  getting-started ,  best-practices ,  repository-structure ,  todo
0 30 June 21, 2022
How to manage credentials in Prefect 2.0 - blocks, secrets managers, Kubernetes secrets, environment variables - incl. pros and cons of each
prefect-2-0 ,  secrets ,  environment-variable ,  aws-secrets-manager ,  blocks ,  todo ,  kubernetes-secrets
0 20 June 19, 2022
How to deploy a Prefect 2.0 agent to Azure VM as your execution layer?
prefect-2-0 ,  azure ,  vm ,  agent-setup ,  execution-layer-deployment-tutorial ,  todo
0 14 June 19, 2022
How to deploy a Prefect 2.0 agent to a single VM as your execution layer?
prefect-2-0 ,  agent-setup ,  execution-layer-deployment-tutorial ,  todo
0 15 June 15, 2022
How to deploy a Prefect 2.0 agent to a VM on GCP Google Compute Engine as your execution layer?
prefect-2-0 ,  gcp ,  agent-setup ,  execution-layer-deployment-tutorial ,  todo ,  google-compute-engine
0 17 June 19, 2022
How to ensure your agent gets restarted after VM gets shut down and rebooted?
prefect-2-0 ,  agent-setup ,  execution-layer-deployment-tutorial ,  todo
0 16 June 19, 2022
How to deploy a Prefect 2.0 agent to a Kubernetes execution layer?
prefect-2-0 ,  execution-layer-deployment-tutorial ,  todo
0 26 June 15, 2022
Prerequisites: Before you begin, install Prefect and authenticate with Cloud 2.0
prefect-2-0 ,  getting-started ,  execution-layer-deployment-tutorial ,  todo
0 21 June 15, 2022
Running unit tests as part of a CI/CD pipeline
prefect-2-0 ,  ci-cd ,  unit-testing ,  todo
0 16 June 19, 2022