work-queue

Topic Replies Views Activity
Prefect Deployments FAQ (PDF)
DataflowOps for Prefect 2.0
prefect-2-0 ,  deployment ,  agent ,  work-queue

How can I get started with deployments? Discourse - getting started recipes incl. AWS, GCP and Azure specific setup How to deploy all flows from a project at once? (both locally and from CI/CD) This Discourse topi…

1 1051 September 22, 2022
Does a work queue provide a mechanism to spread the load across tasks?
DataflowOps for Prefect 2.0
prefect-2-0 ,  work-queue ,  scaling-up-and-out
0 71 September 17, 2022
Agents and work queues FAQ
DataflowOps for Prefect 2.0
prefect-2-0 ,  agent ,  work-queue ,  faq
4 334 September 8, 2022
What is the relationship between an agent, work queue and a deployment?
DataflowOps for Prefect 2.0
prefect-2-0 ,  deployment ,  agent ,  work-queue
0 219 August 22, 2022
What happens when agent picks up a deployed flow run from a work queue?
DataflowOps for Prefect 2.0
prefect-2-0 ,  deployment ,  agent ,  work-queue
0 120 August 22, 2022
How to deploy a Prefect 2.0 agent to an EC2 instance as your execution layer?
Tutorials & Resources
prefect-2-0 ,  storage ,  aws ,  s3 ,  agent ,  getting-started ,  aws-ec2 ,  ubuntu ,  work-queue ,  linux ,  execution-layer-deployment-tutorial
0 1435 April 8, 2022
New Orion release 2.0a13 featuring work queues, agents, profiles, remote object storage and distributed parallel processing with Ray!
Announcements
prefect-2-0 ,  release-notes ,  storage ,  aws ,  s3 ,  gcp ,  task-runner ,  parallel-processing ,  agent ,  azure ,  concurrency-limits ,  kubernetes-flow-runner ,  filters ,  gcs ,  docker-flow-runner ,  profiles-prefect-config ,  work-queue ,  ray ,  ray-task-runner ,  azure-blob-storage
7 520 July 29, 2022
What's the role of agents and work queues, and how the concept of agents differ between Prefect 1.0 and 2.0?
Workflow Orchestration
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  agent ,  work-queue ,  work-queue-agent-relationship
0 500 April 5, 2022
Do I need multiple agent processes in order to set different concurrency limits for deployments with different tags?
Workflow Orchestration
prefect-2-0 ,  agent ,  concurrency-limits ,  work-queue
0 158 March 30, 2022