Topics tagged infrastructure

Topic	Replies	Views	Activity
Main topic: Flow Deployment Patterns & Getting Started Recipes Archive prefect-2-0 , deployment , ci-cd , event-driven , infrastructure , real-time-streaming , infrastructure-as-code , execution-layer-deployment-tutorial , list-of-resources , tbd This list of resources will point you to any topic of your interest regarding how to build a reliable flow deployment process suitable to your use cases, your data stack, and your team. 1. Getting started: install Pr…	3	3207	September 22, 2022
Running Prefect Agents/Workers on different machines Help prefect-2-0 , agent , infrastructure	2	36	April 24, 2024
Find agent that was unable to submit to infrastructure Help prefect-2-0 , agent , infrastructure	0	62	March 7, 2024
Error when starting deployment on ACI Help azure , failure , infrastructure	3	166	February 13, 2024
Azure ACI serverless push pools not working per guide Help prefect-2-0 , azure , infrastructure , troubleshooting	0	134	December 27, 2023
What is a recommended strategy for setting memory limits on a task? Help prefect-2-0 , parallel-processing , infrastructure	0	252	December 4, 2023
Horizontal scaling on Kubernetes & handling Workers termination Help prefect-2-0 , kubernetes , infrastructure , worker	0	273	November 2, 2023
Cannot create ACI with prefect push workpool Help azure , infrastructure , aci	2	249	October 20, 2023
How can I free up Postgres database space? Archive prefect-1-0 , prefect-2-0 , backend , server , infrastructure , resource-clean-up , postgres	1	1670	September 15, 2023
Using a message broker to trigger flow runs Show and Tell prefect-2-0 , infrastructure , integrations	0	424	August 28, 2023
Deployment to run a flow in a container Help prefect-2-0 , deployment , docker , infrastructure	0	225	August 28, 2023
Deployments with extra requirements Help prefect-2-0 , local-development , deployment , kubernetes , docker , agent , server , infrastructure , getting-started	0	246	August 8, 2023
How to handle custom resource (CPU vs. GPU) and code dependencies across various tasks and flows? Archive prefect-1-0 , prefect-2-0 , flow-of-flows , kubernetes , aws , orchestrator-pattern , subflows , infrastructure , cpu_request , kubernetes-agent , aws-eks , radar-view , gpu-intensive-workflows , cpu-memory-resource-allocation	3	2739	July 17, 2023
Creating and Deploying a custom Kubernetes Infrastructure Block Archive deployment , kubernetes , infrastructure , infrastructure-blocks	1	1534	June 22, 2023
Change the infrastructure document does not affect on AWS Help prefect-2-0 , deployment , aws , infrastructure	2	317	June 13, 2023
Tricks for reclaiming memory in Prefect flows and preventing Out-Of-Memory errors (OOM) Archive prefect-1-0 , prefect-2-0 , infrastructure , memory_request , resource-clean-up , oom-error	3	2140	June 9, 2023
CI/CD for Prefect 2.0 Archive prefect-2-0 , deployment , ci-cd , docker , infrastructure , environments , list-of-resources , todo	0	3355	May 14, 2022
Can Prefect run each task in a different Docker container? Archive prefect-1-0 , flow-of-flows , docker , create_flow_run , orchestrator-pattern , wait_for_flow_run , infrastructure , code-dependencies , docker-run , docker-image , base-image	4	2882	February 22, 2023
Deployment fails trying to get namespace Help prefect-2-0 , deployment , kubernetes , infrastructure , troubleshooting	11	2547	February 14, 2023
Unable to add ENV variables to infrastructure block Help prefect-2-0 , infrastructure , troubleshooting	0	778	February 1, 2023
Security Advisory: OpenSSL Vulnerability Archive prefect-1-0 , prefect-2-0 , infrastructure , security , ssl , open-ssl , advisory	0	462	November 3, 2022
Create an Infrastructure From a Python Object Archive prefect-2-0 , deployment , infrastructure	0	554	September 30, 2022
Overview of Infrastructure Blocks in CLI-based deployments Archive prefect-2-0 , docker , infrastructure , getting-started	0	951	September 13, 2022
Deploying an MVP on Heroku, Scalingo or Dokku Archive prefect-2-0 , deployment , infrastructure	1	536	September 16, 2022
Out-of-memory (OOM) error after all tasks completed Archive prefect-2-0 , agent , infrastructure	8	1157	September 8, 2022
How can I parallelize execution across 8 CPU cores? Archive migration-guide , prefect-1-0 , prefect-2-0 , dask , executor , task-runner , parallel-processing , dask-task-runner , local-dask-executor , infrastructure , multithreading , multiprocessing	0	1982	January 31, 2022
How can I run tasks in parallel? Archive migration-guide , prefect-1-0 , prefect-2-0 , dask , executor , task-runner , parallel-processing , dask-task-runner , infrastructure , multithreading , multiprocessing , basics	0	3961	January 31, 2022
Docker compose to run Prefect 2.0 locally with Postgres Archive prefect-2-0 , local-development , docker , user-contribution , infrastructure , postgres , docker-compose , orion-api-server	0	1523	May 14, 2022
Do Prefect base images include extras from the task library e.g. postgres for the Postgres tasks? Archive prefect-1-0 , task-library , dockerfile , infrastructure , code-dependencies , docker-image , best-practices , base-image , extra_pip_packages	1	1220	June 27, 2022
How to deploy self-hosted Server and register first flows to the Server backend? Archive backend , blog-post , server , helm-chart , config-toml , infrastructure	0	1395	January 27, 2022

Main topic: Flow Deployment Patterns & Getting Started Recipes

prefect-2-0 , deployment , ci-cd , event-driven , infrastructure , real-time-streaming , infrastructure-as-code , execution-layer-deployment-tutorial , list-of-resources , tbd

This list of resources will point you to any topic of your interest regarding how to build a reliable flow deployment process suitable to your use cases, your data stack, and your team. 1. Getting started: install Pr…