Topics tagged infrastructure

Topic	Replies	Views	Activity
Main topic: Flow Deployment Patterns & Getting Started Recipes Archive prefect-2-0 , deployment , ci-cd , event-driven , infrastructure , real-time-streaming , infrastructure-as-code , execution-layer-deployment-tutorial , list-of-resources , tbd This list of resources will point you to any topic of your interest regarding how to build a reliable flow deployment process suitable to your use cases, your data stack, and your team. 1. Getting started: install Pr…	3	3413	September 22, 2022
Intermittent Error with Prefect Deployments Help prefect-2-0 , storage , agent , infrastructure	0	18	July 5, 2024
Can prefect run each subflow in different machine? Help prefect-2-0 , deployment , flow-of-flows , task-runner , subflows , infrastructure	0	38	June 25, 2024
Running Prefect Agents/Workers on different machines Help prefect-2-0 , agent , infrastructure	3	225	June 25, 2024
Create Kubernetes Job with mount Help prefect-2-0 , deployment , kubernetes , infrastructure	0	36	June 24, 2024
Tricks for reclaiming memory in Prefect flows and preventing Out-Of-Memory errors (OOM) Archive prefect-1-0 , prefect-2-0 , infrastructure , memory_request , resource-clean-up , oom-error	4	2354	June 22, 2024
Job variables are missing in OSS prefect>=2.18.0 Help prefect-2-0 , ui , create_flow_run , infrastructure , troubleshooting	1	131	May 23, 2024
Find agent that was unable to submit to infrastructure Help prefect-2-0 , agent , infrastructure	0	149	March 7, 2024
Error when starting deployment on ACI Help azure , failure , infrastructure	3	327	February 13, 2024
Azure ACI serverless push pools not working per guide Help prefect-2-0 , azure , infrastructure , troubleshooting	0	240	December 27, 2023
What is a recommended strategy for setting memory limits on a task? Help prefect-2-0 , parallel-processing , infrastructure	0	441	December 4, 2023
Horizontal scaling on Kubernetes & handling Workers termination Help prefect-2-0 , kubernetes , infrastructure , worker	0	399	November 2, 2023
Cannot create ACI with prefect push workpool Help azure , infrastructure , aci	2	372	October 20, 2023
How can I free up Postgres database space? Archive prefect-1-0 , prefect-2-0 , backend , server , infrastructure , resource-clean-up , postgres	1	1951	September 15, 2023
Using a message broker to trigger flow runs Show and Tell prefect-2-0 , infrastructure , integrations	0	536	August 28, 2023
Deployment to run a flow in a container Help prefect-2-0 , deployment , docker , infrastructure	0	309	August 28, 2023
Deployments with extra requirements Help prefect-2-0 , local-development , deployment , kubernetes , docker , agent , server , infrastructure , getting-started	0	381	August 8, 2023
How to handle custom resource (CPU vs. GPU) and code dependencies across various tasks and flows? Archive prefect-1-0 , prefect-2-0 , flow-of-flows , kubernetes , aws , orchestrator-pattern , subflows , infrastructure , cpu_request , kubernetes-agent , aws-eks , radar-view , gpu-intensive-workflows , cpu-memory-resource-allocation	3	3045	July 17, 2023
Creating and Deploying a custom Kubernetes Infrastructure Block Archive deployment , kubernetes , infrastructure , infrastructure-blocks	1	1648	June 22, 2023
Change the infrastructure document does not affect on AWS Help prefect-2-0 , deployment , aws , infrastructure	2	380	June 13, 2023
CI/CD for Prefect 2.0 Archive prefect-2-0 , deployment , ci-cd , docker , infrastructure , environments , list-of-resources , todo	0	3555	May 14, 2022
Can Prefect run each task in a different Docker container? Archive prefect-1-0 , flow-of-flows , docker , create_flow_run , orchestrator-pattern , wait_for_flow_run , infrastructure , code-dependencies , docker-run , docker-image , base-image	4	3164	February 22, 2023
Deployment fails trying to get namespace Help prefect-2-0 , deployment , kubernetes , infrastructure , troubleshooting	11	3102	February 14, 2023
Unable to add ENV variables to infrastructure block Help prefect-2-0 , infrastructure , troubleshooting	0	891	February 1, 2023
Security Advisory: OpenSSL Vulnerability Archive prefect-1-0 , prefect-2-0 , infrastructure , security , ssl , open-ssl , advisory	0	521	November 3, 2022
Create an Infrastructure From a Python Object Archive prefect-2-0 , deployment , infrastructure	0	619	September 30, 2022
Overview of Infrastructure Blocks in CLI-based deployments Archive prefect-2-0 , docker , infrastructure , getting-started	0	1047	September 13, 2022
Deploying an MVP on Heroku, Scalingo or Dokku Archive prefect-2-0 , deployment , infrastructure	1	616	September 16, 2022
Out-of-memory (OOM) error after all tasks completed Archive prefect-2-0 , agent , infrastructure	8	1301	September 8, 2022
How can I parallelize execution across 8 CPU cores? Archive migration-guide , prefect-1-0 , prefect-2-0 , dask , executor , task-runner , parallel-processing , dask-task-runner , local-dask-executor , infrastructure , multithreading , multiprocessing	0	2184	January 31, 2022

Main topic: Flow Deployment Patterns & Getting Started Recipes

prefect-2-0 , deployment , ci-cd , event-driven , infrastructure , real-time-streaming , infrastructure-as-code , execution-layer-deployment-tutorial , list-of-resources , tbd

This list of resources will point you to any topic of your interest regarding how to build a reliable flow deployment process suitable to your use cases, your data stack, and your team. 1. Getting started: install Pr…

3

3413

September 22, 2022

Intermittent Error with Prefect Deployments