Topics tagged infrastructure

Topic	Replies	Views	Activity
Main topic: Flow Deployment Patterns & Getting Started Recipes Archive prefect-2-0 , deployment , ci-cd , event-driven , infrastructure , real-time-streaming , infrastructure-as-code , execution-layer-deployment-tutorial , list-of-resources , tbd This list of resources will point you to any topic of your interest regarding how to build a reliable flow deployment process suitable to your use cases, your data stack, and your team. 1. Getting started: install P…	3	2623	September 22, 2022
How can I free up Postgres database space? Archive prefect-1-0 , prefect-2-0 , backend , server , infrastructure , resource-clean-up , postgres	1	992	September 15, 2023
Using a message broker to trigger flow runs Show and Tell prefect-2-0 , infrastructure , integrations	0	137	August 28, 2023
Deployment to run a flow in a container Help prefect-2-0 , deployment , docker , infrastructure	0	44	August 28, 2023
Deployments with extra requirements Help prefect-2-0 , local-development , deployment , kubernetes , docker , agent , server , infrastructure , getting-started	0	60	August 8, 2023
How to handle custom resource (CPU vs. GPU) and code dependencies across various tasks and flows? Archive prefect-1-0 , prefect-2-0 , flow-of-flows , kubernetes , aws , orchestrator-pattern , subflows , infrastructure , cpu_request , kubernetes-agent , aws-eks , radar-view , gpu-intensive-workflows , cpu-memory-resource-allocation	3	2029	July 17, 2023
Creating and Deploying a custom Kubernetes Infrastructure Block Archive deployment , kubernetes , infrastructure , infrastructure-blocks	1	1167	June 22, 2023
Change the infrastructure document does not affect on AWS Help prefect-2-0 , deployment , aws , infrastructure	2	119	June 13, 2023
Tricks for reclaiming memory in Prefect flows and preventing Out-Of-Memory errors (OOM) Archive prefect-1-0 , prefect-2-0 , infrastructure , memory_request , resource-clean-up , oom-error	3	1555	June 9, 2023
CI/CD for Prefect 2.0 Archive prefect-2-0 , deployment , ci-cd , docker , infrastructure , environments , list-of-resources , todo	0	2654	May 14, 2022
Can Prefect run each task in a different Docker container? Archive prefect-1-0 , flow-of-flows , docker , create_flow_run , orchestrator-pattern , wait_for_flow_run , infrastructure , code-dependencies , docker-run , docker-image , base-image	4	2052	February 22, 2023
Deployment fails trying to get namespace Help prefect-2-0 , deployment , kubernetes , infrastructure , troubleshooting	11	1491	February 14, 2023
Unable to add ENV variables to infrastructure block Help prefect-2-0 , infrastructure , troubleshooting	0	506	February 1, 2023
Security Advisory: OpenSSL Vulnerability Archive prefect-1-0 , prefect-2-0 , infrastructure , security , ssl , open-ssl , advisory	0	272	November 3, 2022
Create an Infrastructure From a Python Object Archive prefect-2-0 , deployment , infrastructure	0	413	September 30, 2022
Overview of Infrastructure Blocks in CLI-based deployments Archive prefect-2-0 , docker , infrastructure , getting-started	0	673	September 13, 2022
Deploying an MVP on Heroku, Scalingo or Dokku Archive prefect-2-0 , deployment , infrastructure	1	352	September 16, 2022
Out-of-memory (OOM) error after all tasks completed Archive prefect-2-0 , agent , infrastructure	8	746	September 8, 2022
How can I parallelize execution across 8 CPU cores? Archive migration-guide , prefect-1-0 , prefect-2-0 , dask , executor , task-runner , parallel-processing , dask-task-runner , local-dask-executor , infrastructure , multithreading , multiprocessing	0	1332	January 31, 2022
How can I run tasks in parallel? Archive migration-guide , prefect-1-0 , prefect-2-0 , dask , executor , task-runner , parallel-processing , dask-task-runner , infrastructure , multithreading , multiprocessing , basics	0	2464	January 31, 2022
Docker compose to run Prefect 2.0 locally with Postgres Archive prefect-2-0 , local-development , docker , user-contribution , infrastructure , postgres , docker-compose , orion-api-server	0	988	May 14, 2022
Do Prefect base images include extras from the task library e.g. postgres for the Postgres tasks? Archive prefect-1-0 , task-library , dockerfile , infrastructure , code-dependencies , docker-image , best-practices , base-image , extra_pip_packages	1	774	June 27, 2022
How to deploy self-hosted Server and register first flows to the Server backend? Archive backend , blog-post , server , helm-chart , config-toml , infrastructure	0	937	January 27, 2022
How to assign IAM permissions to a Kubernetes cluster so that my flows can access other AWS services such as S3 or DynamoDB? Archive prefect-1-0 , auth-and-permissions , kubernetes , aws , infrastructure , iam , service-accounts , iam-roles-for-service-accounts	0	696	February 20, 2022
How scalable is Prefect Server for scheduling concurrent runs of tens of thousands of flows? Archive prefect-1-0 , server , infrastructure , postgres , scaling-up-and-out , performance	0	1067	March 21, 2022
How to handle ECS errors during flow run deployment? Is it possible to implement a flow-level retry for errors such as this one: "Failed to start [ECS] task for flow run SOME_UUID"? Archive prefect-1-0 , aws , ecs , infrastructure , cpu-memory-resource-allocation , ecs-agent	0	513	March 28, 2022
How to disable the SSL verification when setting up a Prefect agent? I'm getting SSLCertVerificationError: "CERTIFICATE_VERIFY_FAILED certificate verify failed: unable to get local issuer certificate" Archive prefect-1-0 , infrastructure , troubleshooting , kubernetes-agent , network-and-firewall , ssl	1	2184	March 28, 2022
Can I run a flow-of-flows that triggers each child flow on a different machine? Archive prefect-1-0 , flow-of-flows , agent , labels , create_flow_run , orchestrator-pattern , wait_for_flow_run , infrastructure	0	935	February 7, 2022
Docker agent cannot communicate with a Prefect Server Postgres database instance running locally on a host VM Archive prefect-1-0 , docker , agent , server , infrastructure , docker-agent , postgres , network-and-firewall	6	1624	March 18, 2022
Launch Week Day 4 is not over yet! We've just released Customer Success Recipes and Prefect 2.0b2! Announcements prefect-2-0 , release-notes , dbt , kubernetes , aws , ci-cd , s3 , docker , secrets , event-driven , airbyte , ecs , infrastructure , kubernetes-agent , docker-agent , docker-flow-runner , network-and-firewall , aws-ec2 , launch-week , agent-setup , linux , terraform , infrastructure-as-code , customer-success-recipes , ecs-agent	0	604	March 17, 2022

Main topic: Flow Deployment Patterns & Getting Started Recipes

prefect-2-0 , deployment , ci-cd , event-driven , infrastructure , real-time-streaming , infrastructure-as-code , execution-layer-deployment-tutorial , list-of-resources , tbd

This list of resources will point you to any topic of your interest regarding how to build a reliable flow deployment process suitable to your use cases, your data stack, and your team. 1. Getting started: install P…

3

2623

September 22, 2022

How can I free up Postgres database space?