Topics tagged ecs

Topic	Replies	Views	Activity
Health check prefect 2 agent Usage Questions prefect-2-0 , agent , health-checks , ecs , prefect-2	0	107	January 31, 2023
How to run deployments with ECSTask infrastructure block at scale (running hundreds of serverless ECS-containerized flow runs concurrently)? DataflowOps for Prefect 2.0 prefect-2-0 , aws , ecs , throttling , rate-limiting	0	420	November 18, 2022
Why the ec2:DescribeVpcs AWS IAM policy is needed on ECSTask even when VPC ID is explicitly provided? FAQ prefect-2-0 , ecs , infrastructure-blocks	0	125	December 14, 2022
Can I override CPU and memory value of the ECSTask infrastructure block for a specific container? DataflowOps for Prefect 2.0 prefect-2-0 , aws , ecs , infrastructure-blocks	0	155	November 17, 2022
Do not invalidate the current Fargate Task Definition when registering a new flow version Usage Questions prefect-1-0 , deployment , aws , ecs	2	183	November 3, 2022
Prefect 2.6.4 is live with great news to serverless fans! Announcements prefect-2-0 , release-notes , kv-store , azure , results , ecs	0	235	October 20, 2022
Prefect 2.4.0 Release Adds Support for AWS ECS Tasks and Improves Deployment CLI for CI/CD Announcements prefect-2-0 , release-notes , aws , ecs	0	797	September 13, 2022
Serverless Real-Time Data Pipelines on AWS with Prefect, ECS and GitHub Actions - blog post by Anna Geller Tutorials & Resources prefect-2-0 , aws , blog-post , ecs , real-time-streaming , serverless	4	431	September 11, 2022
EKS vs ECS for Prefect 2.0 Usage Questions kubernetes , ecs , aws-eks	4	608	August 30, 2022
How to deploy Prefect on AWS ECS Tutorials & Resources prefect-1-0 , aws , ecs , agent-setup , ecs-agent	0	231	June 3, 2022
Example Prefect 1.0 repository with flow registration and infrastructure setup used at Pocket (part of Mozilla) Tutorials & Resources prefect-1-0 , aws , ci-cd , flow-registration , readme , user-contribution , ecs , environments , repository-structure , sentry	0	201	May 13, 2022
Can I use ECS on Fargate with Prefect 2.0? Is an ECSFlowRunner on the roadmap? Deployments & DevOps prefect-2-0 , kubernetes , aws , agent , ecs , aws-eks , aws-ec2 , agent-setup , eksctl	0	868	April 28, 2022
I'm getting CannotPullContainerError when deploying a flow to ECS in a custom VPC Deployments & DevOps prefect-1-0 , aws , ecs , ecs-agent , vpc , run_task_kwargs , ecs-run	0	292	April 27, 2022
ClusterNotFoundException when using ECSAgent Deployments & DevOps prefect-1-0 , aws , ecs , ecs-agent	3	384	April 11, 2022
When using ECSRun I'm getting an error: "An error occurred (ClientException) when calling the RegisterTaskDefinition operation: Invalid setting for container 'flow'. At least one of 'memory' or 'memoryReservation' must be specified" Deployments & DevOps prefect-1-0 , aws , ecs , ecs-task-definition	0	304	April 5, 2022
When I don't set an image in the ECS task definition, I'm getting: "An error occurred (ClientException) when calling the RegisterTaskDefinition operation: Container.image should not be null or empty" Deployments & DevOps prefect-1-0 , ecs , ecs-agent	0	458	March 31, 2022
How to handle ECS errors during flow run deployment? Is it possible to implement a flow-level retry for errors such as this one: "Failed to start [ECS] task for flow run SOME_UUID"? Deployments & DevOps prefect-1-0 , aws , ecs , infrastructure , cpu-memory-resource-allocation , ecs-agent	0	312	March 28, 2022
Launch Week Day 4 is not over yet! We've just released Customer Success Recipes and Prefect 2.0b2! Announcements prefect-2-0 , release-notes , dbt , kubernetes , aws , ci-cd , s3 , docker , secrets , event-driven , airbyte , ecs , infrastructure , kubernetes-agent , docker-agent , docker-flow-runner , network-and-firewall , aws-ec2 , launch-week , agent-setup , linux , terraform , infrastructure-as-code , customer-success-recipes , ecs-agent	0	391	March 17, 2022
When using ECSAgent, I'm getting an error: "An error occurred (ThrottlingException) when calling the DeregisterTaskDefinition operation (reached max retries: 2): Rate exceeded" - how to fix it? FAQ prefect-1-0 , aws , fargate , agent , ecs , throttling	0	210	March 3, 2022
Any plan to add ECSRunTask to AWS Tasks? Integrations prefect-1-0 , aws , fargate , task-library , ecs	0	235	February 22, 2022
How to deal with the long startup time (latency) on flow runs deployed to ECS Fargate? Deployments & DevOps kubernetes , aws , fargate , docker , agent , ecs , infrastructure , kubernetes-run , kubernetes-agent , aws-eks , docker-image , aws-ec2 , image-pull-policy	0	855	March 3, 2022
I am using ECSAgent and sometimes I get an error that says "An error occurred (ClientException) when calling the RegisterTaskDefinition operation: Too many concurrent attempts to create a new revision of the specified family." Deployments & DevOps run_config , aws , fargate , agent , ecs	1	606	January 30, 2022

Health check prefect 2 agent

0

107

January 31, 2023

How to run deployments with ECSTask infrastructure block at scale (running hundreds of serverless ECS-containerized flow runs concurrently)?

DataflowOps for Prefect 2.0

prefect-2-0 , aws , ecs , throttling , rate-limiting

0

420

November 18, 2022

Why the ec2:DescribeVpcs AWS IAM policy is needed on ECSTask even when VPC ID is explicitly provided?

FAQ

prefect-2-0 , ecs , infrastructure-blocks

0

125

December 14, 2022

Can I override CPU and memory value of the ECSTask infrastructure block for a specific container?

DataflowOps for Prefect 2.0

prefect-2-0 , aws , ecs , infrastructure-blocks

0

155

November 17, 2022

Do not invalidate the current Fargate Task Definition when registering a new flow version

Usage Questions

prefect-1-0 , deployment , aws , ecs

2

183

November 3, 2022

Prefect 2.6.4 is live with great news to serverless fans!

Announcements

prefect-2-0 , release-notes , kv-store , azure , results , ecs

0

235

October 20, 2022

Prefect 2.4.0 Release Adds Support for AWS ECS Tasks and Improves Deployment CLI for CI/CD

Announcements

prefect-2-0 , release-notes , aws , ecs

0

797

September 13, 2022

Serverless Real-Time Data Pipelines on AWS with Prefect, ECS and GitHub Actions - blog post by Anna Geller

Tutorials & Resources

prefect-2-0 , aws , blog-post , ecs , real-time-streaming , serverless

4

431

September 11, 2022

EKS vs ECS for Prefect 2.0

Usage Questions

kubernetes , ecs , aws-eks

4

608

August 30, 2022

How to deploy Prefect on AWS ECS

Tutorials & Resources

prefect-1-0 , aws , ecs , agent-setup , ecs-agent

0

231

June 3, 2022

Example Prefect 1.0 repository with flow registration and infrastructure setup used at Pocket (part of Mozilla)

Tutorials & Resources

prefect-1-0 , aws , ci-cd , flow-registration , readme , user-contribution , ecs , environments , repository-structure , sentry

0

201

May 13, 2022

Can I use ECS on Fargate with Prefect 2.0? Is an ECSFlowRunner on the roadmap?

Deployments & DevOps

prefect-2-0 , kubernetes , aws , agent , ecs , aws-eks , aws-ec2 , agent-setup , eksctl

0

868

April 28, 2022

I'm getting CannotPullContainerError when deploying a flow to ECS in a custom VPC

Deployments & DevOps

prefect-1-0 , aws , ecs , ecs-agent , vpc , run_task_kwargs , ecs-run

0

292

April 27, 2022

ClusterNotFoundException when using ECSAgent

Deployments & DevOps

prefect-1-0 , aws , ecs , ecs-agent

3

384

April 11, 2022

When using ECSRun I'm getting an error: "An error occurred (ClientException) when calling the RegisterTaskDefinition operation: Invalid setting for container 'flow'. At least one of 'memory' or 'memoryReservation' must be specified"

Deployments & DevOps

prefect-1-0 , aws , ecs , ecs-task-definition

0

304

April 5, 2022

When I don't set an image in the ECS task definition, I'm getting: "An error occurred (ClientException) when calling the RegisterTaskDefinition operation: Container.image should not be null or empty"

Deployments & DevOps

prefect-1-0 , ecs , ecs-agent

0

458

March 31, 2022

How to handle ECS errors during flow run deployment? Is it possible to implement a flow-level retry for errors such as this one: "Failed to start [ECS] task for flow run SOME_UUID"?

Deployments & DevOps

prefect-1-0 , aws , ecs , infrastructure , cpu-memory-resource-allocation , ecs-agent

0

312

March 28, 2022

Launch Week Day 4 is not over yet! We've just released Customer Success Recipes and Prefect 2.0b2!

Announcements

prefect-2-0 , release-notes , dbt , kubernetes , aws , ci-cd , s3 , docker , secrets , event-driven , airbyte , ecs , infrastructure , kubernetes-agent , docker-agent , docker-flow-runner , network-and-firewall , aws-ec2 , launch-week , agent-setup , linux , terraform , infrastructure-as-code , customer-success-recipes , ecs-agent

0

391

March 17, 2022

When using ECSAgent, I'm getting an error: "An error occurred (ThrottlingException) when calling the DeregisterTaskDefinition operation (reached max retries: 2): Rate exceeded" - how to fix it?

FAQ

prefect-1-0 , aws , fargate , agent , ecs , throttling

0

210

March 3, 2022

Any plan to add ECSRunTask to AWS Tasks?

Integrations

prefect-1-0 , aws , fargate , task-library , ecs

0

235

February 22, 2022

How to deal with the long startup time (latency) on flow runs deployed to ECS Fargate?

Deployments & DevOps

kubernetes , aws , fargate , docker , agent , ecs , infrastructure , kubernetes-run , kubernetes-agent , aws-eks , docker-image , aws-ec2 , image-pull-policy

0

855

March 3, 2022

I am using ECSAgent and sometimes I get an error that says "An error occurred (ClientException) when calling the RegisterTaskDefinition operation: Too many concurrent attempts to create a new revision of the specified family."

Deployments & DevOps

run_config , aws , fargate , agent , ecs