I’m trying to set up Prefect using ECS and my first flow is giving a ClusterNotFoundException. I set up the ECSAgent and in the UI it looked green and ready to accept flows. On the AWS logs side of things I see this for the agent, but it doesn’t give me any clues as to what went wrong. 4/11/2022, 1…

Hi @Connor_Skennerton , welcome to Prefect Discourse! Glad to have you here! :wave: I think the problem might be that your ECSRun doesn’t know to which ECS cluster it’s supposed to deploy your flow. Can you try setting the ECS cluster name explicitly like so: run_task_kwargs=dict(cluster="yourECSClu…

ClusterNotFoundException when using ECSAgent

Archive

Connor_Skennerton April 11, 2022, 7:40pm 3

Thank you! Yes that worked. Is there a way to specify that globally rather than on the flow itself?

1 Like

Topic		Replies	Views
S3fs not found despite being present Help	0	283	September 28, 2023
Prefect Agent Connection issue Prefect Server hosted in EC2 Help prefect-2-0 , aws , agent , getting-started	0	362	May 17, 2023
Command "prefect" not found on ECS Fargate Task Help aws , fargate , ecs , ecs-agent	1	428	April 26, 2023
Having issues of "refectHTTPStatusError: Client error '404 Not Found' for url 'http://ephemeral-prefect/api/flow_runs/..." using prefect_gcp Help gcp	2	490	October 16, 2023
What may be the reason for the error "prefect.exceptions.ObjectNotFound"? Archive prefect-2-0 , flow-runner , troubleshooting	0	2310	April 26, 2022

ClusterNotFoundException when using ECSAgent

Related Topics