Is it possible to direct specific tasks or flows to a specific work-pool or queue?

I have a task that needs a different infrastructure setup than the rest of my tasks (Different image and different CPU+Memory usage profile). Is there an easy way to route the task to a different queue / work-pool so that it will be picked up by a different ECS agent/worker?

Hi @ori-scala

I would recommend a setup that defines a work pool per unique execution environment. That way, you could define deployments that pull their runtime configuration from that work pool and then you could use run_deployment from a central orchestrator to delegate work to its appropriate runtime.

This would likely be easier and more in-line with our best practices than trying to submit specific tasks of one flow to different places.

1 Like