Yes. Prefect has an asynchronous scheduling service whose only job is to correctly generate future flow runs and the agent is a lightweight process that is polling for scheduled flow runs and executing those as:
a subprocess - a local agent
a docker container - a docker agent
a Kubernetes job - a Kubernetes agent
an ECS task - an ECS agent
a Vertex job - a Vertex agent.
View in #prefect-community on Slack
@Emma_Rizzi :https://docs.prefect.io/orchestration/agents/overview.html A single agent can manage many concurrent flow runs -> does it mean that if I schedule multiple flow at the same time for the same agent, the agent will be able to treat them parallelly ? Or does it queue the jobs ?
@Amanda_Wee :
@Emma_Rizzi :@Amanda_Wee thanks, do you have any idea of how to optimize the performances ? if i put the agent on a 4 cpus instance, does it need configuration to use them all ?
@Kevin_Kho :
@Emma_Rizzi :@Kevin_Kho I’ll try this soon!