Yes. Prefect has an
asynchronous scheduling service whose only job is to correctly generate future flow runs and the agent is a lightweight process that is polling for scheduled flow runs and executing those as:
a subprocess - a local agent
a docker container - a docker agent
a Kubernetes job - a Kubernetes agent
an ECS task - an ECS agent
a Vertex job - a Vertex agent.
View in #prefect-community on Slack
Hello, question on Agents to understand the doc here : @Emma_Rizzi: https://docs.prefect.io/orchestration/agents/overview.html
A single agent can manage many concurrent flow runs -> does it mean that if I schedule multiple flow at the same time for the same agent, the agent will be able to treat them parallelly ? Or does it queue the jobs ?
Yeah, the agent does handle them in parallel. @Amanda_Wee:
@Emma_Rizzi: @Amanda_Wee thanks, do you have any idea of how to optimize the performances ? if i put the agent on a 4 cpus instance, does it need configuration to use them all ?
It just keeps launching the processes with no configuration @Kevin_Kho:
thanks @Emma_Rizzi: @Kevin_Kho I’ll try this soon!