Tricks for reclaiming memory in Prefect flows and preventing Out-Of-Memory errors (OOM)

Hey Everyone,

Are you at all considering adding such functionality directly into the framework?
Something like an aggressive memory mode to either cleanup state wherever possible or optionally pass state data over disk.

While I understand that workarounds are possible, feel like there’s a gap here.

1 Like

We do, there is an active WIP about handling task and flow run results. I’d expect to see more updates on this within a couple of next weeks.