When you issue log commands from python code, they hit Prefect Cloud and are subject to the 400/2000 api calls a month limit.
This means things will work for a while until you ramp up runs, then they will start crashing! Even if you’re paying for Pro! This creates a lot of pain for me, and doesn’t incentivize me to upgrade from my free account to Pro, because the exact same issue is there just simply at a higher threshold. Instead, it makes me not want to use Prefect Cloud at all, and self host.
Would you consider changing how the python logging API client calls work so that if the 429 error code comes back, the call blocks, waits for an increasing backoff period, and tries again, up to some reasonable maximum number? I’m going to go through my code and wrap all calls to the logger to accomplish this same thing, but I feel annoyed that I have to.
If anyone has a better solution or analysis I’m all ears!