We have a CRON defined to run each minute.
Each run takes about 15 seconds to complete.
If for some reason a certain run takes more than 1 minute, let’s say 1 minute and 20 seconds, so is there a way to tell Prefect to “push” and reschedule all the future runs so that the current one won’t overlap?
it looks like you are looking for a real-time pipeline as a service
this may help, including conceptual explanation:
I think it’s exactly what we need!
can you share more info about this? (-:
Sure, we meant this:
you could emit events to Prefect and take action on it in near real-time