I am searching for a way to run the different flow runs in a worker in async/thread pool, because my flows usally fetch data from somewhere (api requests and DB queries) and mainly wating for response.
Therefore running the flows in subprocesses or on containers, dose not suit my needs, because they take many time and resources.
In a nuthshell, I want to run thousands of flows in parrelel using some kind of async/threading functionality.
*I know the possibility to run async and dask tasks within the flow, but thats not what I am searching for as my flows are simple and synchronus. I search for a different type of worker that will run the different flows using async/dask/any other way to handle IO bound flows in parrellel.