I am trying to execute the flow using dask worker/pods.
In the flow kwargs, I have initialized task_runner as DaskTaskRunner.
When I try to specify cluster_class as KubeCluster, I am getting this error
But when I specify only cluster_kwargs, flow is executing successfully with distributed.deploy.local.LocalCluster
I guess I might be using some mismatched libraries.
currently I am using this versions
dask 2023.3.1
dask-kubernetes 2023.3.1
distributed 2023.3.1
kubernetes 26.1.0
kubernetes-asyncio 24.2.3
prefect 2.10.4
prefect-aws 0.3.1
prefect-dask 0.2.4