ray-task-runner

Topic Replies Views Activity
How to decide when to use the default ConcurrentTaskRunner vs. SequentialTaskRunner vs. DaskTaskRunner vs. RayTaskRunner? What are performance benchmarks for given use cases?
DataOps Tutorials for Prefect 2.0
task-runner ,  dask-task-runner ,  async ,  ray-task-runner ,  todo ,  concurrent-task-runner
0 13 June 19, 2022
New Prefect 2.0 release: 2.0b4 including flow and task runner improvements, performance optimizations, numerous fixes and new Prefect Collections!
Announcements
prefect-2-0 ,  release-notes ,  cli ,  storage ,  deployment ,  flow-runner ,  task-runner ,  dask-task-runner ,  async ,  twitter ,  kubernetes-flow-runner ,  great-expectations ,  ray-task-runner ,  cube-js ,  prefect-collections ,  subprocess-flow-runner ,  github
2 191 May 13, 2022
RayTaskRunner freezes when writing data to a local directory
Distributed Computing
prefect-2-0 ,  parallel-processing ,  ray ,  ray-task-runner
3 110 April 6, 2022
New Orion release 2.0a13 featuring work queues, agents, profiles, remote object storage and distributed parallel processing with Ray!
Announcements
prefect-2-0 ,  release-notes ,  storage ,  aws ,  s3 ,  gcp ,  task-runner ,  parallel-processing ,  agent ,  azure ,  concurrency-limits ,  kubernetes-flow-runner ,  filters ,  gcs ,  docker-flow-runner ,  profiles-prefect-config ,  work-queue ,  ray ,  ray-task-runner ,  azure-blob-storage
4 241 March 7, 2022