task-runner

Topic Replies Views Activity
How to set a different task runner for dev vs. prod (e.g. to use Dask only in prod)?
DataflowOps for Prefect 2.0
prefect-2-0 ,  local-development ,  task-runner ,  environments
0 106 October 11, 2022
New Orion release 2.0a13 featuring work queues, agents, profiles, remote object storage and distributed parallel processing with Ray!
Announcements
prefect-2-0 ,  release-notes ,  storage ,  aws ,  s3 ,  gcp ,  task-runner ,  parallel-processing ,  agent ,  azure ,  concurrency-limits ,  kubernetes-flow-runner ,  filters ,  gcs ,  docker-flow-runner ,  profiles-prefect-config ,  work-queue ,  ray ,  ray-task-runner ,  azure-blob-storage
7 520 July 29, 2022
Are there some packages that are not compatible with prefect2?
Usage Questions
prefect-2-0 ,  storage ,  task-runner ,  dask-task-runner
12 289 July 23, 2022
What is the default TaskRunner (executor)?
Workflow Orchestration
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  executor ,  task-runner ,  defaults
1 586 July 21, 2022
How can I configure my flow to run with Dask?
Distributed Computing
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  dask ,  executor ,  task-runner ,  parallel-processing ,  dask-task-runner ,  getting-started
2 529 July 5, 2022
How can I configure a specific Dask cluster class?
Distributed Computing
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  aws ,  dask ,  executor ,  task-runner ,  parallel-processing ,  fargate ,  dask-task-runner ,  dask-cloud-provider ,  docker-image
0 223 January 21, 2022
How can I parallelize execution across 8 CPU cores?
Workflow Orchestration
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  dask ,  executor ,  task-runner ,  parallel-processing ,  dask-task-runner ,  local-dask-executor ,  infrastructure ,  multithreading ,  multiprocessing
0 367 January 31, 2022
Why is my function not running in parallel even with DaskTaskRunner / RayTaskRunner?
Distributed Computing
prefect-2-0 ,  dask ,  task-runner ,  parallel-processing ,  dask-task-runner ,  dask-annotations
14 326 July 5, 2022
How can I run tasks in parallel?
Workflow Orchestration
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  dask ,  executor ,  task-runner ,  parallel-processing ,  dask-task-runner ,  infrastructure ,  multithreading ,  multiprocessing ,  basics
0 442 January 31, 2022
New Prefect 2.0 release: 2.0b4 including flow and task runner improvements, performance optimizations, numerous fixes and new Prefect Collections!
Announcements
prefect-2-0 ,  release-notes ,  cli ,  storage ,  deployment ,  flow-runner ,  task-runner ,  dask-task-runner ,  async ,  twitter ,  kubernetes-flow-runner ,  great-expectations ,  ray-task-runner ,  cube-js ,  prefect-collections ,  subprocess-flow-runner ,  github
3 497 July 5, 2022
What is the difference between Prefect and Celery?
FAQ
backend ,  executor ,  task-runner ,  celery
0 161 March 21, 2022
Can my subflow use a different task runner than my parent flow?
Workflow Orchestration
migration-guide ,  prefect-1-0 ,  prefect-2-0 ,  flow-of-flows ,  executor ,  task-runner ,  create_flow_run ,  orchestrator-pattern ,  subflows ,  wait_for_flow_run
0 272 January 31, 2022
New Orion release 2.0a10 including concurrency limits, ConcurrentTaskRunner, CLI refinements and improved database migrations
Announcements
prefect-2-0 ,  release-notes ,  cli ,  parameters ,  task-runner ,  parallel-processing ,  concurrency-limits ,  async ,  database-migrations
0 215 February 9, 2022