Topics tagged task-runner

Topic	Replies	Views	Activity
[Prefect - Airbyte - Error] ssl.SSLSyscallError: Some I/O error occurred (_ssl.c:997) and anyio.BrokenResourceError Usage Questions prefect-2-0 , local-development , deployment , task-runner , docker , airbyte , failure , troubleshooting , getting-started	13	320	December 21, 2022
How to set a different task runner for dev vs. prod (e.g. to use Dask only in prod)? DataflowOps for Prefect 2.0 prefect-2-0 , local-development , task-runner , environments	0	252	October 11, 2022
New Orion release 2.0a13 featuring work queues, agents, profiles, remote object storage and distributed parallel processing with Ray! Announcements prefect-2-0 , release-notes , storage , aws , s3 , gcp , task-runner , parallel-processing , agent , azure , concurrency-limits , kubernetes-flow-runner , filters , gcs , docker-flow-runner , profiles-prefect-config , work-queue , ray , ray-task-runner , azure-blob-storage	7	656	July 29, 2022
Are there some packages that are not compatible with prefect2? Usage Questions prefect-2-0 , storage , task-runner , dask-task-runner	12	416	July 23, 2022
What is the default TaskRunner (executor)? Workflow Orchestration migration-guide , prefect-1-0 , prefect-2-0 , executor , task-runner , defaults	1	972	July 21, 2022
How can I configure my flow to run with Dask? Distributed Computing migration-guide , prefect-1-0 , prefect-2-0 , dask , executor , task-runner , parallel-processing , dask-task-runner , getting-started	2	1021	July 5, 2022
How can I configure a specific Dask cluster class? Distributed Computing migration-guide , prefect-1-0 , prefect-2-0 , aws , dask , executor , task-runner , parallel-processing , fargate , dask-task-runner , dask-cloud-provider , docker-image	0	373	January 21, 2022
How can I parallelize execution across 8 CPU cores? Workflow Orchestration migration-guide , prefect-1-0 , prefect-2-0 , dask , executor , task-runner , parallel-processing , dask-task-runner , local-dask-executor , infrastructure , multithreading , multiprocessing	0	694	January 31, 2022
Why is my function not running in parallel even with DaskTaskRunner / RayTaskRunner? Distributed Computing prefect-2-0 , dask , task-runner , parallel-processing , dask-task-runner , dask-annotations	14	597	July 5, 2022
How can I run tasks in parallel? Workflow Orchestration migration-guide , prefect-1-0 , prefect-2-0 , dask , executor , task-runner , parallel-processing , dask-task-runner , infrastructure , multithreading , multiprocessing , basics	0	972	January 31, 2022
New Prefect 2.0 release: 2.0b4 including flow and task runner improvements, performance optimizations, numerous fixes and new Prefect Collections! Announcements prefect-2-0 , release-notes , cli , storage , deployment , flow-runner , task-runner , dask-task-runner , async , twitter , kubernetes-flow-runner , great-expectations , ray-task-runner , cube-js , prefect-collections , subprocess-flow-runner , github	3	655	July 5, 2022
What is the difference between Prefect and Celery? FAQ backend , executor , task-runner , celery	0	327	March 21, 2022
Can my subflow use a different task runner than my parent flow? Workflow Orchestration migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , executor , task-runner , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run	0	393	January 31, 2022
New Orion release 2.0a10 including concurrency limits, ConcurrentTaskRunner, CLI refinements and improved database migrations Announcements prefect-2-0 , release-notes , cli , parameters , task-runner , parallel-processing , concurrency-limits , async , database-migrations	0	295	February 9, 2022

[Prefect - Airbyte - Error] ssl.SSLSyscallError: Some I/O error occurred (_ssl.c:997) and anyio.BrokenResourceError

prefect-2-0 , local-development , deployment , task-runner , docker , airbyte , failure , troubleshooting , getting-started

13

320

December 21, 2022

How to set a different task runner for dev vs. prod (e.g. to use Dask only in prod)?

DataflowOps for Prefect 2.0

prefect-2-0 , local-development , task-runner , environments

0

252

October 11, 2022

New Orion release 2.0a13 featuring work queues, agents, profiles, remote object storage and distributed parallel processing with Ray!

Announcements

prefect-2-0 , release-notes , storage , aws , s3 , gcp , task-runner , parallel-processing , agent , azure , concurrency-limits , kubernetes-flow-runner , filters , gcs , docker-flow-runner , profiles-prefect-config , work-queue , ray , ray-task-runner , azure-blob-storage

7

656

July 29, 2022

Are there some packages that are not compatible with prefect2?

Usage Questions

prefect-2-0 , storage , task-runner , dask-task-runner

12

416

July 23, 2022

What is the default TaskRunner (executor)?

Workflow Orchestration

migration-guide , prefect-1-0 , prefect-2-0 , executor , task-runner , defaults

1

972

July 21, 2022

How can I configure my flow to run with Dask?

Distributed Computing

migration-guide , prefect-1-0 , prefect-2-0 , dask , executor , task-runner , parallel-processing , dask-task-runner , getting-started

2

1021

July 5, 2022

How can I configure a specific Dask cluster class?

Distributed Computing

migration-guide , prefect-1-0 , prefect-2-0 , aws , dask , executor , task-runner , parallel-processing , fargate , dask-task-runner , dask-cloud-provider , docker-image

0

373

January 21, 2022

How can I parallelize execution across 8 CPU cores?

Workflow Orchestration

migration-guide , prefect-1-0 , prefect-2-0 , dask , executor , task-runner , parallel-processing , dask-task-runner , local-dask-executor , infrastructure , multithreading , multiprocessing

0

694

January 31, 2022

Why is my function not running in parallel even with DaskTaskRunner / RayTaskRunner?

Distributed Computing

prefect-2-0 , dask , task-runner , parallel-processing , dask-task-runner , dask-annotations

14

597

July 5, 2022

How can I run tasks in parallel?

Workflow Orchestration

migration-guide , prefect-1-0 , prefect-2-0 , dask , executor , task-runner , parallel-processing , dask-task-runner , infrastructure , multithreading , multiprocessing , basics

0

972

January 31, 2022

New Prefect 2.0 release: 2.0b4 including flow and task runner improvements, performance optimizations, numerous fixes and new Prefect Collections!

Announcements

prefect-2-0 , release-notes , cli , storage , deployment , flow-runner , task-runner , dask-task-runner , async , twitter , kubernetes-flow-runner , great-expectations , ray-task-runner , cube-js , prefect-collections , subprocess-flow-runner , github

3

655

July 5, 2022

What is the difference between Prefect and Celery?

FAQ

backend , executor , task-runner , celery

0

327

March 21, 2022

Can my subflow use a different task runner than my parent flow?

Workflow Orchestration

migration-guide , prefect-1-0 , prefect-2-0 , flow-of-flows , executor , task-runner , create_flow_run , orchestrator-pattern , subflows , wait_for_flow_run

0

393

January 31, 2022

New Orion release 2.0a10 including concurrency limits, ConcurrentTaskRunner, CLI refinements and improved database migrations

Announcements

prefect-2-0 , release-notes , cli , parameters , task-runner , parallel-processing , concurrency-limits , async , database-migrations

0

295

February 9, 2022

task-runner

Don't Panic

Read our Privacy Policy