Topics tagged task-library

Topic	Replies	Views	Activity
How to use the task library? Integrations shell , imperative-api , task-library What is the task library? The Prefect task library is a constantly growing list of pre-defined tasks that provide off-the-shelf functionality for working with a wide range of tools. A majority of the task library is c…	8	1022	June 15, 2022
How to define DAG like flow in Prefect 2.0 Workflow Orchestration migration-guide , prefect-2-0 , task-library	6	328	December 21, 2022
New dbt recipe allowing you to rerun your dbt DAG from a failed node - by Alex Streed Tutorials & Resources prefect-1-0 , dbt , task-library , restarts , customer-success-recipes	3	727	October 3, 2022
Ideas on future dbt integrations with Prefect Integrations prefect-1-0 , prefect-2-0 , dbt , task-library	0	424	March 3, 2022
Migrating Databricks Tasks from Prefect 1 to Prefect 2 Tutorials & Resources migration-guide , prefect-1-0 , prefect-2-0 , blog-post , task-library , databricks , prefect-collections	0	110	August 25, 2022
How to migrate Prefect 1.0 task library tasks to a Prefect Collection repository in Prefect 2.0? Integrations migration-guide , prefect-1-0 , prefect-2-0 , task-library , user-contribution , prefect-collections	0	851	April 22, 2022
Do Prefect base images include extras from the task library e.g. postgres for the Postgres tasks? FAQ prefect-1-0 , task-library , dockerfile , infrastructure , code-dependencies , docker-image , best-practices , base-image , extra_pip_packages	1	472	June 27, 2022
Wrappers for tasks Getting Started prefect-2-0 , task-library	1	308	June 24, 2022
Prefect Collection to run shell commands in your flows: prefect-shell Integrations prefect-2-0 , shell , task-library , async , prefect-collections , prefect_shell	0	831	May 4, 2022
How to integrate Prefect with toloka.ai crowdsourcing data labeling platform for ML pipelines Integrations prefect-1-0 , blog-post , task-library , data-science-workflows	0	217	March 4, 2022
Should all Prefect Collections implement tasks and flows as async? Integrations prefect-2-0 , task-library , async , prefect-collections	0	295	April 26, 2022
Issues using Kubernetes tasks in Prefect 1.0 to implement a persistent service FAQ prefect-1-0 , prefect-2-0 , kubernetes , task-library , real-time-streaming , persistent-service	0	174	April 24, 2022
How can we pause a task until a specified time and how to resume the same task before the timeout with some external triggers Workflow Orchestration task-library	4	317	April 14, 2022
How to use the AWSParametersManager task? Integrations prefect-1-0 , aws , task-library , credentials , aws-parameter-store	0	217	April 12, 2022
How can I use SQLServerExecute task? Integrations prefect-1-0 , task-library , sql-server	0	220	April 12, 2022
I want to create a global temp table in my SQL Server database. Can I use Prefect SqlServerExecute task for it? Integrations prefect-1-0 , task-library , sql-server , load-task	0	278	March 28, 2022
Prefect 1.2 release including Transform.co integration and a new feature to retry your tasks only on specific exception types Announcements prefect-1-0 , release-notes , retries , task-library , exception-handling , transform-co , retry_on	0	215	April 5, 2022
Continuous Data Validation with Great Expectations and Prefect 1.0 - tutorial by Alex Streed Tutorials & Resources prefect-1-0 , task-library , data-quality , great-expectations , data-validation	0	196	March 31, 2022
How to use the SnowflakeQueryTask with the imperative API? Integrations prefect-1-0 , snowflake , imperative-api , task-library	0	191	March 31, 2022
How to send an attachment within an email task? Integrations prefect-1-0 , task-library , email-notifications , email-task	0	195	March 31, 2022
Twilio + Prefect with Dylan Hughes Tutorials & Resources prefect-1-0 , task-library , video-content , twillio	0	172	March 31, 2022
The fourth launch week initiative - Sock Day & Marvin Challenge and release of Prefect 2.0 Collections! Announcements prefect-2-0 , blog-post , task-library , verified-integrations , radar-view , hybrid-execution-model , launch-week , community , prefect-collections , marvin-challenge	0	292	March 17, 2022
Prefect 1.1.0 is out introducing pipe operator for functional chaining, Kubernetes authentication support to HashiCorp Vault, improving idempotency key for mapped subflows, fixing Hasura zombie processes and many task library enhancements! Announcements prefect-1-0 , dag-flow-structure , release-notes , auth-and-permissions , kubernetes , server , task-library , create_flow_run , airbyte , user-contribution , task-decorator , hasura , run-namespaced-job , cube-js	0	245	March 11, 2022
How do I include both data and state dependences in a Prefect flow? Workflow Orchestration prefect-1-0 , state-dependencies , task-library , notifications , data-dependencies , email-notifications	0	225	March 6, 2022
Prefect’s Next Stage Ecosystem: Premier Partnership Program and Verified by Prefect - article by Andrew Black Tutorials & Resources prefect-1-0 , blog-post , task-library , airbyte , artifacts-api , monte-carlo , pagerduty , great-expectations , firebolt , fivetran , verified-integrations	0	168	March 4, 2022
How to Use Prefect and Monte Carlo to Achieve More Reliable Data Pipelines Tutorials & Resources prefect-1-0 , blog-post , task-library , video-content , data-lineage , observability , monte-carlo , data-quality	0	206	March 3, 2022
Prefect demo - by Creative Force Tutorials & Resources prefect-1-0 , blog-post , task-library , user-contribution , getting-started , trello , jupyter-notebook	0	207	March 3, 2022
Any plan to add ECSRunTask to AWS Tasks? Integrations prefect-1-0 , aws , fargate , task-library , ecs	0	241	February 22, 2022
Running R scripts with Prefect Integrations prefect-1-0 , task-library , data-dependencies , data-science-workflows , r	5	989	March 2, 2022
How to contribute to Prefect? Integrations prefect-1-0 , prefect-2-0 , task-library , user-contribution	1	338	February 21, 2022

How to use the task library?

shell , imperative-api , task-library

What is the task library? The Prefect task library is a constantly growing list of pre-defined tasks that provide off-the-shelf functionality for working with a wide range of tools. A majority of the task library is c…

8

1022

June 15, 2022

How to define DAG like flow in Prefect 2.0

Workflow Orchestration

migration-guide , prefect-2-0 , task-library

6

328

December 21, 2022

New dbt recipe allowing you to rerun your dbt DAG from a failed node - by Alex Streed

Tutorials & Resources

prefect-1-0 , dbt , task-library , restarts , customer-success-recipes

3

727

October 3, 2022

Ideas on future dbt integrations with Prefect

Integrations

prefect-1-0 , prefect-2-0 , dbt , task-library

0

424

March 3, 2022

Migrating Databricks Tasks from Prefect 1 to Prefect 2

Tutorials & Resources

migration-guide , prefect-1-0 , prefect-2-0 , blog-post , task-library , databricks , prefect-collections

0

110

August 25, 2022

How to migrate Prefect 1.0 task library tasks to a Prefect Collection repository in Prefect 2.0?

Integrations

migration-guide , prefect-1-0 , prefect-2-0 , task-library , user-contribution , prefect-collections

0

851

April 22, 2022

Do Prefect base images include extras from the task library e.g. postgres for the Postgres tasks?

FAQ

prefect-1-0 , task-library , dockerfile , infrastructure , code-dependencies , docker-image , best-practices , base-image , extra_pip_packages

1

472

June 27, 2022

Wrappers for tasks

Getting Started

prefect-2-0 , task-library

1

308

June 24, 2022

Prefect Collection to run shell commands in your flows: prefect-shell

Integrations

prefect-2-0 , shell , task-library , async , prefect-collections , prefect_shell

0

831

May 4, 2022

How to integrate Prefect with toloka.ai crowdsourcing data labeling platform for ML pipelines

Integrations

prefect-1-0 , blog-post , task-library , data-science-workflows

0

217

March 4, 2022

Should all Prefect Collections implement tasks and flows as async?

Integrations

prefect-2-0 , task-library , async , prefect-collections

0

295

April 26, 2022

Issues using Kubernetes tasks in Prefect 1.0 to implement a persistent service

FAQ

prefect-1-0 , prefect-2-0 , kubernetes , task-library , real-time-streaming , persistent-service

0

174

April 24, 2022

How can we pause a task until a specified time and how to resume the same task before the timeout with some external triggers

Workflow Orchestration

task-library

4

317

April 14, 2022

How to use the AWSParametersManager task?

Integrations

prefect-1-0 , aws , task-library , credentials , aws-parameter-store

0

217

April 12, 2022

How can I use SQLServerExecute task?

Integrations

prefect-1-0 , task-library , sql-server

0

220

April 12, 2022

I want to create a global temp table in my SQL Server database. Can I use Prefect SqlServerExecute task for it?

Integrations

prefect-1-0 , task-library , sql-server , load-task

0

278

March 28, 2022

Prefect 1.2 release including Transform.co integration and a new feature to retry your tasks only on specific exception types

Announcements

prefect-1-0 , release-notes , retries , task-library , exception-handling , transform-co , retry_on

0

215

April 5, 2022

Continuous Data Validation with Great Expectations and Prefect 1.0 - tutorial by Alex Streed

Tutorials & Resources

prefect-1-0 , task-library , data-quality , great-expectations , data-validation

0

196

March 31, 2022

How to use the SnowflakeQueryTask with the imperative API?

Integrations

prefect-1-0 , snowflake , imperative-api , task-library

0

191

March 31, 2022

How to send an attachment within an email task?

Integrations

prefect-1-0 , task-library , email-notifications , email-task

0

195

March 31, 2022

Twilio + Prefect with Dylan Hughes

Tutorials & Resources

prefect-1-0 , task-library , video-content , twillio

0

172

March 31, 2022

The fourth launch week initiative - Sock Day & Marvin Challenge and release of Prefect 2.0 Collections!

Announcements

prefect-2-0 , blog-post , task-library , verified-integrations , radar-view , hybrid-execution-model , launch-week , community , prefect-collections , marvin-challenge

0

292

March 17, 2022

Prefect 1.1.0 is out introducing pipe operator for functional chaining, Kubernetes authentication support to HashiCorp Vault, improving idempotency key for mapped subflows, fixing Hasura zombie processes and many task library enhancements!

Announcements

prefect-1-0 , dag-flow-structure , release-notes , auth-and-permissions , kubernetes , server , task-library , create_flow_run , airbyte , user-contribution , task-decorator , hasura , run-namespaced-job , cube-js

0

245

March 11, 2022

How do I include both data and state dependences in a Prefect flow?

Workflow Orchestration

prefect-1-0 , state-dependencies , task-library , notifications , data-dependencies , email-notifications

0

225

March 6, 2022

Prefect’s Next Stage Ecosystem: Premier Partnership Program and Verified by Prefect - article by Andrew Black

Tutorials & Resources

prefect-1-0 , blog-post , task-library , airbyte , artifacts-api , monte-carlo , pagerduty , great-expectations , firebolt , fivetran , verified-integrations

0

168

March 4, 2022

How to Use Prefect and Monte Carlo to Achieve More Reliable Data Pipelines

Tutorials & Resources

prefect-1-0 , blog-post , task-library , video-content , data-lineage , observability , monte-carlo , data-quality

0

206

March 3, 2022

Prefect demo - by Creative Force

Tutorials & Resources

prefect-1-0 , blog-post , task-library , user-contribution , getting-started , trello , jupyter-notebook