Topics tagged local-development

Topic	Replies	Views	Activity
Setting Up Prefect 2 Locally using venv - by John Enquist Tutorials & Resources prefect-2-0 , local-development , user-contribution , venv	0	94	February 21, 2023
Profile and order of Python Imports not being recognized when running Deployments Getting Started prefect-2-0 , local-development , deployment , troubleshooting	7	359	January 23, 2023
[Prefect - Airbyte - Error] ssl.SSLSyscallError: Some I/O error occurred (_ssl.c:997) and anyio.BrokenResourceError Usage Questions prefect-2-0 , local-development , deployment , task-runner , docker , airbyte , failure , troubleshooting , getting-started	13	287	December 21, 2022
How to use Prefect `sync_compatible` functions in Jupyter Usage Questions prefect-2-0 , local-development	3	182	December 1, 2022
How to set a different task runner for dev vs. prod (e.g. to use Dask only in prod)? DataflowOps for Prefect 2.0 prefect-2-0 , local-development , task-runner , environments	0	242	October 11, 2022
Does Prefect 2.0 support filters and adjustments e.g. to restrict the schedule to only run during business hours? Workflow Orchestration migration-guide , prefect-2-0 , local-development , scheduling , interval-schedule , cron , unit-testing , rrule	0	405	April 29, 2022
How can I inspect the flow run states locally? Getting Started migration-guide , prefect-1-0 , prefect-2-0 , local-development , getting-started	2	519	July 21, 2022
Guide for testing out KubernetesFlowRunner locally Tutorials & Resources prefect-2-0 , local-development , kubernetes , kubernetes-flow-runner	0	217	July 1, 2022
Docker compose to run Prefect 2.0 locally with Postgres Tutorials & Resources prefect-2-0 , local-development , docker , user-contribution , infrastructure , postgres , docker-compose , orion-api-server	0	566	May 14, 2022
Debugging Prefect flows with breakpoints in Visual Studio Code (VSCode) FAQ prefect-1-0 , local-development , troubleshooting , debugging	0	436	May 4, 2022
How to print the next 10 scheduled dates to validate my schedule is set up correctly? Workflow Orchestration prefect-2-0 , local-development , scheduling , async , cron , unit-testing , rrule	0	207	April 29, 2022
How to properly manage external code dependencies in a Prefect 1.0 flow? Workflow Orchestration prefect-1-0 , local-development , code-dependencies , environments , repository-structure	5	1238	April 8, 2022
How can I debug local flow runs? Workflow Orchestration prefect-1-0 , prefect-2-0 , local-development , exception-handling , troubleshooting , debugging	0	222	March 16, 2022
How can I force Prefect to use Cloud secrets rather than the local secrets? FAQ prefect-1-0 , local-development , secrets , environment-variable	0	556	January 31, 2022
What is the difference between a DaskExecutor and a LocalDaskExecutor? Distributed Computing prefect-1-0 , local-development , dask , parallel-processing , local-dask-executor , dask-executor , kube-cluster	0	1083	February 25, 2022
How can I start a local flow run? Getting Started migration-guide , prefect-1-0 , prefect-2-0 , local-development , getting-started	0	262	January 24, 2022
How to cancel a flow run? FAQ prefect-1-0 , local-development , ui , cancellation , getting-started	0	294	February 25, 2022
How to use PrefectSecret with (Azure) Task Library and what are the differences between secrets in a module vs. Flow scope? Integrations prefect-1-0 , dag-flow-structure , local-development , cloud-1-0 , secrets , azure , build-time-vs-runtime	2	237	February 24, 2022
How to sequentially loop several cleanup tasks over a set of files to process for ETL Workflow Orchestration prefect-1-0 , dag-flow-structure , local-development , elt , mapping , looping , sequential-processing , etl	2	371	February 24, 2022
Orchestrating ELT on Kubernetes with Prefect, dbt, & Snowflake (Part 2) Tutorials & Resources prefect-1-0 , local-development , snowflake , parameters , dbt , elt , kubernetes , aws , ci-cd , blog-post , docker , state-dependencies , secrets , dockerfile , triggers , kubernetes-run , kubernetes-agent , github-storage , ecr , aws-eks , circle-ci	0	611	January 21, 2022
How can I define a flow? Getting Started migration-guide , prefect-1-0 , prefect-2-0 , dag-flow-structure , local-development , getting-started , basics	3	947	February 17, 2022
How to disable schedule when running flows locally with flow.run()? FAQ prefect-1-0 , local-development , scheduling	0	198	February 15, 2022
What's the relationship between the agent, executor, storage and FlowRunner and how do they affect local vs. backend-based flow run execution? Workflow Orchestration prefect-1-0 , local-development , backend , flow-runner , executor , agent	0	328	February 10, 2022
When starting a local agent, I got a python-box error "AttributeError: 'Config' object has no attribute 'datefmt'" FAQ prefect-1-0 , local-development , code-dependencies , troubleshooting , local-agent	0	641	February 4, 2022
My pylint checks fail with "Unexpected keyword argument 'upstream_tasks' in function call" - how can I disable it? FAQ prefect-1-0 , local-development , pylint	0	209	February 3, 2022
Flow of Flows - Orchestrating ELT with Prefect and dbt Tutorials & Resources prefect-1-0 , local-development , dbt , elt , flow-of-flows , blog-post	0	257	January 21, 2022

Setting Up Prefect 2 Locally using venv - by John Enquist

Tutorials & Resources

0

94

February 21, 2023

Profile and order of Python Imports not being recognized when running Deployments

Getting Started

prefect-2-0 , local-development , deployment , troubleshooting

7

359

January 23, 2023

[Prefect - Airbyte - Error] ssl.SSLSyscallError: Some I/O error occurred (_ssl.c:997) and anyio.BrokenResourceError

Usage Questions

prefect-2-0 , local-development , deployment , task-runner , docker , airbyte , failure , troubleshooting , getting-started

13

287

December 21, 2022

How to use Prefect `sync_compatible` functions in Jupyter

Usage Questions

prefect-2-0 , local-development

3

182

December 1, 2022

How to set a different task runner for dev vs. prod (e.g. to use Dask only in prod)?

DataflowOps for Prefect 2.0

prefect-2-0 , local-development , task-runner , environments

0

242

October 11, 2022

Does Prefect 2.0 support filters and adjustments e.g. to restrict the schedule to only run during business hours?

Workflow Orchestration

migration-guide , prefect-2-0 , local-development , scheduling , interval-schedule , cron , unit-testing , rrule

0

405

April 29, 2022

How can I inspect the flow run states locally?

Getting Started

migration-guide , prefect-1-0 , prefect-2-0 , local-development , getting-started

2

519

July 21, 2022

Guide for testing out KubernetesFlowRunner locally

Tutorials & Resources

prefect-2-0 , local-development , kubernetes , kubernetes-flow-runner

0

217

July 1, 2022

Docker compose to run Prefect 2.0 locally with Postgres

Tutorials & Resources

prefect-2-0 , local-development , docker , user-contribution , infrastructure , postgres , docker-compose , orion-api-server

0

566

May 14, 2022

Debugging Prefect flows with breakpoints in Visual Studio Code (VSCode)

FAQ

prefect-1-0 , local-development , troubleshooting , debugging

0

436

May 4, 2022

How to print the next 10 scheduled dates to validate my schedule is set up correctly?

Workflow Orchestration

prefect-2-0 , local-development , scheduling , async , cron , unit-testing , rrule

0

207

April 29, 2022

How to properly manage external code dependencies in a Prefect 1.0 flow?

Workflow Orchestration

prefect-1-0 , local-development , code-dependencies , environments , repository-structure

5

1238

April 8, 2022

How can I debug local flow runs?

Workflow Orchestration

prefect-1-0 , prefect-2-0 , local-development , exception-handling , troubleshooting , debugging

0

222

March 16, 2022

How can I force Prefect to use Cloud secrets rather than the local secrets?

FAQ

prefect-1-0 , local-development , secrets , environment-variable

0

556

January 31, 2022

What is the difference between a DaskExecutor and a LocalDaskExecutor?

Distributed Computing

prefect-1-0 , local-development , dask , parallel-processing , local-dask-executor , dask-executor , kube-cluster

0

1083

February 25, 2022

How can I start a local flow run?

Getting Started

migration-guide , prefect-1-0 , prefect-2-0 , local-development , getting-started

0

262

January 24, 2022

How to cancel a flow run?

FAQ

prefect-1-0 , local-development , ui , cancellation , getting-started

0

294

February 25, 2022

How to use PrefectSecret with (Azure) Task Library and what are the differences between secrets in a module vs. Flow scope?

Integrations

prefect-1-0 , dag-flow-structure , local-development , cloud-1-0 , secrets , azure , build-time-vs-runtime

2

237

February 24, 2022

How to sequentially loop several cleanup tasks over a set of files to process for ETL

Workflow Orchestration

prefect-1-0 , dag-flow-structure , local-development , elt , mapping , looping , sequential-processing , etl

2

371

February 24, 2022

Orchestrating ELT on Kubernetes with Prefect, dbt, & Snowflake (Part 2)

Tutorials & Resources

prefect-1-0 , local-development , snowflake , parameters , dbt , elt , kubernetes , aws , ci-cd , blog-post , docker , state-dependencies , secrets , dockerfile , triggers , kubernetes-run , kubernetes-agent , github-storage , ecr , aws-eks , circle-ci

0

611

January 21, 2022

How can I define a flow?

Getting Started

migration-guide , prefect-1-0 , prefect-2-0 , dag-flow-structure , local-development , getting-started , basics

3

947

February 17, 2022

How to disable schedule when running flows locally with flow.run()?

FAQ

prefect-1-0 , local-development , scheduling