About the Getting Started category

[anna_geller]

New to Prefect? This category covers all the basics to get you started. There are no stupid questions - the first step is always the hardest.

[jimmy_shue]

Hi, I’m a data analyst/scientist that is looking into some data automation solutions. Let’s say I create an ETL process that extracts data from an external database and save it to a SQLite database on my laptop. If I create this local flow and want it to run every day, does that require my computer to be on all of the time? Or is that not an issue if I register the flow to Prefect Cloud?

[anna_geller]

Only your agent/execution layer needs to be on 24/7. If you want to do that just for a hobby project, this post may help for Prefect 1.0:

What type of agent can I set up quickly to execute flow runs on a remote machine (e.g. public cloud)?

It’s hard to give a clear single answer since it depends on what infrastructure and cloud provider your company/team is using. All agents are straightforward to set up and can be started using the command prefect agent TYPE start --label YOUR_LABEL -k YOUR_API_KEY , where TYPE indicates one of the agent types: local docker kubernetes ecs vertex. You could e.g. spin up a small AWS EC2 instance with a local or docker agent to get started. We also provide ready-made Azure resources to make it e…

For Prefect 2.0, we will publish some more tutorials in the future, but for now, you may try deploying it with Kubernetes as shown here:

Prefect 2.0 and Prefect Cloud 2.0 - Overview and Work Queues

[jimmy_shue]

Thank you! I will look into this further.