How to package a common task library into a Docker image and use it in my run configuration

[anna_geller]

To execute your flow run as a docker container, you would need to use DockerRun run configuration and a Docker agent. For various configurations of storage and run configurations, check out this repository:

GitHub - anna-geller/packaging-prefect-flows: Examples of various flow...

And for more background on this error, check this Discourse topic:

When I run my flow, I see an error: Failed to load and execute Flow's environment: ModuleNotFoundError("No module named '/Users/username'"). What is happening?

In Prefect 1.0, there is a distinction between build time and runtime: When a flow is registered (i.e. at build time), Prefect stores the location of the flow in Storage ( GitHub , S3 , Docker , etc.) when using a flow stored_as_script=True or the pickled Flow object when using pickle storage. For more about pickle vs script storage, check out: Storage | Prefect Docs During a flow run execution (i.e. at runtime), Prefect pulls the flow from the storage location and runs it. 1. Registering t…

This post may also help:

The Simple Guide to Productionizing Data Workflows with Docker

LMK, if you still have any questions after reading this, happy to explain more.