I’m getting an error “File system ... could not be created. You are likely missing a Python module required to use the given storage protocol” - how to solve that?

There are several ways you can solve that problem:

  1. Install the required file-system subpackage in your environment, e.g.:
pip install s3fs
pip install gcsfs
pip install adlfs
  1. Include it as environment variable called EXTRA_PIP_PACKAGES - works only for DockerContainer block - docs

  2. Build a custom image with those dependencies - you can use this GitHub Actions workflow template to build and push such custom DockerHub image in a single click:

https://github.com/anna-geller/prefect-deployments/blob/master/.github/workflows/docker_image.yaml

You can configure and trigger the image build process directly from the GitHub Actions UI:

1 Like