There are several ways you can solve that problem:
- Install the required file-system subpackage in your environment, e.g.:
pip install s3fs
pip install gcsfs
pip install adlfs
-
Include it as environment variable called
EXTRA_PIP_PACKAGES
- works only forDockerContainer
block - docs -
Build a custom image with those dependencies - you can use this GitHub Actions workflow template to build and push such custom DockerHub image in a single click:
https://github.com/anna-geller/prefect-deployments/blob/master/.github/workflows/docker_image.yaml
You can configure and trigger the image build process directly from the GitHub Actions UI: