Prefect Collection for interacting with AWS in your flows: prefect-aws

Docs

https://prefecthq.github.io/prefect-aws/

Code

Examples

from prefect import flow
from prefect_aws import s3_upload

@flow
def example_s3_upload_flow():
    aws_credentials = AwsCredentials(
        aws_access_key_id="acccess_key_id",
        aws_secret_access_key="secret_access_key"
    )
    with open("data.csv", "rb") as file:
        key = s3_upload(
            bucket="bucket",
            key="data.csv",
            data=file.read(),
            aws_credentials=aws_credentials,
        )

example_s3_upload_flow()
1 Like

Starting today, there are new AWS Blocks!

To register those, use:

pip install prefect-aws
prefect block register -m prefect_aws.credentials
prefect block register -m prefect_aws.s3
2 Likes