There are a couple of payload size limits that are relevant for Prefect Cloud:
-
Apollo (which handles all our requests) has a limit of 5MB per request.
-
Individual routes may also have size limits. The purpose of these limits is usually to control the size of data we write to the backend database. Examples:
- set_task_run_states - 1 MB (you shouldn’t store arbitrary data in states, that’s what results are for)
- set_key_value - 10 kb (since the KV Store is meant for small pieces of metadata/references)