Ignore specific parameters from a flow

Help
1

Hi, I have a flow, and one of the parameters entering the flow is an output of “readlines()”, therefore I’m getting HUGE records in the orion database - a file can be up to 20-30mb each, so the content of the file is written as a parameter in Orion, and it looks like so:

image
image445×526 57.5 KB

Is there a way to ignore specific parameters? if no, is there a workaround? or I should read the file inside the flow.

2

no

you can store that JSON as a file in S3 and reference the S3 object location as a single parameter to your flow