Hi, am migrating my pipelines from v1 to v2. Each of the tasks returns large amount of data, so movement of data from task to task is quite slow. I noticed that the results are being stored in the local storage n if I am right thats why its so slow, i removed that setting in v1 (dont really remember how) n was wondering if such an option is available in v2

Hi Nikhil, great question! The ability to change how task results are persisted is currently being worked on by our engineers and should be available before the end of the quarter. I’m not sure on the best workaround in the meantime, but I’ll try to see if someone else knows.

uh oh, guess ill postpone the migration for awhile