what is the best way to track flow metadata? Im looking for a way to track arguments and times of main flows

You mind if I pull on this thread more? Is there a problem behind this problem you’re trying to solve - super interested in your use case

Sure! My main purpose is troubleshooting and improving efficiency. For example, I ingest a lot of data from public API's. I want to find the throughput for each endpoint (producer) and log the flow params and execution time, number of requests. Let the params be the flow inputs (batch size, subflow_interval, exponential_backoff_factor for each request, etc). Do several experiments where you run through a feasible param space

batch_size = randint(10,50), subflow_interval = (60, 600), etc

Depending on the number of runs and my param space, I can do some data augmentation as well.