Is it possible to persistently annotate/attach metadata to a successful deployment run in Prefect with metadata or should I use storage for that?
We use Prefect to asynchronously launch a short-lived workflow (<1min) from a Node.js backend.
This allows us to free the Node.js backend from being blocked.
The output of this workflow is a simple JSON with an array of key-value pairs.
We would like to be able to return the result of this JSON in the simplest possible way.
What’s the best practice here?
AFAICT there are 3 options:
1. Persist the result into a database from the workflow
2. Persist the result into a storage
3. Annotate the deployment run / attach metadata to the deployment run using Prefect SDK
If option (3) exists it would be great, less responsibilities on the application side of things to setup the database, persist the data and then apply garbage collection to stale data (e.g. when deployments get deleted, we need to do a cascaded delete where the JSON body also needs to be wiped out).
Your thoughts? Thanks!