Miguel Silva
02/14/2024, 7:22 PMfetch_catalog_data.serve(name="vinted-catalog_ids",
tags=["staging", "extraction", "api", "catalog_ids"],
pause_on_shutdown=False,
interval=60*60*24)
fetch_data_from_vinted.serve(name="vinted-v1",
tags=["staging", "extraction", "api"],
parameters={"sample_frac": 0.001,
"batch_size": 500,
"nbrRows": 500,
"item_ids": [221, 1242, 2320, 1811, 267, 1812, 98, 246, 287, 2964] # [t shirts, trainers, sweaters, books, hoodies and sweaters, zip hoodies, sunglasses, backpacks, caps, gorros]
},
pause_on_shutdown=False,
interval=3600)
fetch_brands_from_vinted.serve(name="vinted-brands",
tags=["brands", "staging", "extraction", "api"],
pause_on_shutdown=False,
interval=60*60*24)
(etc...)
I have been using serve to deploy multiple flows but with increasing workload I need a better and easier way to deploy all flows from one deployment. How can I do this?
I'm running locallyNate
02/14/2024, 8:44 PMserve
method that accepts an iterable of flowsNate
02/14/2024, 8:49 PMserve
with many flows at onceMiguel Silva
02/14/2024, 10:02 PMNate
02/14/2024, 10:02 PMMiguel Silva
02/14/2024, 10:50 PMNate
02/14/2024, 10:51 PM