Sumant Agnihotri07/17/2020, 7:34 AM
def main(): # list of arguments ls = [1,2,3,4] # start a thread for calculate method for each arg in ls for each in ls: thread(each) def thread(arg): t = threading.Thread(target=calculate, args=(arg)) t.start() def calculate(*args): # does time consuming calculations and pushes the result in the db
method in a python thread, so that multiple threads can run the calculations. Issue is, if
is too long, I crash the server (maybe due to too many threads). I want to do this using prefect-dask, but I'm not sure how to do it, or where to look for examples. Any help will be much appreciated. Thanks.
josh07/17/2020, 11:24 AM