Sean Talia
02/16/2022, 4:12 PMKevin Kho
Sean Talia
02/16/2022, 4:23 PMBy default the number of threads or processes used is equal to the number of cores available.
, so if Fargate is giving it access to 2 vCPUs my assumption was that it would just infer that num_workers=2
is the appropriate thing to doKevin Kho
Sean Talia
02/16/2022, 4:51 PMKevin Kho
year/month/day.csv
and you are right to read these one at a time?Sean Talia
02/16/2022, 5:43 PM/year/month/day/hour/
prefixesKevin Kho
Sean Talia
02/17/2022, 3:12 PMKevin Kho