Zheng Cheng
06/25/2022, 4:30 PMprefect orion start
, mainly that this web UI doesn’t require login or other form of authentication. I can’t just deploy and allow anyone on the internet can visit that.yu zeng
06/26/2022, 12:21 PMJean-Paul Berthelot
06/26/2022, 1:04 PMRayTaskRunner
versus DaskTaskRunner
,
I have a requirement to develop a Prefect Workflow for a high volume ingestion workflow. The architecture I am looking at is based on Data Mesh.
I have a local environment and worked through several POCs similar to the workflow described here.
Could I please be directed to relevent reading materials or examples?Dekel R
06/26/2022, 2:07 PMJames Phoenix
06/26/2022, 4:09 PMJames Phoenix
06/26/2022, 4:09 PMJames Phoenix
06/26/2022, 4:10 PMJames Phoenix
06/26/2022, 4:10 PMJames Phoenix
06/26/2022, 4:37 PMibrahem
06/26/2022, 6:37 PMAlfred Martinez
06/26/2022, 8:47 PMJovan Sakovic
06/26/2022, 9:53 PMBen Muller
06/27/2022, 3:03 AMSurya
06/27/2022, 9:07 AMMarius Haberstock
06/27/2022, 9:23 AMMichal Zawadzki
06/27/2022, 9:30 AMwhile True:
if x:
my_task()
And deploy & manage as usual?Zheng Cheng
06/27/2022, 10:10 AMredsquare
06/27/2022, 11:33 AMwonsun
06/27/2022, 12:06 PMGuoying Qi
06/27/2022, 12:12 PMprefect storage delete my-s3-storage
Naga Sravika Bodapati
06/27/2022, 12:38 PMNaga Sravika Bodapati
06/27/2022, 12:39 PMNaga Sravika Bodapati
06/27/2022, 12:39 PMNaga Sravika Bodapati
06/27/2022, 12:39 PMGuoying Qi
06/27/2022, 1:09 PMBucket name must match the regex "^[a-zA-Z0-9.\-_]{1,255}$" or be an ARN matching the regex "^arn:(aws).*:(s3|s3-object-lambda):[a-z\-0-9]*:[0-9]{12}:accesspoint[/:][a-zA-Z0-9\-.]{1,63}$|^arn:(aws).*:s3-outposts:[a-z\-0-9]+:[0-9]{12}:outpost[/:][a-zA-Z0-9\-]{1,63}[/:]accesspoint[/:][a-zA-Z0-9\-]{1,63}$"
Zheng Cheng
06/27/2022, 1:33 PMZheng Cheng
06/27/2022, 1:39 PMZheng Cheng
06/27/2022, 1:42 PMZheng Cheng
06/27/2022, 1:43 PMZheng Cheng
06/27/2022, 2:18 PMZheng Cheng
06/27/2022, 2:18 PMKevin Kho
06/27/2022, 3:32 PMZheng Cheng
06/27/2022, 3:37 PM