Suchindra02/16/2021, 11:24 PM
from stdlib. How can I configure it to capture logs from within prefect tasks?
itay livni02/16/2021, 11:30 PM
in a task with a loop signal? My concern is that with
the enviroment (including modules) will be "re-initialized" on every loop. But maybe that will happen with recursion also? -- In short is the effort of trying to build a recursive Flow worth the effort from a speed perspective? (Currently running into different issues). Thanks
matta02/17/2021, 4:11 AM
Sven Teresniak02/17/2021, 9:40 AM
because this is the default behaviour. but when you're creating a tenant a 2nd time (same name and slug) you will get an exception and return value 1 from the prefect cli. it seems
Harshal Rane02/17/2021, 9:51 AM
Attached are logs from Docker agent Has anyone faced this issue before?
Failed to load and execute Flow's environment: ModuleNotFoundError("No module named '/root/'")
Michael Hadorn02/17/2021, 10:04 AM
Jonathan Wright02/17/2021, 10:51 AM
Milly gupta02/17/2021, 1:34 PM
Josselin Girault02/17/2021, 2:37 PM
Matthew Blau02/17/2021, 2:40 PM
Puja Thacker02/17/2021, 3:29 PM
Nikul02/17/2021, 4:35 PM
Ajith Kumara Beragala Acharige Lal02/17/2021, 5:57 PM
, the Prefect server also deployed to the kubernetes via Helm, now need to try-out a flow on that Prefect-server, does anyone has example/page?
Tobias Heintz02/17/2021, 8:26 PM
Fina Silva-Santisteban02/18/2021, 1:27 AM
in a terminal, and then use the prefect dashboard to trigger that run. I’d like to build a standalone app, so have a custom GUI that lets a user input flow parameters and trigger a flow run. I’m imagining that I’ll have to create a prefect ecs agent using the prefect api instead of running it in a separate terminal but I’m not sure how to go about that. Pls let me know of any deployment recipes that fit my use case! 🙏
prefect ecs agent
Puja Thacker02/18/2021, 7:45 AM
Puja Thacker02/18/2021, 7:46 AM
Julian02/18/2021, 10:31 AM
, but they don't provide any actual value. Since it is quite nice (from ui perspective) to have meaningful names, we rename these flowruns during runtime like
. However, if a flowrun fails before executing the rename task, it won't have this "nice" name but the orignal (meaning-less) name. Also, renaming inside the flow will also overwrite flowrun names which were provided when manually starting a flowrun with name, e.g. from ui.
Milly gupta02/18/2021, 11:47 AM
Siva Kumar02/18/2021, 2:57 PM
Joël Luijmes02/18/2021, 2:59 PM
tasks = dynamic_list_of_tasks() windowed_tasks = fixed_window(tasks, window_size=5) def process_item(item): x = task_1() task_2(x) def process_window(tasks): apply_map(process_item, tasks) apply_map(process_window, windowed_tasks)
Jean-Marc LE FEVRE02/18/2021, 3:04 PM
Jean-Marc LE FEVRE02/18/2021, 3:05 PM
Karolína Bzdušek02/18/2021, 5:43 PM
flow.storage = GitHub(repo="cividi/gemeinde_workflows",path="/workflows/residential_density.py",access_token_secret="GITHUB_ACCESS_TOKEN")
is stored in secret in Cloud. However, when I run flow through UI, I am still getting this and not sure why. Note: repository is private and own by our team, I am using token generated under my account. What I am missing? Thanks for your help in advance.
Craig Wright02/18/2021, 8:08 PM
. If anyone is even vaguely interested in more deterministic Fivetran scheduling, please reach out! https://prefect-community.slack.com/archives/CL09KTZPX/p1613678832100000
Sean Talia02/18/2021, 9:22 PM
task before? I'm just starting to play around with it and am curious as to exactly what actions i'm going to need to include in my iam policy allow list for the host on which the task will execute (besides obviously the
matta02/18/2021, 10:43 PM
Ajith Kumara Beragala Acharige Lal02/19/2021, 1:31 AM
i get this error
prefect auth create-token -n my-runner-token -s RUNNER
matta02/19/2021, 4:31 AM
for flows in there, and it launches even when I don't specify an image (which is awesome!). Just out of curiosity, what exactly am I launching? Is it the same image as the container of the JupyterHub instance?