David Evans
04/28/2022, 11:58 AMprefecthq:prefect
? or would it just need python:3
?) for each flow? And I guess these docker images would run pip install -r requirements.txt
as a build layer. But if we can achieve this with a virtual environment instead I think that would be preferable (I'm thinking in terms of the flow needed for an engineer to try something out by pushing it to the runner from their local machine)
(I can see the high-level concept here but I'm struggling to see how it will look in practice for the various use-cases)davzucky
04/28/2022, 11:58 AMBaris Cekic
04/28/2022, 12:49 PMChris Reuter
04/28/2022, 1:02 PMxyzz
04/28/2022, 1:13 PMAmruth VVKP
04/28/2022, 2:11 PMJoshua Greenhalgh
04/28/2022, 2:12 PMDavid Evans
04/28/2022, 2:35 PMBob Colner
04/28/2022, 3:04 PMPhilip MacMenamin
04/28/2022, 3:36 PMfrom prefect import task, Flow
from typing import Tuple
@task
def double_and_triple(x: int) -> Tuple[int, int]:
return x * 2, x * 3
with Flow("This works") as flow:
a = [1,2,3]
double, triple = double_and_triple.map(x=a)
Geoffrey Keating
04/28/2022, 3:48 PMValueError: [TypeError("'_thread.RLock' object is not iterable"), TypeError('vars() argument must have __dict__ attribute')]
Code to reproduce in thread
Prefect 1.3 didn't seem to care about loggers being a part of a class used in a flow - any patterns worth adopting to replace this or does this merit a fix?Chris Reuter
04/28/2022, 5:19 PMChris Reuter
04/28/2022, 6:45 PMAlex Rogozhnikov
04/28/2022, 6:52 PMThere is also support in ``ECSCluster`` for GPU aware Dask clusters. To do
this you need to create an ECS cluster with GPU capable instances (from the
``g3``, ``p3`` or ``p3dn`` families) and specify the number of GPUs each worker task
should have.
Amruth VVKP
04/28/2022, 7:46 PMTom Manterfield
04/28/2022, 8:41 PMinvalid duration format
errors showing up in my Orion API, just checking if this is a bug or misconfig on my part?Greg Wyne
04/28/2022, 10:19 PMMatthew Roeschke
04/28/2022, 10:21 PMmap
. I added max_retries
to this task I got this Userwarning I don’t really know how to addressed based on the link. I thought I could pass the results from a functional task to another task?
UserWarning: Task <...> has retry settings but some upstream dependencies do not have result types. See <https://docs.prefect.io/core/concepts/results.html> for more details.
Izu
04/29/2022, 10:19 AMfrom my_module import my_function
within the flow script. Now here’s the thing; I have registered the flow and started my local agent. When I try to trigger the job to run from the prefect UI, I get the message:
Failed to load and execute flow run: FlowStorageError('An error occurred while unpickling the flow:\n ModuleNotFoundError("No module named \'extract_strings\'")\nThis may be due to a missing Python module in your current environment. Please ensure you have all required flow dependencies installed.')
The `extract_strings`function is defined in another module in the same director.
Can anyone help?Florian Guily
04/29/2022, 10:26 AMVivek Kaushal
04/29/2022, 1:19 PMAmruth VVKP
04/29/2022, 1:29 PMTim Wright
04/29/2022, 1:43 PMWilliam Durksen
04/29/2022, 2:19 PMConstantino Schillebeeckx
04/29/2022, 2:24 PMFilterTask
with my own filter func, does the task still filter out the default NoResult
None
and exceptions?Florian Guily
04/29/2022, 2:58 PMGreg Wyne
04/29/2022, 5:38 PMek
04/29/2022, 5:39 PMMadison Schott
04/29/2022, 5:42 PMJonathan Seery
04/29/2022, 8:08 PM