Brett Naul
10/09/2020, 6:57 PMKrzysztof Nawara
10/09/2020, 7:26 PMall_inputs
cache validator is meant to work.
Cache validator receives 3 arguments, but only 2 of those are relevant here:
- state (State): a `Success` state from the last successful Task run that contains the cache
- inputs (dict): a `dict` of inputs that were available on the last successful run of the cached Task
Now my current understanding (almost certainly incorrect) is that they come from the same run. But then the logic of the validator wouldn't make any sense:
elif getattr(state, "hashed_inputs", None) is not None:
if state.hashed_inputs == {key: tokenize(val) for key, val in inputs.items()}:
return True
else:
return False
elif {key: res.value for key, res in state.cached_inputs.items()} == inputs:
return True
It just compares inputs passed directly to validator to inputs extracted from the state.
So it's pretty clear those 2 arguments can come from different runs, but I don't understand how is that possible. If someone could provide an explenation I'd be very grateful 🙂Krzysztof Nawara
10/09/2020, 8:06 PMprefect.context.map_index
might not be enoughflavienbwk
10/09/2020, 8:45 PMclient.create_project()
to create a project. But each time I get the following error :
requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: <http://xxx.xxx.xxx.xxx:4200/graphq>
My code :
client = Client(api_server="<http://xxx.xxx.xxx.xxx:4200/graphql>")
client.create_project(project_name="weather")
I don't understand what port / URL I should put in Client()
.
Thank you for your help.flavienbwk
10/10/2020, 12:03 AMFailed to load and execute Flow's environment: ModuleNotFoundError("No module named '/root/'")
I don't understand the problem as I don't have any relative import in my code and the latter is pretty simple : https://github.com/flavienbwk/prefect-docker-compose/blob/main/scripts/weather.pyTsang Yong
10/10/2020, 4:20 AMERROR - prefect.FlowRunner | Unexpected error: TypeError('code() takes at most 15 arguments (16 given)')
not sure if it’s a supported mode of operation.Alfie
10/10/2020, 4:45 PMFile ".../.pyenv/versions/alert/lib/python3.8/site-packages/prefect/core/flow.py", line 1608, in register
registered_flow = client.register(
File ".../.pyenv/versions/alert/lib/python3.8/site-packages/prefect/client/client.py", line 734, in register
serialized_flow = flow.serialize(build=build) # type: Any
File ".../.pyenv/versions/alert/lib/python3.8/site-packages/prefect/core/flow.py", line 1451, in serialize
self.storage.add_flow(self)
File ".../.pyenv/versions/alert/lib/python3.8/site-packages/prefect/environments/storage/local.py", line 140, in add_flow
flow_location = flow.save(flow_location)
File ".../.pyenv/versions/alert/lib/python3.8/site-packages/prefect/core/flow.py", line 1520, in save
cloudpickle.dump(self, f)
File ".../.pyenv/versions/alert/lib/python3.8/site-packages/cloudpickle/cloudpickle_fast.py", line 55, in dump
CloudPickler(
File ".../.pyenv/versions/alert/lib/python3.8/site-packages/cloudpickle/cloudpickle_fast.py", line 563, in dump
return Pickler.dump(self, obj)
TypeError: 'NoneType' object is not callable
flavienbwk
10/10/2020, 9:25 PMLeo Meyerovich (Graphistry)
10/10/2020, 10:15 PMLeo Meyerovich (Graphistry)
10/10/2020, 10:15 PMLeo Meyerovich (Graphistry)
10/10/2020, 10:17 PMAlfie
10/11/2020, 3:56 AMale
10/11/2020, 11:47 AMflavienbwk
10/11/2020, 2:26 PMValueError: Interval can not be less than one minute when deploying to Prefect Cloud.
Why was that limit set ? Why can't I decide to schedule a job every second ?flavienbwk
10/11/2020, 4:10 PMAlfie
10/12/2020, 3:51 AMBilly McMonagle
10/12/2020, 11:17 PMJackson Maxfield Brown
10/13/2020, 12:56 AMresults, errors = my_task.safe_map(**iterables)
Rob Fowler
10/13/2020, 9:19 AMRob Fowler
10/13/2020, 9:19 AMRob Fowler
10/13/2020, 9:29 AMNewskooler
10/13/2020, 10:05 AMRob Fowler
10/13/2020, 10:22 AMChirag
10/13/2020, 10:59 AMNewskooler
10/13/2020, 11:36 AMNewskooler
10/13/2020, 1:37 PMVinod Sugur
10/13/2020, 2:17 PM[2020-10-13 13:56:50,113] ERROR - agent | Error while deploying flow: ClientException("An error occurred (ClientException) when calling the RegisterTaskDefinition operation: Invalid setting for container 'flow'. At least one of 'memory' or 'memoryReservation' must be specified.")
. I have followed the sample given the documentation and have defined all the attributes including "memory" and "cpu". Please suggest on the same.Matias Godoy
10/13/2020, 4:08 PMNewskooler
10/13/2020, 4:31 PMEmma Willemsma
10/13/2020, 7:36 PMEmma Willemsma
10/13/2020, 7:36 PMJim Crist-Harif
10/13/2020, 7:55 PMS3
storage, you could use the version as part of the key
, for Docker
storage it could be part of the image_tag
, etc... This will show up in the UI and be stored with the flow as metadata.Emma Willemsma
10/13/2020, 9:31 PM