Baum
09/14/2021, 10:30 AMAlfie
09/14/2021, 1:22 PMAlexander van Eck
09/14/2021, 2:09 PMRaed Shabbir
09/14/2021, 7:15 PMRaed Shabbir
09/15/2021, 6:56 PMConnected to Prefect Server at <http://localhost:4200/graphql>
However the Apollo GraphQL API URL actually is at an external IP.
How would I update this manually on the UI? The getting started tab is not available.
I tried to perform a helm upgrade … --set ui.apolloApiUrl=http://$API_HOST:4200/graphql
the output of this shows
he UI has been configured to point to 'http://<EXTERNAL_IP>:4200/graphql' by default.
which is correct, however when I refer to the UI it still says
Connected to Prefect Server at <http://localhost:4200/graphql>
. How can I ensure this change was made correctly ?YD
09/15/2021, 9:08 PMprefect server stop
and then
prefect server start --detach --use-volume
but it get stuck
$ prefect server start --detach --use-volume
Pulling postgres ... done
Pulling hasura ... done
Pulling graphql ... done
Pulling towel ... done
Pulling apollo ... done
Pulling ui ... done
Creating network "prefect-server" with the default driver
temp_data_processing_postgres_1 is up-to-date
Creating temp_data_processing_hasura_1 ... done
temp_data_processing_graphql_1 is up-to-date
Creating temp_data_processing_towel_1 ... done
Creating temp_data_processing_apollo_1 ... done
Creating temp_data_processing_ui_1 ... done
does not detach
on on the UI I getSam Werbalowsky
09/15/2021, 9:57 PMMichael Hadorn
09/16/2021, 7:25 AMale
09/16/2021, 4:12 PMElliot Oram
09/16/2021, 5:02 PMprefect server start --postgres-port 5433
to start the server (have another postgres instance on my machine hence the port diff) then I get the following error. However despite this and the logs spitting out endless errors the I can still connect agents and register flows and they still work. Any ideas how I can fix this?Tom Baldwin
09/17/2021, 12:29 AMJames Geiger
09/17/2021, 6:26 PMNivi Mukka
09/17/2021, 8:26 PMdask_gateway.client.GatewayClusterError: Cluster 'dask-gateway.227aa200f55a45a091b3cf6a0d037563' failed to start, see logs for more information
Diego Alonso Roque Montoya
09/17/2021, 11:24 PMgayle tan
09/20/2021, 3:42 AM[server]
endpoint = "<http://myserver.name/backend>"
[server.ui]
endpoint = "<http://myserver.name/>"
apollo_url= "http:/myserver.name/backend"
[ui]
endpoint = "<http://myserver.name>"
Alexander van Eck
09/20/2021, 2:00 PMPierre Monico
09/21/2021, 5:13 PMdocker pull myregistry/myimage:latest
from the VM works flawlessly), yet I can’t run my flows since I get a 500:
500 Server Error for <http+docker://localhost/v1.41/images/create?tag=latest&fromImage=myregistry%2Fmyimage>: Internal Server Error ("Head <https://myregistry/v2/myimage/manifests/latest>: unauthorized: authentication required, visit <https://aka.ms/acr/authorization> for more information.")
My registry is on Azure Container Registries and from the VM I am properly logged in and can pull the image. Does the agent need some sort of additional authentication?Nivi Mukka
09/21/2021, 5:32 PMRob Douglas
09/21/2021, 6:06 PMFlow
(runs daily on a Schedule
with a CronClock
). I'd like to generate names of a particular format for the runs. (Rather than the defaulted random word-pair names). Is that something I can do programmatically as part of the Flow
object? Can I use a callable to some parameter of the flow to determine run names? Any help is appreciated!Nivi Mukka
09/21/2021, 6:49 PMmap
method under Flow to run the same task in parallel for different inputs. It is working fine but not using all the Dask workers, which is causing Dask to run into resource/communication errors. How can I tell Prefect flow to run only one mapped task per worker?Joe McDonald
09/21/2021, 8:43 PMserver.keepAliveTimeout = 61 * 1000;
server.headersTimeout = 65 * 1000; // This should be bigger than `keepAliveTimeout + your server's expected response time`
Nivi Mukka
09/21/2021, 11:00 PMresult
parameter in the @task decorator for defining tasks in a flow script mandatory? I am using the gcs_result
method to save the task results but running into a weird error when its a mapped task trying to write results at the same time I think. this never happened before.Andreas Eisenbarth
09/22/2021, 9:13 AMcreate_flow_run
task always fails when we use it with map
. Also, the log does not contain any exceptions or reasons for errors.
• Are we doing something wrong or is it a bug?
• How can we get full logs of the tasks that are run within create_flow_run? (in parent_flow_succeeding)
• The prefect UI shows no runs (zero count, no run history) for parent_flow_succeeding although it was run, it only shows runs for child_flow.Alexey Gorchakov
09/22/2021, 9:44 AMHugo Polloli
09/22/2021, 9:46 AMpython -m http.server 8080
and it worked perfectly fine) so it seems to be an issue with prefect server, the thing is I changed absolutely nothing, when the server is running, I can do a wget localhost:8080
or wget 0.0.0.0:8080
and get the prefect UI html with no issue, same thing, I can register a flow with no issue. It simply seems to be a connectivity issue between the outside world and my prefect server, despite both 8080 and 4200 ports being opened on EC2Gareth Allen
09/23/2021, 7:21 AMTraceback (most recent call last):
File "/usr/local/bin/prefect", line 8, in <module>
sys.exit(cli())
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/prefect/cli/execute.py", line 49, in flow_run
result = client.graphql(query)
File "/usr/local/lib/python3.8/site-packages/prefect/client/client.py", line 311, in graphql
raise AuthorizationError(result["errors"])
Any ideas?Mohamed Hajji
09/23/2021, 9:43 AMSam Werbalowsky
09/23/2021, 11:09 PMflows
|____my_flow.py
|____my_tasks.py
|___helpers.py
I am getting Failed to load and execute Flow's environment: ModuleNotFoundError("No module named 'my_tasks'")
when trying to run the flow in my_flow
. I have a feeling that what’s happening is the my_tasks
file only lives on the Agent or Job Pod, and not the Dask pods…any way around this?Yury Alexandrov
09/26/2021, 7:34 AMkojisuganuma.dog
09/26/2021, 6:55 PMSubmitted
state but I cannot find the reason. Any ideas how I can fix this?
I’m using Prefect Cloud and Google Kubernetes Engine, KubernetesAgent
, KubernetesRun
, GCS storage. Details are in this thread.