jack
12/03/2020, 8:17 PM# In window #1
prefect backend server
prefect agent start
prefect project create test-1
# In window #2
prefect server start
# In window #3
prefect agent start
When I go to http://IP_OF_VM:8080 the UI is visible, but when I click "Dashboard" and then "Agents", it says there are no agents.
Also in the upper right corner of the UI there is a drop-down for "Project", but there are no items in the drop-down.
Even created a config.toml (and restarted server and agent), but still no change.
[server]
[server.ui]
apollo_url = "<http://IP_OF_VM:4200/graphql>"
Sergiy Krutsenko
12/03/2020, 8:40 PMflow = create_flow('TestFlowServer')
flow.register(project_name="Test")
docker-compose.yml
Added below var to environment section for towel and graphql services
PREFECT__ENGINE__EXECUTOR__DEFAULT_CLASS: prefect.engine.executors.DaskExecutor
I use LocalAgent to run flows. I also added the above env var when I start it. But nothing helped.
When I try to run the flow locally, without registering on Server everything works.
Thanks,
SergeyJoël Luijmes
12/04/2020, 11:40 AMNeeraj Sharma
12/04/2020, 12:00 PMjack
12/04/2020, 7:26 PM[Errno 2] No such file or directory: 'prefect'
but does not give context. Any idea which "prefect" file or directory it's looking for?Neeraj Sharma
12/07/2020, 11:06 AMNeeraj Sharma
12/07/2020, 11:07 AMCharles Leung
12/07/2020, 5:18 PMFrances Sun
12/09/2020, 2:52 PMMiecio
12/09/2020, 3:44 PMGRAPHQL_VALIDATION_FAILED: Cannot query field "get_or_create_task_run_info" on
type "Mutation". Did you mean "get_or_create_task_run" or
"get_or_create_mapped_task_run_children"?
Francisco
12/09/2020, 8:27 PMNewskooler
12/10/2020, 3:07 PMprefect[9118]: Pulling postgres ...
prefect[9118]: Pulling hasura ...
prefect[9118]: Pulling graphql ...
prefect[9118]: Pulling towel ...
prefect[9118]: Pulling apollo ...
prefect[9118]: Pulling ui ...
prefect[9118]: [29.6K blob data] Host is already in use by another container
prefect[9118]: [47B blob data]prefect[9118]: ERROR: for cli_postgres_1 Cannot start service postgres: driver failed programming external connectivity on endpoint cli_postgres_1 (32c027fb4da78cf7d569efc0a4f33e5baed8621c161b7c4a2c5efca694b3912c): Error starting userland proxy: listen tcp 0.0.0.0:5432: bind: address already in use
Dec 10 14:53:26 mb-01 prefect[9118]: ERROR: for postgres Cannot start service postgres: driver failed programming external connectivity on endpoint cli_postgres_1 (32c027fb4da78cf7d569efc0a4f33e5baed8621c161b7c4a2c5efca694b3912c): Error starting userland proxy: listen tcp 0.0.0.0:5432: bind: address already in use
prefect[9118]: Encountered errors while bringing up the project.
Newskooler
12/10/2020, 3:28 PMprefect/flows
so that we can keep it at a manageable size (it tends to just grow naturally; and it does so quite quickly)? 🤔Julio Venegas
12/10/2020, 3:35 PMPedro Martins
12/10/2020, 6:53 PMJulio Venegas
12/10/2020, 8:30 PMCharles Leung
12/10/2020, 9:40 PMClemens
12/11/2020, 9:12 AMjack
12/11/2020, 7:07 PMJoseph
12/11/2020, 10:44 PM@task
def return2(x):
return 2 + x
@task
def say_hello(x):
print(f"Hello, world! {x}")
with Flow("My First Flow") as flow:
for x in range(0, 100):
say_hello(return2(x))
flow.register("test")
Pedro Machado
12/12/2020, 12:24 AMMatt Drago
12/14/2020, 9:28 AMFailed to write log with error: 413 Client Error: Payload Too Large for url: <http://dataflow-apollo:4200/graphql//graphql>
The flow hadn't even run the first task, which was a EnvVarSecret
. Other instances of the Flow have run successfully.Lukas N.
12/14/2020, 2:52 PMPedro Martins
12/14/2020, 5:23 PMEvents:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 103s default-scheduler Successfully assigned default/prefect-agent-c4b68bfd9-dj8cf to ip-10-0-1-20.eu-west-1.compute.internal
Normal Pulling 102s kubelet Pulling image "prefecthq/prefect:0.13.19-python3.6"
Normal Pulled 101s kubelet Successfully pulled image "prefecthq/prefect:0.13.19-python3.6"
Normal Created 101s kubelet Created container agent
Normal Started 101s kubelet Started container agent
Warning Unhealthy 37s kubelet Liveness probe failed: Get <http://10.0.1.64:8080/api/health>: dial tcp 10.0.1.64:8080: connect: connection refused
jack
12/15/2020, 2:32 AMprint()
statements to show up in the web console at localhost:8080?
Here's my example code that prints to the terminal, but does not now up in the web console:
from prefect import task, Flow
@task
def simple_func(log_stdout=True):
print('simple print statement')
if __name__ == '__main__':
with Flow('test-logging') as flow:
simple_func()
flow.register('test-log')
flow.run()
jack
12/15/2020, 3:50 PMJoseph
12/15/2020, 8:43 PMKIRYL BUCHA
12/16/2020, 9:34 AMMike Marinaccio
12/16/2020, 6:30 PMboto3.client()
issue when running prefect agent ecs start
. In short, I receive the following error:
File "/Users/mike/.virtualenvs/reporting-Q7tyta-k/lib/python3.9/site-packages/prefect/utilities/aws.py", line 55, in get_boto_client
return boto3.client(
TypeError: boto3.client() got multiple values for keyword argument 'aws_access_key_id'
From the looks of it, the below code snippet from prefect/utilities/aws.py
is running, in my case, such that none of the kwargs.pop(...)
conditionals are executed. My creds are being pulled from ~/.prefect/config.toml
. This would mean that the code is adding duplicate keyword args to session.client()
(since they also exist in **kwargs with None
values). If I remove **kwargs
, it works.Charles Leung
12/17/2020, 8:28 PMResult check: OK
---------------------------------------------------------------------------
ClientError Traceback (most recent call last)
<ipython-input-11-014533001643> in <module>()
----> 1 flow.register(project_name='test-charles')
C:\ProgramData\Anaconda3\lib\site-packages\prefect\core\flow.py in register(self, project_name, build, labels, set_schedule_active, version_group_id, no_url, idempotency_key, **kwargs)
1667 version_group_id=version_group_id,
1668 no_url=no_url,
-> 1669 idempotency_key=idempotency_key,
1670 )
1671 return registered_flow
C:\ProgramData\Anaconda3\lib\site-packages\prefect\client\client.py in register(self, flow, project_name, build, set_schedule_active, version_group_id, compressed, no_url, idempotency_key)
821 create_mutation,
822 variables=dict(input=inputs),
--> 823 retry_on_api_error=False,
824 ) # type: Any
825
C:\ProgramData\Anaconda3\lib\site-packages\prefect\client\client.py in graphql(self, query, raise_on_error, headers, variables, token, retry_on_api_error)
316 ):
317 raise VersionLockError(result["errors"])
--> 318 raise ClientError(result["errors"])
319 else:
320 return GraphQLResult(result) # type: ignore
ClientError: [{'message': "'NoneType' object has no attribute 'get'", 'locations': [{'line': 2, 'column': 5}], 'path': ['create_flow_from_compressed_string'], 'extensions': {'code': 'INTERNAL_SERVER_ERROR', 'exception': {'message': "'NoneType' object has no attribute 'get'"}}}]
What's this error message mean? Using the latest version of prefect for python.
Thanks,