Jake
01/19/2022, 4:42 PMKevin Kho
Jake
01/19/2022, 4:44 PMKevin Kho
Jake
01/19/2022, 4:46 PMKevin Kho
Jake
01/19/2022, 4:48 PMKevin Kho
Jake
01/19/2022, 4:54 PM- name: PREFECT__CLOUD__TENANT_ID
value: ''
Kevin Kho
Jake
01/19/2022, 4:56 PMprefect agent kubernetes install -k <api_key> -l 'cf' --rbac --namespace <namespace> >> prefect_agent.yaml
followed by:
kubectl apply -f prefect_agent.yaml --namespace=<namespace>
Kevin Kho
Jake
01/19/2022, 4:59 PMZanie
Jake
01/19/2022, 5:01 PM[2022-01-19 16:38:50,620] INFO - agent | Registering agent...
[2022-01-19 16:38:51,157] INFO - agent | Registration successful!
____ __ _ _ _
| _ \ _ __ ___ / _| ___ ___| |_ / \ __ _ ___ _ __ | |_
| |_) | '__/ _ \ |_ / _ \/ __| __| / _ \ / _` |/ _ \ '_ \| __|
| __/| | | __/ _| __/ (__| |_ / ___ \ (_| | __/ | | | |_
|_| |_| \___|_| \___|\___|\__| /_/ \_\__, |\___|_| |_|\__|
|___/
[2022-01-19 16:38:51,327] INFO - agent | Starting KubernetesAgent with labels ['cf']
[2022-01-19 16:38:51,327] INFO - agent | Agent documentation can be found at <https://docs.prefect.io/orchestration/>
[2022-01-19 16:38:51,327] INFO - agent | Waiting for flow runs...
Zanie
Jake
01/19/2022, 5:02 PMZanie
PREFECT__CLOUD__AGENT__LEVEL=DEBUG
Jake
01/19/2022, 5:07 PMAnna Geller
Jake
01/19/2022, 5:10 PM[2022-01-19 17:09:09,787] DEBUG - agent | Environment variables: []
[2022-01-19 17:09:09,788] DEBUG - agent | Max polls: None
[2022-01-19 17:09:09,788] DEBUG - agent | Agent address: http://:8080
[2022-01-19 17:09:09,788] DEBUG - agent | Log to Cloud: True
[2022-01-19 17:09:09,788] DEBUG - agent | Prefect backend: cloud
[2022-01-19 17:09:10,188] DEBUG - agent | Loading incluster configuration
[2022-01-19 17:09:10,189] DEBUG - agent | Namespace: mall-data-test
[2022-01-19 17:09:10,189] INFO - agent | Registering agent...
[2022-01-19 17:09:10,696] INFO - agent | Registration successful!
[2022-01-19 17:09:10,696] DEBUG - agent | Assigned agent id: d6628fec-dc59-4190-9f73-b5c2a90fe19b
[2022-01-19 17:09:10,696] DEBUG - agent | Sending test query to API at '<https://api.prefect.io>'...
[2022-01-19 17:09:10,873] DEBUG - agent | Test query successful!
____ __ _ _ _
| _ \ _ __ ___ / _| ___ ___| |_ / \ __ _ ___ _ __ | |_
| |_) | '__/ _ \ |_ / _ \/ __| __| / _ \ / _` |/ _ \ '_ \| __|
| __/| | | __/ _| __/ (__| |_ / ___ \ (_| | __/ | | | |_
|_| |_| \___|_| \___|\___|\__| /_/ \_\__, |\___|_| |_|\__|
|___/
[2022-01-19 17:09:10,873] INFO - agent | Starting KubernetesAgent with labels ['cf']
[2022-01-19 17:09:10,873] INFO - agent | Agent documentation can be found at <https://docs.prefect.io/orchestration/>
[2022-01-19 17:09:10,873] INFO - agent | Waiting for flow runs...
[2022-01-19 17:09:10,874] DEBUG - agent | Sending agent heartbeat...
[2022-01-19 17:09:10,880] DEBUG - agent | Running thread pool with 8 workers to handle flow deployment
[2022-01-19 17:09:10,881] DEBUG - agent | Agent API server listening on port http://:8080
[2022-01-19 17:09:10,887] DEBUG - agent | Retrieving information of jobs that are currently in the cluster...
[2022-01-19 17:09:10,887] DEBUG - agent | Querying for ready flow runs...
[2022-01-19 17:09:10,898] DEBUG - agent | Heartbeat succesful! Sleeping for 60.0 seconds...
DEBUG:agent:Heartbeat succesful! Sleeping for 60.0 seconds...
[2022-01-19 17:09:11,064] DEBUG - agent | No ready flow runs found.
DEBUG:agent:No ready flow runs found.
[2022-01-19 17:09:11,065] DEBUG - agent | Sleeping flow run poller for 0.5 seconds...
DEBUG:agent:Sleeping flow run poller for 0.5 seconds...
[2022-01-19 17:09:11,565] DEBUG - agent | Querying for ready flow runs...
DEBUG:agent:Querying for ready flow runs...
[2022-01-19 17:09:11,764] DEBUG - agent | No ready flow runs found.
DEBUG:agent:No ready flow runs found.
DEBUG:agent:Sleeping flow run poller for 1.0 seconds...
[2022-01-19 17:09:11,764] DEBUG - agent | Sleeping flow run poller for 1.0 seconds...
DEBUG:agent:Querying for ready flow runs...
[2022-01-19 17:09:12,765] DEBUG - agent | Querying for ready flow runs...
DEBUG:agent:No ready flow runs found.
[2022-01-19 17:09:12,936] DEBUG - agent | No ready flow runs found.
DEBUG:agent:Sleeping flow run poller for 2.0 seconds...
[2022-01-19 17:09:12,936] DEBUG - agent | Sleeping flow run poller for 2.0 seconds...
[2022-01-19 17:09:14,937] DEBUG - agent | Querying for ready flow runs...
DEBUG:agent:Querying for ready flow runs...
[2022-01-19 17:09:15,109] DEBUG - agent | No ready flow runs found.
DEBUG:agent:No ready flow runs found.
...
Anna Geller
Jake
01/19/2022, 5:16 PMAnna Geller
Jake
01/19/2022, 5:21 PMAnna Geller
Jake
01/19/2022, 5:22 PM