Ruslan
02/24/2021, 5:42 PMrafaqat ali
02/25/2021, 9:45 AMAndrew Druchenko
02/25/2021, 5:47 PMrafaqat ali
02/26/2021, 1:31 PMprefect backend server
rafaqat ali
02/26/2021, 3:39 PMbanditelol
02/27/2021, 5:12 AMMariusz Olszewski
02/27/2021, 10:20 AMMariusz Olszewski
02/27/2021, 10:21 AMMariusz Olszewski
02/27/2021, 10:21 AMIgor Kaluđer
02/27/2021, 10:36 PMDiego Alonso Roque Montoya
02/28/2021, 5:06 AMMariusz Olszewski
02/28/2021, 8:07 AMMariusz Olszewski
02/28/2021, 8:08 AMMariusz Olszewski
02/28/2021, 8:08 AMMark Dodds
02/28/2021, 5:27 PMFailed to load and execute Flow's environment
. This is the full error
Failed to load and execute Flow's environment: ModuleNotFoundError("No module named '/root/'")
This happens every time I update the flow regardless of what changes are actually made. I'm guessing I'm doing to setup or storage wrong but not really sure where to start - any direction would be much appreciated!Minakshi
02/28/2021, 11:11 PMTobias Heintz
03/01/2021, 12:55 PMrafaqat ali
03/02/2021, 12:41 PMGanesh Kalyansundaram
03/03/2021, 2:54 PMDavid Harrington
03/03/2021, 7:41 PMPREFECT__FLOWS__CHECKPOINTING: false
for the flow. Based on the logs/errors we are seeing - the flow is still trying to serialize and write results. Two questions:
1. if we disable checkpointing at the flow level should prefect core not attempt to serialize the result
2. what is the appropriate way to disable checkpointing at the flow level
Relevant traceback included as a comment from when we ran a job where the env var was set to falseDana Merrick
03/03/2021, 9:19 PMCouldn't connect to Prefect Server at <https://localhost:4201/graphql>
but I would like to change thatDana Merrick
03/04/2021, 8:35 PMprefect
installed on the custom image, but when the container starts up and tries to run prefect execute flow-run
, I get this error:
Error: No such command 'execute'.
Any idea what I am missing? I installed prefect via conda btwMathijs Schoorl
03/05/2021, 2:12 PMJonathan Wright
03/06/2021, 11:52 AMale
03/08/2021, 12:52 PMpublic.log
hdb_catalog.hdb_schema_update_event
hdb_catalog.hdb_custom_types
utility.traversal
We are thinking of skipping replication/sync of these tables, but I’m not sure if they contain important data that we should replicate.
Any suggestion/advice is welcome 😒imple_smile:Hien Dang
03/08/2021, 2:55 PMUnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
.
I would like to increase the timeout to 120s but could not find an option where I can pass such parameters to prefect docker agent.
Currently the implementation of docker agent simply uses the default timeout of 60s for docker.APIClient
. I think it makes sense to give users the ability to configure such parametersStephen Mugisha
03/08/2021, 5:02 PMAndré Bonatto
03/08/2021, 11:06 PMhaf
03/09/2021, 10:23 AMpython
vs prefect register flow
vs triggering flows via the UI? And if I change a flow, do I register it again? Is it always that I have to change the python code when I change the runtime of a flow (by doing flow.run()
or flow.register()
or is this something that can be inferred by the agent running the flow?Josh Greenhalgh
03/09/2021, 1:09 PMNAME READY STATUS RESTARTS AGE
prefect-agent-c58b946f9-9r59j 1/1 Running 280 21h
prefect-server-apollo-78c9b8cbfb-bd69r 1/1 Running 0 3d12h
prefect-server-graphql-875f7ddc-pntjp 1/1 Running 0 3d12h
prefect-server-hasura-7897f76bcf-mtphx 1/1 Running 0 3d12h
prefect-server-towel-6d9c9748f4-q9mrc 1/1 Running 0 3d12h
prefect-server-ui-55f4bcb597-mmz4c 1/1 Running 0 3d12h
The agent consistently restarts every 5 mins or so - is this expected? If not any idea how to solve? I am using the output of prefect agent kubernetes install
as the spec for the deploymentJosh Greenhalgh
03/09/2021, 1:09 PMNAME READY STATUS RESTARTS AGE
prefect-agent-c58b946f9-9r59j 1/1 Running 280 21h
prefect-server-apollo-78c9b8cbfb-bd69r 1/1 Running 0 3d12h
prefect-server-graphql-875f7ddc-pntjp 1/1 Running 0 3d12h
prefect-server-hasura-7897f76bcf-mtphx 1/1 Running 0 3d12h
prefect-server-towel-6d9c9748f4-q9mrc 1/1 Running 0 3d12h
prefect-server-ui-55f4bcb597-mmz4c 1/1 Running 0 3d12h
The agent consistently restarts every 5 mins or so - is this expected? If not any idea how to solve? I am using the output of prefect agent kubernetes install
as the spec for the deploymentMariia Kerimova
03/09/2021, 1:25 PMkubectl describe po prefect-agent-c58b946f9-9r59j
)
Do you set memory limits on the agent?Josh Greenhalgh
03/09/2021, 2:26 PMEvents:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Pulled 33m (x291 over 22h) kubelet Successfully pulled image "prefecthq/prefect:0.14.11-python3.8"
Warning Unhealthy 13m (x590 over 22h) kubelet Liveness probe failed: Get <http://10.32.1.19:8080/api/health>: dial tcp 10.32.1.19:8080: connect: connection refused
Warning BackOff 8m47s (x3591 over 22h) kubelet Back-off restarting failed container
Normal Pulling 3m39s (x298 over 22h) kubelet Pulling image "prefecthq/prefect:0.14.11-python3.8"
memory limits: noperesource "kubernetes_deployment" "prefect_agent" {
metadata {
name = "prefect-agent"
namespace = kubernetes_namespace.prefect.metadata.0.name
labels = {
app = "prefect-agent"
}
}
spec {
replicas = 1
selector {
match_labels = {
app = "prefect-agent"
}
}
template {
metadata {
labels = {
app = "prefect-agent"
}
}
spec {
node_selector = {
"<http://cloud.google.com/gke-nodepool|cloud.google.com/gke-nodepool>" = google_container_node_pool.fixed_compute.name
}
container {
name = "agent"
image = "prefecthq/prefect:0.14.11-python3.8"
command = ["/bin/bash", "-c"]
args = ["prefect agent kubernetes start"]
env {
name = "PREFECT__CLOUD__API"
value = "http://<HIDDEN>:4200/graphql"
}
env {
name = "NAMESPACE"
value = "prefect"
}
env {
name = "PREFECT__CLOUD__AGENT__LABELS"
value = "['prefect-agent']"
}
env {
name = "PREFECT__BACKEND"
value = "server"
}
resources {
limits = {
cpu = "100m"
memory = "128Mi"
}
}
liveness_probe {
http_get {
path = "/api/health"
port = "8080"
}
initial_delay_seconds = 40
period_seconds = 40
failure_threshold = 2
}
image_pull_policy = "Always"
}
}
}
}
}
Michael Adkins
03/09/2021, 3:01 PMJosh Greenhalgh
03/09/2021, 3:54 PMcloud
version?Michael Adkins
03/09/2021, 4:00 PMCLOUD
settings are just "backend" settings that we didn't have a better name for when Server was split out.Josh Greenhalgh
03/09/2021, 4:04 PM