@Marvin how can I extend the base job template KubernetesClusterConfig to request the cpu and memory for a pod?

Hi, I'm trying to get logs from the GraphQL API but there is a limitation in the query. Is there a way to paginate the query so I can get all of the content?

I'm running a mapped task that has many children tasks (~2800) and about 95% of them are sucessfull but at some point I get this error:

Heartbeat process died with exit code 1

and the few children tasks left incomplete are unsuccsful. Any ideas how to debug why the parent mapping task is dying?

@Marvin why isn't prefect able to read my environment variables when I deploy the flow

Hi all! We've recently noticed our prefect postgres database has hit 20GB in size, which seems like a large size. Does anyone know if prefect is saving out task results / artifacts (note I have no explicit artifacts in any of my flows), and if there are ways to configure a retention policy (like to delete things after a week)?

@Marvin I have set up an instance of prefect server on an prem kubernetes cluster. I am trying to set up blocks that connect to my git repo and docker registry, but keep getting an error when I run my flows saying

RuntimeError: Failed to clone repository ‘<https://myrepo.com/my-repo>’ with exit code 128

The cluster is using a proxy so I suspect that it may not be configured to use the proxy. How can I do that with Prefect? Or is there another more plausible cause for this error?

Is there a way to write prefect logs to a file, different for each wokrqueue ? I am referring to this prefect doc https://discourse.prefect.io/t/how-to-stream-prefect-logs-to-a-file/1963

How do you people supplying parameters for a flow for different environments e.g. local, staging and prod? With CLI-based deployment, I have to modify deployment files locally or modify in web ui after applying. I think it's weird to drop the

Deployment

class. It can provide the deployment configuration above the

DO NOT EDIT

line in a generated deployment file. https://orion-docs.prefect.io/concepts/deployments/

I have an issue with building a docker image which I am pushing to Prefect Cloud. I have managed to successfully run the flow locally on my machine, the issue I am having is creating the Docker image to push to the Prefect cloud. It basically fails to build the image when I use the

prefect register

method, during building of the custom docker image on the local machine. I can build the image using the underlying docker command, but only if I use the flag

--network=host

in the build call. I have been successful in doing this before, I am using a newly installed VM for the submission, and so I am left wondering if there are default settings required for Docker. Is there a flag or setting that needs to be added somewhere, either to Docker or to Prefect, that enables the container to access the external network and internet during build time?

Another thing is that I am getting a strange error for this simple Flow:

Failed to load and execute Flow's environment: ModuleNotFoundError("No module named 'C'")

Can anybody tell me some hint where to look for a cause? googling did not help... 😞 More details in thread.