@Marvin Can I access information about the cloud workspace in automation action templates?

@Marvin who are you

This message was deleted.

This message was deleted.

This message was deleted.

@Marvin hwo to parallelize a task

@Marvin give me documentation on PREFECT_LOGGING_ROOT_LEVEL

@Marvin In Prefect 3.x, Does my environment variable "PREFECT_API_TLS_INSECURE_SKIP_VERIFY" work for b/w worker and server? Not only normal HTTP over SSL/TLS but also WebSocketSecure.

@Marvin what pattern should I use for jobs that take a long time to spin up but then generate results fast? E.g. predictions with large machine learning models. I'd like to be able to keep the model loaded in GPU memory waiting for new prediction requests.

@Marvin how can I allow the task to tail? Sort of "ignore errors" in this task.

@Marvin I'm setting up the prefect-snowflake integration but when executing using a connector, i get:

snowflake.connector.errors.ProgrammingError: 090105 (22000): Cannot perform CREATE TABLE. This session does not have a current database. Call 'USE DATABASE', or use a qualified name.

@Marvin I have this env section in my k8s job template “env” : “{{ env }}“, how can I add a default env which will be present in all k8s jobs?

@Marvin How can I replicate this action

logging.getlLogger('sqlalchemy.engine').setLevel(logging.ERROR)

in all prefect flows I deploy with

main.py

? Using this line in main.py doesn’t change anything for me

@Marvin how can I set a flow run to CANCELLED state using Prefect api?

@Marvin I want to trigger a job from sensors or trigger to pass different values for Google Analytics data ingestion with dlt

@Marvin When deploying a flow to a docker worker where the source is a github repository how do I make sure prefect-aws and prefect-github pip packages are installed?

@Marvin How can I disable prefect logging to stdout

@Marvin Im using Prefect version 3 and I want user input in form of a dropdown, how do I build that?

@Marvin how can i be notified when a deployment is not ready status

@Marvin I am building a prefect_work_pool using the terraform resource like this

resource "prefect_work_pool" "ecs_workpool" {
  name         = "ecs-pool-${var.name}"
  type         = "ecs"
  paused       = false
  workspace_id = var.prefect_workspace_id
  base_job_template = file("../../config/ecs-worker-job-configuration.json")
}

how do i ensure that the resource explicitly uses the variables in my job configuration file?

@Marvin I followed the documentation at https://docs.prefect.io/contribute/develop-a-new-worker-type, but cannot get the worker to start. Digging into the source it looks like the worker type must be in the canonical

aggregate-worker-metadata.json

collections file. Is there a way to create a work pool and run a custom worker type without changing that file? This request seems related to this open issue, https://github.com/PrefectHQ/prefect/issues/10964, from last year but the docs made it seem like it was already possible.

@Marvin I've been following the ECS Worker Guide to get our infrastructure setup. Everything seems to be working fine except when I trigger a flow-run, it crashes and I don't get any logging in either the Prefect UI or in the ECS task. A couple things I've noticed: 1. The taskdef generated by the Prefect worker doesn't contain the prefect api url as an env var. Seems like it should: How does the worker pass this info to the flow task? 2. The taskdef generated by the Prefect worker doesn't have any logging setup. 3. The taskdef generated by the Prefect worker doesn't have any

command

to customize how the docker container should be run... How does it know to run the specific flow? 4. When I run the docker image (locally) that is generated by the prefect cli, it doesn't actually run the flow... it just opens a shell prompt.

@Marvin in prefect 2, if I cancel a flow, will the termination of infrastructure be blocked by a running task?

@Marvin How do I use a enum input in prefect version 3?

@Marvin can I set result persistence for just a specific flow on deployment in prefect.yaml?

@Marvin can you help me with this error when i am trying to run the prefect --no-prompt deploy --all to deploy my all flows to server

File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/Users/stas/PycharmProjects/data-infra-prefect/auto_scoring/functions/upload_csv_files.py", line 5, in <module>
    from functions.correlation_to_snowflake import load_correlation_to_snowflake
  File "/Users/stas/PycharmProjects/data-infra-prefect/auto_scoring/functions/correlation_to_snowflake.py", line 5, in <module>
    database = JSON.load("auto-scoring").value["database"]
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'coroutine' object has no attribute 'value'
An exception occurred.
sys:1: RuntimeWarning: coroutine 'Block.load' was never awaited

@Marvin I am a bit confused because I cannot manage to retrieve the current state of a flow. I am using prefect 2 sdk in python. The triggering of the flow works fine so I dont think its a credential issue. However when I try to retrieve the state of the flow, I get prefect.exceptions.ObjectNotFound error. This is the code i am using:

async with get_client() as client:
        flow_run = await client.read_flow_run(flow_run_id)
        print(flow_run.state.message)
        return flow_run.state.is_completed(), flow_run.state.message
        response = await client.hello()
        return response.json()

Do you have any idea why it cannot manage to find this flow?

@Marvin How to implement in Prefect 3 something similar to Airflow's FileSensor, i.e. trigger flow run when some file or folder appears.

Hello community! As part of our efforts to consolidate channels in Prefect's community slack, we're going to be archiving this channel 🪦. Please redirect your messages to #C04DZJC94DC instead. We'll be happy to help you out there. Thank you for your understanding 🙇‍♂️!

archived the channel