Hi all, I'm running prefect jobs on an ECS task block and I am trying to set up a datadog agent in the same task definition. However, when I run the job, the logs are not picked up by datadog. Has anyone succesfully integrated Prefect with datadog? Specifically while running on ECS?

@Marvin ive got a streamlit webapp that triggers a remote run and awaits the results of that run to display a plot. How do i best poll the prefect server to know when the flow has successfully completed?

Is it safe to stop the prefect agent in order to update the packages installed in the virtualenv? Or would that cause any flow-runs-in-progress to be killed/restarted? Asking for both prefect 1.x and 2.x, as we are using both.

In prefect 2.0, whats the alternative command of

$ prefect backend server

Hi! Fetching sub-flow results without storage-serialization: I'm trying to run sub-flow from my parent-flow, over separate machines (through

run_deployment

) - and i want to get the (json-serialized) results directly returned in python rather than through serialized-dumps on file-system -since the external-machines are dead when i finish waiting for all sub-flows, local-files persistence crashes. i was hoping not to define a shared efs or spam s3 with temp-calculations - i assumed it's possible (something lie Airflow's xcomm, or just return the value which was already held by the subflow-process) After many (!) talks with Marvin, i tried to get the outputs through

flow_run.state.result(fetch=True)

and also made sure to activate the in-memory storage rather than file-system (which is not even defined as Block, but still) through

@flow(persist_result=False)

decorators. However i'm still failing over marvin's specific example snippet (this time over:

prefect.exceptions.MissingResult: State data is missing. Typically, this occurs when result persistence is disabled and the state has been retrieved from the API.

) Any idea if this snippet should work at all? am i missing something basic (some server-configuration)? must i define a shared-efs? i'll put on marvin's (slightly-modified) snippet in thread Thanks!

@Marvin how can I use a progress bar with prefect 3.X to check up on the progress of multiple tasks being run in parallel?

@Marvin I get this error when I try to quick run a deployment from the cloud State Message Submission failed. ValidationError: 1 validation error for Process command value is not a valid list (type=type_error.list) How can I know where the error is coming from? When I run the flow locally it works fine 205905.914 | INFO | prefect.engine - Created flow run 'laughing-rattlesnake' for flow 'Price Scrapper' TestING 205906.015 | INFO | Flow run 'laughing-rattlesnake' - Finished in state Completed()

Is there a planned release date for Prefect 3? Or a roadmap I can follow along somewhere?

Hello, I'm creating my first flow run on local for the first time, and i want to set it up with how (i think) my prod set up will interact with prefect. I have a work pool created and a local agent listening to it, and I deployed my Flow to prefect cloud like so:

if __name__ == "__main__":
    
    deployment: Deployment = Deployment.build_from_flow(
        flow=test_flow,
        name="example",
        version="1",
        tags=["demo"],
        work_pool_name='local_agent_work_pool'
    )

    deployment.apply()

I confirmed that the deployment worked in the Prefect Cloud UI. In my flask endpoint, I am trying to submit the flow run to Prefect cloud like so, but it feels wrong:

@flask_route.route("/prefect", methods=['POST'])
def start_prefect_flow():
    # prefect_client = get_client(
    #     # api_key='redacted'
    # )
    prefect_client = PrefectClient(
        api='redacted',
        api_key='redacted'
    )

    res = prefect_client.create_flow_run(test_flow)
    print(res)

First, I don't think I should be creating the client this way, but unsure how else I should be passing my api/api key information to it. This is also returning a coroutine object instead of what I thought would be information about my flow run, but maybe that makes sense since I don't see a flow run being kicked off. Some assistance here would be super helpful!

Hi folks, quick dumb question : to set to the type of parameter for a flow, do i just use type hints to set the type of parameters?