Hi All, I want to schedule a prefect flow every minute and within the flow have a check to determine a file in s3 has changed, if the file is changed a bunch of tasks are executed, otherwise flow exits, for this I need to maintain state across flows, how can I do that, thanks a ton

Hey folks - trying to authenticate with prefect Cloud via a startup script on a VM with the following command:

prefect cloud login -k PREFECT_API_KEY

and I'm getting the following error:

When not using an interactive terminal, you must supply a `--key` and `--workspace`

Do I have to hardcode a workspace for this to work?

Hi, what is the best way to run "subtasks"? I know i can just use in taskA

taskB.run()

but then it's treated as a normal python function (so no logging, and no other prefect's magic is available for this taskB) I managed to workaround this creating a Flow in a Task, something like this:

@task
def taskA(config: dict):
#...
    with Flow() as flowB:
        taskB()
#...
    a = flow.runB()

it seems to work - i get logs for flowB and taskB, etc I can visualize both flows using flow.visualize() - on two separate diagrams - but it's all right for me. But is this a correct approach, or should I do this some other way?

how to run a flow and wait for the result and then continue the other flow @Marvin

Is there any way to limit concurrency when mapping over a task? I’m wanting to send a bunch of API requests, but the endpoint I’m hitting is pretty fragile. I’m wanting the exact map functionality (feed in a list, and have each execute), but limit the execution rate. Either sequentially or limiting to N concurrent requests would be great. I’ve achieved the same functionality by arbitrarily breaking up the number of requests I’d need to send into chunks, but then those either succeed or fail as a group, which I’m hoping to avoid.

@Marvin, if I run

prefect worker start

instead of

prefect agent start

, I get this error

Discovered type 'prefect-agent' for work pool '<>'.
'prefect-agent' typed work pools work with Prefect Agents instead of Workers.
Please use the 'prefect agent start' to start a Prefect Agent.

can you tell me how to solve it?

@Marvin Can I run Docker with GPUs on Prefect?

In Prefect 2.0, I’m trying to create a Deployment which takes arguments from a configuration stored in Prefect Cloud as a custom block. Here is the sample code:

config = CustomConfig.load('my_block')

Deployment(
    name="My deployment",
    flow=my_flow,
    parameters={
        "password": config.password
    }
)

when I run this command from CLI

prefect deployment create my_deployment.py

I get this error

AttributeError: 'coroutine' object has no attribute 'password'

Failed to load deployments from 'my_deployment.py'
sys:1: RuntimeWarning: coroutine 'Block.load' was never awaited

How can I do that?

@Marvin I want to install self-hosted Prefect server with dashboard(that's Prefect UI ) in my Ubuntu server, could you share me the install document?

Hello! How do we change the prefect_api_url to our server host ip in selfhosted prefect. I first ran the command prefect config set PREFECT_API_URL=http://MYHOSTIP:4200/api and then prefect server start, once the prefect server starts, I am seeing it pointed to http://127.0.0.1:4200/api