@Marvin Hey Marvin why I am gettignthis error

sqlite3.OperationalError: database is locked

when running a flow that was working perfectly yesterday? I also tried

rm ~/.prefect/prefect.db && prefect server database reset -y

but the same error persists

@Marvin Hi Marvin, is it possible to set up Prefect 2 automations to trigger when a flow hasn’t been run in the past 24 hours?

@Marvin can you give any guidance on how to organize a repo with multiple prefect flows. I would also like to incorporate prefect project recipes to manage deployments

@Marvin Can you provide an example of mocking prefect tasks for testing a prefect flow that uses those tasks?

@Marvin is there any way to have a task end a flow run prematurely?

This message was deleted.

@Marvin How do I fix this? Trying to set up a CI/CD pipeline that registers flows. It just repeats this

18:44:38.783 | INFO    | botocore.credentials - Found credentials in environment variables.

and eventually times out. I'm running the

py

file that has the Flow as a script, and have this at the end:

if __name__ == "__main__":
    for memory in [15360, 30720, 63398, 126899]:
        base_args = make_deployment_args(flow_name1, memory, user="matt")
        storage1 = S3Bucket.load(<name>)
        deployment1 = Deployment.build_from_flow(
            flow=nb_flow, storage=storage1, **base_args
        )
    memory2 = 14360
    base_args2 = make_deployment_args(flow_name2, memory2, user="matt")
    storage2 = S3Bucket.load(<name>)
    deployment1 = Deployment.build_from_flow(
        flow=nb_subflows, storage=storage2, **base_args2
    )

It works fine when I run it interactively, but not in CI/CD.

@Marvin why does using subprocess.run() inside a prefect task cause errors? What is the correct way of doing it

@Marvin can you give me an example deployment.yaml that spins up two containers using kubernetes with different cpu resources and different flows

@Marvin, can I hide task logs from the flow logs? For example, I want to see the flow run logs without being cluttered by the task logs. If I did want to see the task logs I would select the desired task

Hey @Marvin, what’s the Prefect 2 equivalent of LocalDaskExecutor() ?

@Marvin how can i cancel a flow run if the work pool is not available?

This message was deleted.

@Marvin Why might a deployment be extremely slow? I'm using

ECSTask

and

s3

storage, and an

s3

filesystem.

@Marvin How do I find details like the date and time that a flow was last successful. Is there a way to search for this information by flow-name?

@Marvin explain how to migrate from using work queues in early prefect 2.x versions to using work pools in newer versions of prefect

@Marvin how can I create a prefect email notification block with python code

@Marvin please tell me cool places to go in london that make me seem native

@Marvin tell me where on Stack Exchange I can ask a question about fixing p-values in a study without enough power and how I could tag it.

Hello @Marvin What's the good practice to work with Secret (or block) locally? In Prefect 1, the task

PrefectSecret

allows me to switch between Secrets stored via Prefect cloud UI and secrets stored on my local file

config.toml

. What's the solution to reproduce this feature with Prefect 2?

@Marvin I used a terraform module to start my ecs worker and I’m getting these worker logs.

6/22/2023, 2:21:26 PM GMT+1	raise PrefectHTTPStatusError.from_httpx_error(exc) from exc.__cause__	dd7a2b4d0c864a29a45c7fb3be8e12e0	prefect-worker-dev
6/22/2023, 2:21:26 PM GMT+1	prefect.exceptions.PrefectHTTPStatusError: Client error '401 Unauthorized' for url '<https://api.prefect.cloud/api/accounts/df07584b-fc84-43cb-a012-4a733392bcb7/workspaces/aebc2199-ddcd-430f-b7f1-de9c172d3892/work_pools/my-ecs-pool>'	dd7a2b4d0c864a29a45c7fb3be8e12e0	prefect-worker-dev
6/22/2023, 2:21:26 PM GMT+1	Response: {'detail': 'Invalid authentication credentials'}	dd7a2b4d0c864a29a45c7fb3be8e12e0	prefect-worker-dev
6/22/2023, 2:21:26 PM GMT+1	For more information check: <https://httpstatuses.com/401>	dd7a2b4d0c864a29a45c7fb3be8e12e0	prefect-worker-dev
6/22/2023, 2:21:26 PM GMT+1	Worker 'ECSWorker b98f1928-6596-4a06-83f1-84188da6d966' started!	dd7a2b4d0c864a29a45c7fb3be8e12e0	prefect-worker-dev

@Marvin Whats the rule when using Marvin AI when its not getting a response from the OPEN AI API?

@Marvin I deployed an ECS Worker, and it is kicking off deployments nicely. But, I get the following error on my Flow that runs dbt operations using blocks that I have previously created.

KeyError: "No class found for dispatch key 'dbt-cli-snowflake-target-configs' in registry for type 'TargetConfigs'."

@Marvin I am trying to run a function as a task inside a flow, but I get back

AttributeError: 'function' object has no attribute 'submit'

. Can you help me?

@Marvin how do I register new block types in prefect’s cli?

@Marvin I need your help with the jinja syntax and available variables in making a deployment. How can I use the name of the deployment in one of the

job_variables

in a jinja template?

@Marvin can you show me an example of a deployments.yaml file for an aks worker that uses

job_variables

to override the cpu and memory request

@Marvin Is there a way to ensure that a new definition of a Task or Flow overwrites an old one? I'm using Jupyter to tinker with a Task, and if I make a tweak and re-run, it gives me this and the new behavior doesn't happen.

UserWarning: A task named 'download_image' and defined at '/tmp/ipykernel_409/4031849273.py:14' conflicts with another task. Consider specifying a unique `name` parameter in the task definition:

@Marvin can you show me an example of a prefect task that uses subprocess to call a command line program in a way that doesn't conflict with prefect

This message was deleted.