Hi #prefect-cloud #prefect-getting-started, Got Runtime error as task runner is already started in below scenario

@flow(name="Status check")
def run():
    a= "hello"
    if(condition):
        success
    else:
        run()

if __name__ == "__main__":
   run()

Can anyone help. This is more like recursive funtion

Hi #prefect-cloud Can we deploy Prefect 2 Agent on ECS Fargate with Prefect orion UI. I mean with default workspace. Hope Prefect orion UI doesn't have API key and account id.

Hello there! I'm having an issue with default parameters on a flow that uses pydantic validation. My flow looks something like:

class FlowParameters(BaseModel):
    requests_per_minute: int = 10
    ids: Optional[List[str]] = None


@flow(
    description='Imports and enriches Entities.',
    task_runner=SequentialTaskRunner()
)
def token_pipeline(parameters: FlowParameters):
    new_entities = fetch_new_entities(parameters.ids)
    enrich_entity.map(new_entities, parameters.requests_per_minute)

If I call my flow from Prefect Cloud and pass it some parameters (run Custom), all runs smoothly. If, on the other hand, I try to run it with the default parameters, I get:

Validation of flow parameters failed with error: 
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/prefect/engine.py", line 275, in retrieve_flow_then_begin_flow_run
    parameters = flow.validate_parameters(flow_run.parameters)
  File "/usr/local/lib/python3.10/site-packages/prefect/flows.py", line 324, in validate_parameters
    raise ParameterTypeError.from_validation_error(exc) from None
prefect.exceptions.ParameterTypeError: Flow run received invalid parameters:
 - parameters: field required

Which is weird. Expected behavior would be having the flow run with default parameters. Can't seem to understand what I'm doing wrong from reading the docs, any ideas? 🙂

And since I'm already asking: is the way I'm writing my flow correct? Or is it dispatching tasks to a different task runner cause I'm not calling submit? If the latter, how can I use

map

with a custom task runner?

Hi #prefect-cloud, How prefect agent handle the task load for example we are generating one file huge data and it will take 30min. Will Prefect2 agent service wont run out of memory? Can we run the computation outside of prefect agent like running task logic execution on some compute machine and we will just call the call the computation method/function in prefect agent?

Hi. Is there a way to see task run concurrency limits in Prefect Cloud 2?

This message was deleted.

Hi #prefect-cloud, I have installed prefect2 on ec2 and running prefect Orion UI server on particular IP address. And I am running prefect agent with ecs task "prefect agent start -q "demo" --api <prefect Orion api link>". ecs task running fine. But when I do the deployment flows are not running. prefect work-queue is not syncing/active. Could anyone tell me If I am missing anything

Hi everyone i am currently using prefect cloud with my data pipelines and code running in aws ec2 instance , i have written a bash script to make the worker queues run in the background and for some reason the worker queues arent running in the background as expected , is there any way you guys would recommend? , thanks in advance!

Hi. What firewall rules are required to allow an agent inside a closed-off environment to reach Cloud 2.0? • https://api.prefect.cloud should be reachable (note the IP addess can change_)_ • Ports: 443. Only 443?

Hi, does anyone know why Prefect Cloud leaves deployment instances as "Pending" rather than "Completed", despite the fact that the Prefect Agent seems to have no issue completing the task itself? Is this some sort of firewall issue?

Hi , i have an bash script which starts prefect worker queues (prefect agent start -q "name" ) every hour and for some reason one of the agent says its unhealthy most of the time , any reasons what could the issues? (my understanding was there was no responce from that queue but i am more curious as to whats causing this issue and that specific queue alone!) and one of my flow runs crashed and it threw and 500 responce error , it says it was internal server error any leads on this would help! (I am using prefect 2 with server running on amazon ec2 instance and i use prefect cloud if that helps) , thanks in advance

Hi #prefect-cloud, I am trying to deploy my flows to S3. Getting this error. Although the s3 user i used to create the block has that permission. I am using the build_from_flow function to deploy, if that makes any difference. Any help would be great, thanks.

botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the PutObject operation: Access Denied

what’s a good email for billing support?

Hi guys, I'm new to Prefect, I see we have two different Prefect Cloud, one is: app.prefect.cloud and one is cloud.prefect.io. Which one should I use?

Hi guys, I cannot find the docs guiding for setting up docker agent in local machine on Prefect 2. All demos are about running flow in Docker. Does anyone have any docs or tutorial for setting up agent in docker local? (for prefect 2, i mean)

is there a way to extract my Prefect cloud data out in the history-viewing window, in case I need to put it into a self-hosted instance in the future?

I am trying to deploy flows to prefect cloud using github actions, is there a way to non interactively select the worskpace after you login.

Hi guys, I'm trying to run docker agent with local process. And error shows up as

ModuleNotFoundError: No module named 'prefect_airbyte

I did install prefect airbyte in my local machine (as global system). Did I miss anythings?

Hi, I'm experiencing timeout error even though I put timeout_seconds = 3600. How can I disable this error:

File "/usr/local/lib/python3.10/site-packages/anyio/_core/_tasks.py", line 118, in __exit__
    raise TimeoutError
TimeoutError

During handling of the above exception, another exception occurred: 
File "/usr/local/lib/python3.10/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
    raise to_exc(exc)
httpcore.ReadTimeout

I run prefect to orchestrate airbyte connection (airbyte local)

Hello everyone, so I can run the basic_flow.py from my terminal and it runs successfully. But when I deploy the same code and run from the UI. It fails because it is looking for my directory.

Documents/prefect/prefect_env

What do I need to do so that the path doesn't point to my local file system?

Hi guys, I'm running a deployment contains around 32 flows, which in turn has runtime around 50 mins. And I often got crash detected at very end of the deployment (around min 45). My deployment code is simple, call to airbyte local API and trigger connection. The error is

Crash detected! Request to <https://api.prefect.cloud/api/accounts/xxxx/workspaces/xxxx/task_runs/xxxx/set_state> failed: Traceback (most recent call last):
ssl.SSLSyscallError: Some I/O error occurred (_ssl.c:997)

The above exception was the direct cause of the following exception:
anyio.BrokenResourceError

During handling of the above exception, another exception occurred:
File "/usr/local/lib/python3.10/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
raise to_exc(exc)
httpcore.ConnectError

The above exception was the direct cause of the following exception:
File "/usr/local/lib/python3.10/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.ConnectError

Worker information:
 Approximate queue length: 0
 Pending log batch length: 6
 Pending log batch size: 2160
The log worker is stopping and these logs will not be sent.

Does anyone have ideas to fix this error?

Hi, last night we ran into an issue where our Snowflake Connector block had the credential field set to “None” which cause the following errors on our flows

....
 File "/home/ubuntu/.local/lib/python3.8/site-packages/prefect/blocks/core.py", line 175, in __init__
    super().__init__(*args, **kwargs)
  File "pydantic/main.py", line 342, in pydantic.main.BaseModel.__init__
pydantic.error_wrappers.ValidationError: 1 validation error for SnowflakeConnector
credentials
  field required (type=value_error.missing)

This was resolved by switching the credential field back to the correct block instead of the “None” value. Additionally our Slack Webhook URL was “unset/blanked”, leading to alerts not firing off. Is this a known issue? Trying to understand what would cause these fields to be nulled overnight.

Hey! In the release notes to 2.7.1:

improved timeout handling on the

KubernetesJob

block - this timeout is now disabled by default (i.e.

job_watch_timeout_seconds

is set to

None

)

When I now try to run a pipeline without having that parameter explicitly set to a not-None value in KubernetesJob(...), I get this error from Prefect Cloud.

Submission failed. pydantic.error_wrappers.ValidationError: 1 validation error for KubernetesJob job_watch_timeout_seconds none is not an allowed value (type=type_error.none.not_allowed)

Is this intended?

Hello everyone,Iam not able to connect to prefect cloud via my PC although i have all access.Its showing SSL error wheen i have connected to my organization VPN.Its connecting fine when iam not connected VPN.Can anyone suggest how to access prefect cloud while connecting to VPN.

Hi all, I have been having some significant trouble using the

GcpCredentials

block in both the Prefect UI and the Python API. I am able to save the credentials on the UI, but when I load the credentials, I get a Pydantic

JSONDecodeError

. When I try to save the credentials from Python, I get the same error. Anybody know a solution or workaround?

Hi everyone! I’ve just started to learn and use Prefect. I was looking for best practices to share blocks between different workspace in Prefect cloud.

Hi, can someone please let me know where is Perfect Cloud hosted? Thanks.

Hello - maybe i’m a bit silly but i can’t find where to change the (member) password in Prefect cloud 1.0 ?

Hello, is there any limit of how many blocks can be deployed on prefect cloud?