Join Slack

<@ULVA73B9P> Can I pass environment variables in my values.yaml when installing an aks worker with h...

Dan Morris

about 2 years ago

@Marvin Can I pass environment variables in my values.yaml when installing an aks worker with helm?

<@ULVA73B9P>, if I run `prefect worker start` instead of `prefect agent start`, I get this error ```...

Giacomo Chiarella

about 2 years ago

@Marvin, if I run

prefect worker start

instead of

prefect agent start

, I get this error

Discovered type 'prefect-agent' for work pool '<>'.
'prefect-agent' typed work pools work with Prefect Agents instead of Workers.
Please use the 'prefect agent start' to start a Prefect Agent.

can you tell me how to solve it?

``` build: - prefect_docker.deployments.steps.build_docker_image: id: build_image...

Gemma

about 3 years ago

build:
      - prefect_docker.deployments.steps.build_docker_image:
          id: build_image
          requires: prefect-docker>=0.3.0
          image_name: <http://724930167716.dkr.ecr.eu-west-2.amazonaws.com/prefect-training-2023|724930167716.dkr.ecr.eu-west-2.amazonaws.com/prefect-training-2023>
          tag: 0.0.1
          dockerfile: Dockerfile
          push: true
          platform: linux/amd64

<@ULVA73B9P> after upgrading prefect3, I cant see flow task diagram at flow runs widget. It only s...

syakesaba

almost 2 years ago

@Marvin after upgrading prefect3, I cant see flow task diagram at flow runs widget. It only say message "This flow run did not generate any task or subflow runs". Why?

Hi <@ULVA73B9P> I am getting the following error while running prefect flows. ```aiohttp.client_ex...

Abuzar Shakikh

about 2 years ago

Hi @Marvin I am getting the following error while running prefect flows.

aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host <http://hooks.slack.com:443|hooks.slack.com:443> ssl:default [Temporary failure in name resolution]

Hi, is there a way to export the flow logs from Prefect? I would like to save the logs for at least...

Mars

almost 4 years ago

Hi, is there a way to export the flow logs from Prefect? I would like to save the logs for at least 90 days, preferably with a copy of the flow logs imported our own logging infrastructure (Loki) for searchability.

Is there any way to limit concurrency when mapping over a task? I’m wanting to send a bunch of API r...

Alex Cano

about 7 years ago

Is there any way to limit concurrency when mapping over a task? I’m wanting to send a bunch of API requests, but the endpoint I’m hitting is pretty fragile. I’m wanting the exact map functionality (feed in a list, and have each execute), but limit the execution rate. Either sequentially or limiting to N concurrent requests would be great. I’ve achieved the same functionality by arbitrarily breaking up the number of requests I’d need to send into chunks, but then those either succeed or fail as a group, which I’m hoping to avoid.

<@ULVA73B9P> I'm trying to connect my prefect server to Aurora Postgres in AWS - Postgres uses toke...

Lee

about 1 year ago

@Marvin I'm trying to connect my prefect server to Aurora Postgres in AWS - Postgres uses token based authentication, not password based. How can I provide these credentials to Prefect when the app starts to ensure connectivity?

<@ULVA73B9P> ValueError: Unable to find block document named “” for block type s3:

datamongus

about 2 years ago

@Marvin ValueError: Unable to find block document named “” for block type s3:

I currently have a prefect flow that operates on a single row of a pandas dataframe. Is there a stra...

Dexter Antonio

over 4 years ago

I currently have a prefect flow that operates on a single row of a pandas dataframe. Is there a straighforward way to map this flow to all of the rows in a pandas dataframe? In other words, can I create a flow and then map it? If I cannot map each row of a dataframe to a flow, is there a straightforward way of nesting different tasks into each other and then mapping that “super” task to a series of inputs?

Previous 343536 Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.