• a

    Andrey Tatarinov

    1 year ago
    Hi, I have a question about a family of built-in tasks
    ReadGsheetRow
    ,
    ReadAirtableRow
    etc. What is their use case? All of these tasks Read- and Write- counterparts receive
    n
    - identifier of the row to be read or written. In our experience there's no such scenario when you need just a single row from table. Even more: there's no way to find out the size of the table. So is anybody actually using these tasks in this specific implementation?
    a
    j
    2 replies
    Copy to Clipboard
  • a

    Andrey Tatarinov

    1 year ago
    Question about Run Configuration for Flow. What is a meaning behind specifying LocalRun/DockerRun/.. in order to specify list of required labels for agent? What if I don't care what kind of run it will be as long as it satisfies required labels? How do I specify labels without specifying a type of run?
    a
    j
    3 replies
    Copy to Clipboard
  • s

    Scott Moreland

    1 year ago
    Suppose I have a long sequence of tasks within a given flow, where each task reads some persisted data created by the previous task, operates on that data, and persists the resulting output to a database via checkpointing. How can I...1. Run a single task within the flow and pull its input data from the persisted checkpoint of the previous task, i.e. debug a single task. 2. Have my flow rebuild the persisted output of any given task, i.e. ignore the fact that the checkpoint exists, recompute and overwrite it. Thanks in advance! Love the package and selling my team hard on it!
    s
    Jenny
    7 replies
    Copy to Clipboard
  • r

    Riley Hun

    1 year ago
    For the Prefect Server Helm Chart, is there a specific reason as to why it's not recommended to deploy the packaged postgresql database that comes w/ the helm chart into production? What are the risks involved?
    r
    Jenny
    +1
    6 replies
    Copy to Clipboard
  • j

    Jasono

    1 year ago
    Hi does the Context {…} defined in the Prefect Cloud web UI (I’m referring to the Run screen where Parameters and Context are manually entered) override the same context variables in config.toml? It appears to me the context entered in the web UI is ignored.
    j
    j
    12 replies
    Copy to Clipboard
  • l

    Luke Orland

    1 year ago
    is there a way to test-run a flow locally in Docker, something like
    flow.run(run_on_schedule=False)
    or using FlowRunner, without using an agent?
    l
    s
    7 replies
    Copy to Clipboard
  • j

    josh

    1 year ago
    Hey team, Prefect version 
    0.13.17
     has been released and here are a few notable changes:   😛refect-duck:😛refect-duck: Nicer support for tasks with multiple results   ⚠️   Improved logs and warnings   ♻️   Cleaner flow-run restarts when using resource managers #️⃣ Squashed bug in flow-hashing for idempotency A big thank you to our contributors who helped out with this release! Full changelog:https://github.com/PrefectHQ/prefect/releases/tag/0.13.17
    j
    1 replies
    Copy to Clipboard
  • m

    Mac Gréco Péralte Chéry

    1 year ago
    Hello Eveveryone! I am using a CI/CD process with AWS Codepipeline (source: Github, build: Codebuild) the output is a docker image i push to an AWS ECR repository for each flow. I my github project i have a buildspec file where i put this code:
    build:
        commands:
          - python --version
          - pyenv global 3.7.7
          - python --version
          - pip install $(grep -ivE "pywin32" requirements.txt)
          - prefect backend cloud
          - prefect auth login -t $PREFECT_ACCESS_TOKEN
          - aws ecr get-login-password --region us-east-2 | docker login --username AWS --password-stdin <http://xxxxxxxx.dkr.ecr.us-east-2.amazonaws.com|xxxxxxxx.dkr.ecr.us-east-2.amazonaws.com>
          - python3.7 flows/my_flow.py
    From November 20 docker introduced pull limits for images what cause me to have this error in Code build
    File "/root/.pyenv/versions/3.7.7/lib/python3.7/site-packages/prefect/environments/storage/docker.py", line 619, in pull_image
        output = client.pull(self.base_image, stream=True, decode=True)
      File "/root/.pyenv/versions/3.7.7/lib/python3.7/site-packages/docker/api/image.py", line 415, in pull
        self._raise_for_status(response)
      File "/root/.pyenv/versions/3.7.7/lib/python3.7/site-packages/docker/api/client.py", line 261, in _raise_for_status
        raise create_api_error_from_http_exception(e)
      File "/root/.pyenv/versions/3.7.7/lib/python3.7/site-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
        raise cls(e, response=response, explanation=explanation)
    docker.errors.APIError: 500 Server Error: Internal Server Error ("toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: <https://www.docker.com/increase-rate-limit>")
    When i go to the site i can read: "Anonymous free users will be limited to 100 pulls per six hours, and authenticated free users will be limited to 200 pulls per six hours." So i created a account on docker to raise my limits to 200 pull per 6 hours. So i understand the problem occurs when prefect is pulling the base prefect docker image to build my flow image because i have reached my 100 pulls / 6 hours anonymous limit My question is where should i put my docker account token to pull the prefect base image via my newly created docker account?
    m
    Michael Adkins
    +1
    4 replies
    Copy to Clipboard
  • Krzysztof Nawara

    Krzysztof Nawara

    1 year ago
    message has been deleted
  • h

    Hui Zheng

    1 year ago
    hello Prefect Support, I have a flow run that, right after it started the first task
    init_run
    ,
    Task 'init_run': Starting task run...
    it got this error message ( see thread) and, the log message said
    Task 'init_run': Finished task run for task with final state: 'ClientFailed'
    After that, All remaining tasks stuck in
    Pending
    state for hours. Any ideas what happened? Maybe my flow need to know how to handle this
    ClientFailed
    state ?
    h
    Jenny
    3 replies
    Copy to Clipboard