• Rio McMahon

    Rio McMahon

    3 months ago
    Hello - I’d like to automatically deploy a flow from within a CI/CD pipeline. I run into import errors and am curious if there is some registration pattern that doesn’t require the environment prefect is installed into to also have the flow dependencies installed for serialization? Ideally I’d like to run some CI/CD pipeline using the prefect docker image (but not necessarily install
    sklearn
    or similar into it) then run
    prefect register --project "Project Name" -l label -p flow.py
    from within the pipeline. Realistically I could probably use the container that I am running the flow from within but am curious if there is an easier way. Thanks.
    Rio McMahon
    Kevin Kho
    2 replies
    Copy to Clipboard
  • Tony Yun

    Tony Yun

    3 months ago
    Hi, I think there is a ghost task running behind which we cannot see on UI. All of our running task is queued but no job is seen running on UI. Can someone help?
    Task 'RunNamespacedJob - DBT Run': Finished task run for task with final state: 'Queued'
    Tony Yun
    Kevin Kho
    22 replies
    Copy to Clipboard
  • Paco Ibañez

    Paco Ibañez

    3 months ago
    Hello, in 2.0, is there a way to provide custom parameter values for a deployment from the UI?
    Paco Ibañez
    Kevin Kho
    2 replies
    Copy to Clipboard
  • a

    aaron

    3 months ago
    Hello — we’re using Prefect Server 1.2.2, Docker storage (with
    stored_as_script=True
    ). I’m attempting to use the ExecuteNotebook task and I’m getting the following only with debug logs on the Docker agent:
    [2022-06-14 20:54:12+0000] INFO - prefect.CloudFlowRunner | Beginning Flow run for 'Test Docker Notebook Flow'
    [2022-06-14 20:54:13+0000] INFO - prefect.CloudTaskRunner | Task 'notebook0': Starting task run...
    Executing:   0%|          | 0/2 [00:00<?, ?cell/s]Operation not permitted (src/thread.cpp:309)
    This is erroring out in the container when trying to access the notebook but not making it back to the Prefect API to change task state (the task run just hangs until it times out with a
    No heartbeat detected from the remote task
    error). Any ideas?
    a
    Kevin Kho
    3 replies
    Copy to Clipboard
  • a

    Ahmed Ezzat

    3 months ago
    Orion's KV storage option is removed?
    2.0b6
    a
    1 replies
    Copy to Clipboard
  • Jovan Sakovic

    Jovan Sakovic

    3 months ago
    Hiya 😮ctavia-hi: Quick question on triggering Flows, any thoughts or ideas are appreciated and welcome 🙌 We have a Jenkins job extracting data from Postgres 😛ostg: and loading into BigQuery (yep, aware it could’ve been done with certain ETL tools, but it wasn’t an option) We also have a few Airbyte syncs on the same VM that Prefect is running on too. How would it make the most sense to trigger dbt jobs after the Jenkins and Airbyte syncs are finished? 🤔
    Jovan Sakovic
    3 replies
    Copy to Clipboard
  • Faheem Khan

    Faheem Khan

    3 months ago
    Hello Everyone, is it possible with prefect to run python script i.e. (abc.py) instead of refactoring my code to prefect tasks. I have already written my python script with multiprocessing functionality and would like to schedule it prefect.
    Faheem Khan
    Anna Geller
    +1
    9 replies
    Copy to Clipboard
  • Walter Cavinaw

    Walter Cavinaw

    3 months ago
    is it possible to specify where the prefect local agent should clone gitstorage to? Right now it clones gistorage to AppData/Temp/[here] . Just wondering if it's possible to change that through a variable or config?
    Walter Cavinaw
    Kevin Kho
    2 replies
    Copy to Clipboard
  • wonsun Jeong

    wonsun Jeong

    3 months ago
    Hi all! Shouldn't the
    config.toml
    file be in the path where prefect is installed? There is only
    backend.toml
    file in the path where my prefect is installed, are those two the same? Also i can't read
    backend.toml
    . I got the error message like below:
    TomlDecodeError: Found invalid character in key name: ':'. Try quoting the key name. (line 1 column 2 char 1)
    What's the backend.toml file?
    wonsun Jeong
    Anna Geller
    9 replies
    Copy to Clipboard
  • Jeff Kehler

    Jeff Kehler

    3 months ago
    Setting the
    apollo_url
    under
    [server.ui]
    in the
    .prefect/config.toml
    file does not appear to be working. How do I change the host that the UI will call to access the API?
    Jeff Kehler
    Anna Geller
    2 replies
    Copy to Clipboard