https://prefect.io logo
Docs
Join the conversationJoin Slack
Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-australia
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Powered by Linen
prefect-ui
  • h

    holger brandl

    05/29/2021, 7:41 PM
    Hi. I'm trying my first baby steps with prefect. I 'm running it in a ubuntu VMware following the protocol from https://docs.prefect.io/core/getting_started/installation.html#running-the-local-server-and-ui, and when accessing via chrome in VM, the UI functions flawlessly (and also the tutorial demos work fine). However, when accessing the same instance from my host with HTTP://myvmhostname:8080 the ui shows up, but reports the error "Connecting to Prefect Server at *null*". Is this intended or a known issue?
    j
    • 2
    • 2
  • с

    Сергей Романкевич

    06/02/2021, 1:35 AM
    Hi friends! How to change the time format on the site from AM PM to 24 hours?
    n
    • 2
    • 2
  • c

    Chohang Ng

    06/02/2021, 4:03 PM
    If I register the flows to the prefect.io and delete the code stored in my local computer. Would prefect still pick up the flows since they are registered?
    k
    • 2
    • 1
  • c

    Chohang Ng

    06/03/2021, 4:49 PM
    A task failed ofinished in state <Failed: "Some reference tasks failed."> on Prefect UI, can I get more info about this error message?
    k
    c
    • 3
    • 8
  • c

    Chohang Ng

    06/03/2021, 10:07 PM
    Failed: "Failed to load and execute Flow's environment: StorageError('An error occurred while unpickling the flow:\n ModuleNotFoundError("No module named \'task\'")\nThis may be due to a missing Python module in your current environment
    n
    g
    • 3
    • 78
  • f

    Florian Kühnlenz

    06/07/2021, 6:15 AM
    In the prefect.io UI, where can I change the password for my user?
    j
    • 2
    • 2
  • i

    Ismail Cenik

    06/08/2021, 10:29 PM
    Hello, is it possible to extract Prefect Cloud UI LOGS and show them in our dashboard for observability? What is the best practice here?
    z
    • 2
    • 4
  • d

    Dahn Jahn

    06/09/2021, 7:39 AM
    Hi all! I am attempting to use Prefect to standardize and simplify my team's ETL processes. One of the main problems is that it's never clear which script uses which files and which files are its outputs. I thought Prefect could help solve that with the DAG visualization, but I did not manage to get that to work: only input parameter names are visualized, and I don't see a way to visualize an output file. One hacky solution I came up with would be to have all paths (inputs and outputs) as Parameters with default values equal to the actual filepath. If I could then visualize the default parameter value in the DAG, I would have a working solution. However, I am not sure if I can visualize the default parameter values. Perhaps I can inherit from Task/Parameter and override its name to reflect that information? How could I do it, or is there a different solution altogether? Ideally, the graph would look something like
    input_filepath
    ->
    function
    ->
    output_filepath
    .
    j
    • 2
    • 3
  • c

    Carlos Gutierrez

    06/11/2021, 10:48 AM
    Hey all! Just a very quick question: I noticed that Prefect UI only shows the flow run history for the current month. Is there any way to view historic flow runs past to the current month? In case this is not possible, how can I inspect flow runs that are prior to that?
    n
    • 2
    • 5
  • r

    Ruslan

    06/16/2021, 1:46 AM
    hi! flow concurrency is disabled on concurrency based plan?
    c
    • 2
    • 3
  • j

    jcozar

    06/16/2021, 7:46 AM
    Hi all! I am using tags for tasks and task concurrency. Is there a place where I can see the tags assigned to each running task? Thank you very much!
    k
    • 2
    • 2
  • m

    michael.urrutia

    06/16/2021, 2:26 PM
    Anyone else noticing brutal load times of prefect cloud? It had been getting stuck perpetually loading, but if I close chrome and re-open it works immediately.
    n
    f
    z
    • 4
    • 7
  • d

    Diego Piloni

    06/17/2021, 11:46 AM
    Hi 👋 ! First of all, thank you for such a great tool, I really enjoy using prefect 🙂 I'm using prefect-ui with hourly schedule to run an ETL flow. The agent is in a raspberrypi4 🙈 , and it sometimes get discconected from the network (Maybe I should stop using a Raspberry for this, I know). When this happen I see that all the missing hourly flows start executing when the agent is turned on (all at the same time). Is there any way to configure prefect to not start executing flows after the schedule time? Should I do it programatticaly? Or maybe just don't allow it to execute the same flow at the same time. Here is an example where many flows started running together:
    🙏 1
    k
    • 2
    • 9
  • t

    Tim Enders

    06/22/2021, 4:34 PM
    How do I get around a Flow failing due to the "failed to detect heartbeat" on Prefect Cloud? This seems to be triggered by a long running task.
    k
    d
    • 3
    • 6
  • m

    Matheus Cruz

    06/23/2021, 3:00 PM
    [Flow Schematic] Hi Guys! Some of my flows trigger other flows and I was wondering if there is any way I can see an aggregate schematic without having to join the tasks into a single flow and see the schematic of this unique flow.
    n
    • 2
    • 3
  • r

    Ruslan

    06/23/2021, 4:39 PM
    Hi! Can’t remove agent, what the problem how to fix it?
    n
    • 2
    • 1
  • j

    Jeffrey Lai

    06/24/2021, 12:32 AM
    Hi! I don't why I can't turn on/off the schedules in prefect cloud. When I click on the switch, nothing happened.
    n
    • 2
    • 5
  • s

    Serdar Tumgoren

    06/27/2021, 1:02 AM
    Hey all, I just noticed some quirky behavior on the Prefect Cloud UI when configuring Inputs on a Flow. I have some boolean Parameters set in the flow, and they appear to display their defaults correctly in the Cloud UI. However, when I try to switch from 
    true
     -> 
    false
     or vice versa, the UI appears to be converting them under the hood to strings (
    "true"
     or 
    "false"
     , as the case may be). This causes  conditional logic that checks for “truthiness” in my flow to behave incorrectly (i.e. conditionals expecting a 
    False
     always evaluate as 
    True
     since non-empty Python strings always evaluate as
    True
    ). I verified this by toggling the values in Inputs UI and switching to the JSON configuration view of the data. I can get the Flow to run correctly by switching to the JSON configuration and correcting the issue, but figured that perhaps I’m missing something basic about the UI. Anyone have advice?
    k
    n
    m
    • 4
    • 15
  • r

    Ruslan

    06/28/2021, 8:07 PM
    hi! is it possible to make default “rows per page” = 50 while watching flows list in cloud?
    n
    • 2
    • 4
  • a

    Austen Bouza

    06/28/2021, 8:31 PM
    Has anyone else encountered issues with the Prefect Cloud UI simply refusing to load past the blue spinner? Seems to happen after my tab hangs from leaving the dashboard open too long (memory leak somewhere?). Closing it and opening a new tab results in an infinite spinner. Only way I’ve found to fix this is completely exit Chrome and restart the browser
    ✅ 1
    n
    a
    j
    • 4
    • 4
  • l

    Laura Vaida

    06/29/2021, 7:21 AM
    heey everyone, does anybody know how to put more than one variable in a secret, maybe as json? thanks :)
    ✅ 1
    j
    • 2
    • 11
  • r

    Ruslan

    06/29/2021, 8:59 AM
    how to create second team from same account? is it allowed to use different teams to cost optimization?
    j
    c
    • 3
    • 3
  • r

    Ruslan

    06/29/2021, 2:47 PM
    How to work with frozen flows? I see in agent log that flow finished but in cloud UI it is influently in running state. How to debug this problem?
    j
    • 2
    • 4
  • n

    Nicholas Chammas

    06/30/2021, 6:15 PM
    My flow has several
    DatabricksRunNow
    tasks that run Databricks jobs. The tasks take parameters, which I provide via Prefect’s
    Parameter
    construct. These parameters that are fed into Databricks tasks always show up in the UI with these extra nodes for
    List
    and
    Dict
    . I don’t understand what they’re for, or why I need to see them in the UI, and they really clutter things up. Is this something I can eliminate by restructuring my flow somehow? Or is there some part of Prefect that needs to be changed to eliminate these noisy nodes from the schematic? Or are these
    List
    and
    Dict
    nodes actually useful for something?
    n
    t
    • 3
    • 2
  • t

    Thomas Hoeck

    07/01/2021, 8:13 AM
    Hi, I'm seeing som weird behavior in the UI this morning. No matter the selection it shows the full historiy of fails (note 24 hour selection):
    j
    • 2
    • 4
  • s

    Sean Talia

    07/01/2021, 6:28 PM
    if you're an admin for your prefect team, is there any way via the UI to edit your other team members' first + last name or do they have to do that themselves?
    n
    • 2
    • 1
  • l

    Laura Vaida

    07/02/2021, 10:56 AM
    Hi at all, im trying to use the following function:
    For convenience, you can use the snowflake.sqlalchemy.URL method to construct the connection string and connect to the database. The following example constructs the same connection string from the previous example:
    
    from snowflake.sqlalchemy import URL
    from sqlalchemy import create_engine
    
    engine = create_engine(URL(
        account = 'myorganization-myaccount',
        user = 'testuser1',
        password = '0123456',
        database = 'testdb',
        schema = 'public',
        warehouse = 'testwh',
        role='myrole',
    ))
    I want to create an engine with passing the input for URL with ** instead of putting every variable but I dont know how to write the input, it should be a str format that's what I tried, maybe you have an idea how input data should look like
    ###selecting order data
    @task(log_stdout=True)
    def create_engine(snowflake_salesforce):
        config = configparser.ConfigParser()
        engine=create_engine(URL(**config[snowflake_salesforce]))
    
    with Flow('UWG-Mail') as flow:
        snowflake_credentials=PrefectSecret("Snowflake")
        connection=create_engine(snowflake_salesforce=snowflake_credentials)
    but resulting in this error
    [12:03 Uhr] Unexpected error: TypeError("unhashable type: 'dict'")
    Traceback (most recent call last):
      File "/usr/local/lib/python3.8/site-packages/prefect/engine/runner.py", line 48, in inner
        new_state = method(self, state, *args, **kwargs)
      File "/usr/local/lib/python3.8/site-packages/prefect/engine/task_runner.py", line 863, in get_task_run_state
        value = prefect.utilities.executors.run_task_with_timeout(
      File "/usr/local/lib/python3.8/site-packages/prefect/utilities/executors.py", line 298, in run_task_with_timeout
        return task.run(*args, **kwargs)  # type: ignore
      File "<input>", line 36, in create_engine
      File "/usr/local/lib/python3.8/configparser.py", line 959, in __getitem__
        if key != self.default_section and not self.has_section(key):
      File "/usr/local/lib/python3.8/configparser.py", line 668, in has_section
        return section in self._sections
    TypeError: unhashable type: 'dict'
    ✅ 1
    m
    k
    • 3
    • 13
  • p

    peter zhao

    07/02/2021, 3:35 PM
    Good morning! I*m having issues with starting my prefect server locally on my machine (mac) here's the error message upon prefect startup:
    $prefect server start
    Pulling postgres  ... done
    Pulling hasura    ... done
    Pulling graphql   ... done
    Pulling apollo    ... done
    Pulling scheduler ... done
    Pulling ui        ... done
    Creating network "prefect-server" with the default driver
    Creating t_postgres_1 ... done
    Creating t_hasura_1   ... done
    Creating t_hasura_1   ... error
    
    ERROR: for t_hasura_1  Cannot start service hasura: driver failed programming external connectivity on endpoint t_hasura_1 (d6f6316d7f501eb40399dccdacd6bce8c09e565a6057ec6c6d5433274be1f707): Bind for 0.0.0.0:3000 failed: port is already allocated
    
    ERROR: for hasura  Cannot start service hasura: driver failed programming external connectivity on endpoint t_hasura_1 (d6f6316d7f501eb40399dccdacd6bce8c09e565a6057ec6c6d5433274be1f707): Bind for 0.0.0.0:3000 failed: port is already allocated
    ERROR: Encountered errors while bringing up the project.
    on docker here's the error message for that container t_hasura_1:
    t_hasura_1 exited with code 128
    k
    • 2
    • 5
  • p

    peter zhao

    07/02/2021, 3:49 PM
    After starting prefect-server, I get this error in the logs.
    apollo_1     | 2021-07-02T15:47:56.760Z {"message":"Cannot query field \"api\" on type \"Query\".","locations":[{"line":2,"column":3}],"extensions":{"code":"GRAPHQL_VALIDATION_FAILED"}}
    When I access the gui, website partially loads
    k
    • 2
    • 49
  • b

    Bruno Murino

    07/02/2021, 4:24 PM
    Hi everyone — this may be a silly question, but on the UI there’s a page called “notifications” but I couldn’t find any documentation on how to “create” a notification or how it works.. can anyone shed some light to this please?
    j
    k
    • 3
    • 7
Powered by Linen
Title
b

Bruno Murino

07/02/2021, 4:24 PM
Hi everyone — this may be a silly question, but on the UI there’s a page called “notifications” but I couldn’t find any documentation on how to “create” a notification or how it works.. can anyone shed some light to this please?
j

Jenny

07/02/2021, 4:38 PM
Hi @Bruno Murino - notifications are used by Prefect to update you on important changes in your account such as new team members or invitations; automation failures; paused tasks awaiting approval and public announcements.
If you want to set up a notification about flow states etc you can use the automations tab on the dashboard or cloud hooks in flow settings. (Or the relevant hook mutations).
b

Bruno Murino

07/02/2021, 4:59 PM
So there’s no way to have a custom notification to appear in the UI? Also, I think automations are only available on Cloud, not Server :(
k

Kevin Kho

07/02/2021, 5:11 PM
Yes they are a Cloud only feature. What do you mean by custom notification?
There are Cloud Hooks in Server that support Prefect Messages
b

Bruno Murino

07/06/2021, 8:41 AM
I couldn’t find hooks to create a Prefect Message, is there any documentation on it?
j

Jenny

07/06/2021, 9:15 AM
Hi Bruno - there is currently no mutation to create a custom Prefect Message/Notification. If you want to give more details of your use case we can maybe help you find a solution.
View count: 1