Stéphan Taljaard
07/04/2021, 4:22 PMSami Serbey
07/05/2021, 12:31 PMBeeshal Rizal
07/06/2021, 1:24 AMBruno Murino
07/06/2021, 7:27 AMBruno Murino
07/06/2021, 8:42 AMBruno Murino
07/06/2021, 8:45 AMflow.schedule = get_schedule()
import datetime
from datetime import datetime, timedelta
from prefect.schedules import clocks, Schedule
def get_schedule():
now = datetime.utcnow()
clock1 = clocks.IntervalClock(
interval=timedelta(minutes=10),
parameter_defaults={
"scope": "full",
},
)
my_schedule = Schedule(
clocks=[
clock1,
]
)
return my_schedule
Scarlett King
07/06/2021, 4:23 PMMadison Schott
07/06/2021, 7:06 PMTask 'DbtShellTask': Starting task run...
[2021-07-06 15:05:27-0400] ERROR - prefect.DbtShellTask | Command failed with exit code 2
[2021-07-06 15:05:27-0400] INFO - prefect.TaskRunner | FAIL signal raised: FAIL('Command failed with exit code 2')
[2021-07-06 15:05:28-0400] INFO - prefect.TaskRunner | Task 'DbtShellTask': Finished task run for task with final state: 'Failed'
[2021-07-06 15:05:28-0400] INFO - prefect.FlowRunner | Flow run FAILED: some reference tasks failed.
Евгений Берендяев
07/07/2021, 8:35 AMCannot connect to Prefect Server at http://localhost:4200/graphqlThis variable is set to https://prefect-apollo.example.com/graphql I’m wondering why the UI still points to stupid localhost
Евгений Берендяев
07/07/2021, 10:56 AMprefect agent docker start --label common --api <https://prefect-apollo.example.com/graphql>
it says No agent API token provided
according to this API keys can be generated only by using Perfect Cloud, not onpremise version
Can I attach docker agent to my onpremise installation?bral
07/07/2021, 5:22 PMRaed
07/07/2021, 6:56 PMClemens
07/09/2021, 8:04 AMЕвгений Берендяев
07/09/2021, 8:24 AMPERFECT_SERVER_URL
or flow.register()
param
(I’m pretty new in data ops and still thinking in “devops” categories like ci/cd pipelines, sorry 😞 )Chris Bowen
07/09/2021, 5:11 PMTOML
file. I'm not sure where/what generates the referenced Markdown file though. I put some docstrings into some of my flows and registered them, but I don't see a Markdown file generated anywhere, nor do I see any change on the UI that displays my doc string.
Feels like I might be missing something (or another Prefect Docs page). Any advice is greatly appreciated! Thank you.Goh Rui Zhi
07/12/2021, 1:16 PMprefect server start --postgres-url postgres://<username>:<password>@hostname:<port>/<dbname>
or similar commands and can only make use of value.yaml to change the configurations. Any help will be appreciated 🙂
Edit: I also realised that the database_url stated in the logs does not have the password field, it is just username@hostname:port/dbname. Is this expected?Scarlett King
07/12/2021, 2:06 PMRaúl Mansilla
07/12/2021, 9:47 PM[context.secrets]
Goh Rui Zhi
07/13/2021, 2:20 AMError from server (BadRequest): container “graphql” in pod “prefect-poc-graphql-76462537d4-4v7c6” is waiting to start: PodInitializing
All other pods seems to be deployed and running well. Anyone knows why this is happening? Also, my UI is not showing up as well, probably due to this issue.Евгений Берендяев
07/13/2021, 8:03 AMpython3 example1.py
. The .py file mentioned in this command is copied from that page.
unfortunately the registered flow does not start and shows me an error
[13 July 2021 10:52am]: Failed to load and execute Flow's environment: ModuleNotFoundError("No module named '/Users/mylocaluser/'")
anyone knows why?Zhilong Li
07/13/2021, 9:26 AMGoh Rui Zhi
07/13/2021, 12:59 PMapolloApiUrl
in values.yaml
before deploying the helm chart. And indeed I do see the settings.json
reflecting this. However, it seems that graphql
is still being requested from <https://localhost:4200/graphql>
and the user interface is permanently stucked at its loading page.
May I know what I did wrong? Also, I am not able to configure my config.toml
as only the deployment agent has access to it, and therefore I can only play around with the chart, values and templates.Alex Furrier
07/13/2021, 4:00 PMFailed to set task state with error: HTTPError('413 Client Error: Payload Too Large for url: <http://prefect-apollo.prefect:4200/graphql/graphql>')
Traceback (most recent call last):
File "/opt/conda/lib/python3.8/site-packages/prefect/engine/cloud/task_runner.py", line 91, in call_runner_target_handlers
state = self.client.set_task_run_state(
File "/opt/conda/lib/python3.8/site-packages/prefect/client/client.py", line 1518, in set_task_run_state
result = self.graphql(
File "/opt/conda/lib/python3.8/site-packages/prefect/client/client.py", line 298, in graphql
result = <http://self.post|self.post>(
File "/opt/conda/lib/python3.8/site-packages/prefect/client/client.py", line 213, in post
response = self._request(
File "/opt/conda/lib/python3.8/site-packages/prefect/client/client.py", line 459, in _request
response = self._send_request(
File "/opt/conda/lib/python3.8/site-packages/prefect/client/client.py", line 375, in _send_request
response.raise_for_status()
File "/opt/conda/lib/python3.8/site-packages/requests/models.py", line 943, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 413 Client Error: Payload Too Large for url: <http://prefect-apollo.prefect:4200/graphql/graphql>
Nathan Evans
07/13/2021, 5:56 PMAuthorizationError: No agent API token provided
my task definition has a PREFECT__CLOUD__API_KEY, and its set to a service account api key. any ideas?Alex Furrier
07/13/2021, 8:44 PMStartFlowRun(flow_name="my registered flow", project_name="my project")
with a registered flow. I pass the name of the registered flow but when I try to execute the flow of flows I get this error:
Unexpected error: ValueError("Flow 'my registered flow' not found.")
To double check the name is correct in the Interactive API I queried for flows and found the flow name I passed.
Any idea what I'm doing wrong? Attempting to execute this on k8s and a Dask cluster if that makes a difference.Kenneth Miller
07/13/2021, 9:49 PMjaehoon
07/14/2021, 3:10 AMRaúl Mansilla
07/14/2021, 10:30 AMrequests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=4200): Max retries exceeded with url: /graphql (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f373f0b32b0>: Failed to establish a new connection: [Errno 111] Connection refused'))
Alex Furrier
07/14/2021, 8:25 PMHeartbeat process died with exit code 1
and the few children tasks left incomplete are unsuccsful.
Any ideas how to debug why the parent mapping task is dying?Kevin Weiler
07/14/2021, 9:17 PMextra_loggers
config at the level of my flow (as described here) but it’s not having the desired effect (logging stuff from my imported code)