Nic
01/16/2023, 2:04 PMGet credentials to access Prefect Cloud. Expects an identifying token as the bearer token.
How do i obtain the identifying token to login via this?Tadej Svetina
01/16/2023, 6:38 PMJean-Michel Provencher
01/16/2023, 6:54 PMRam Vuppaladadiyam
01/16/2023, 10:15 PMTask.set_dependencies()
. In V2, the equivalent of the ShellTask
class seems to be the shell_run_command
function in the prefect-shell
package. Additionally, V2 seems to be much more declarative with a focus on the @task
and @flow
decorators. Is there a way to still wire up dependencies imperatively in V2? If one did, would it be an anti-pattern?
For context, we have a large set of jobs and dependencies listed in yaml files. In V1, we could parse the yaml, create ShellTasks, and wire up dependencies with Task.set_dependencies()
. I'm looking for the equivalent in V2. I don't see references to that functionality in the V2 docs, but perhaps I'm missing it. Thank you!Steven Trimboli
01/16/2023, 11:09 PMfatal: could not read Username for '<https://github.com>': No such device or address
With my ssh link, the error I receive is:
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
To be clear, this repo is in a part of an organization which I am a member of and not an admin/owner, but I do have read/write access to the repo itself.
Does anyone have a solution, workaround or have has similar issues?wonsun
01/17/2023, 1:05 AMTim Galvin
01/17/2023, 1:29 AM.submit
and .map
methods are used? mypy
is getting a little confused, I think when I have to resort to using the wait_for=
argument in this methods.
Does anyone have a preferred or generally awesome linter set up that works well with prefect that they can share?eddy davies
01/17/2023, 10:15 AMpoetry add prefect-airbyte
, seemed to work with pip but running all my projects with poetry for consistency
╰─ poetry add prefect-airbyte ─╯
Using version ^0.2.0 for prefect-airbyte
Updating dependencies
Resolving dependencies... (0.0s)
AssertionError
at ~/Library/Application Support/pypoetry/venv/lib/python3.10/site-packages/poetry/mixology/incompatibility.py:113 in __str__
109│ )
110│
111│ def __str__(self) -> str:
112│ if isinstance(self._cause, DependencyCause):
→ 113│ assert len(self._terms) == 2
114│
115│ depender = self._terms[0]
116│ dependee = self._terms[1]
117│ assert depender.is_positive()
Khyaati Jindal
01/17/2023, 11:20 AMElliott Wilson
01/17/2023, 12:40 PM/data/prefect
and it seems that it can not pull the flow from the deployment when using a path.
I have also created a new repo which has the deployment and the flow in the root directory and this works with the same PAT token.
I am not sure if its an issue with the nested path or permissions on the file. Does any one have any ideas? I have included the deployment and stack trace, in the thread.Trevor Kramer
01/17/2023, 2:17 PMJoe
01/17/2023, 2:43 PM/assets
). So if anyone has any configuration they've gotten to work, I'd appreciate a hand.Aleksandr Liadov
01/17/2023, 4:40 PMTaskRunner
while the deployment with Deployment.build_from_flow
?Nate Roberts
01/17/2023, 5:31 PMprefect server start
, two of the containers get stuck in a restart loop. Could anyone assist with next steps in fixing these issues below?
Error from the container t_hasura_1 : graphql-engine: error while loading shared libraries: /usr/lib/aarch64-linux-gnu/libpq.so.5: file too short
Error from the container t_graphql_1 : Error: HTTPConnectionPool(host='hasura', port=3000): Max retries exceeded with url: /v1/query (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x4009e17990>: Failed to establish a new connection: [Errno -2] Name or service not known'))
Mansour Zayer
01/17/2023, 6:42 PMPrefect 2.7.3
with prefect_aws 0.2.3 prefect-snowflake 0.25 prefect-sqlalchemy 0.2.2
on windows (running locally for now), and when I run my flow, I get these 3 warnings first (even when I don't use them)
Warning! Failed to load collection 'prefect_aws': ImportError: cannot import name 'CredentialsBlock' from 'prefect.blocks.abstract'
Warning! Failed to load collection 'prefect_snowflake': ImportError: cannot import name 'CredentialsBlock' from 'prefect.blocks.abstract'
Warning! Failed to load collection 'prefect_sqlalchemy': ImportError: cannot import name 'CredentialsBlock' from 'prefect.blocks.abstract'
And when I use secret_reader
in my flow, I get this error:
from prefect.blocks.abstract import CredentialsBlock
ImportError: cannot import name 'CredentialsBlock' from 'prefect.blocks.abstract'
Any ideas what might be the problem?
ThanksSurat Mukker
01/17/2023, 8:13 PMSamuel Kohlleffel
01/17/2023, 9:22 PMcanceling
state. How long should it take for a scheduled flow run to move into a cancelled
state?Adrian Fernandez
01/17/2023, 10:34 PMMappingLengthMismatch
error while doing this (more details on the thread) and I have the impression that kwargs can't be unmapped
, neither explicitly nor implicitly. My current work around is to wrap the desired task (A) with another task that doesn't take kwargs and call task a as a function task_a.fn()
.Nikhil Jain
01/17/2023, 10:49 PMserverless
. However, I am running into issues with module import errors when I run the lambda.
Runtime.ImportModuleError: Unable to import module 'serverless.enrollment.app_status_change_handler': No module named 'orjson.orjson'
PS: my lambda setup was working fine when I was using prefect1.Jacob Blanco
01/17/2023, 10:57 PMSenthil M.K.
01/17/2023, 11:43 PMTomás Emilio Silva Ebensperger
01/18/2023, 1:17 AMdef make_flow(f: Callable) -> Callable:
@wraps(f)
def wrapper(self, *args, **kwargs):
return flow(log_prints=True)(f)(self, *args, **kwargs)
return wrapper
The issue is, although i am able to run itTomás Emilio Silva Ebensperger
01/18/2023, 1:18 AMTomás Emilio Silva Ebensperger
01/18/2023, 1:19 AMNikhil Jain
01/18/2023, 4:32 AM"RuntimeError: Orion requires sqlite >= 3.24.0 but we found version 3.7.17\n"
I am using prefect2 cloud app with no changes for sqlite. Any ideas why this is happening?Jari Rosti
01/18/2023, 7:34 AMPREFECT_LOGGING_EXTRA_LOGGERS: mylogger
on agent and on orion server, and various combinations of setting the handler for my logger in the flow.
I have self-hosted Prefect 2.7.8. Any ideas what should I check in the configuration?Idan
01/18/2023, 7:56 AMCrash detected! Execution was interrupted by an unexpected exception: RecursionError: maximum recursion depth exceeded while calling a Python object
And no additional logs available. Any ideas?
EDIT: Prefect 2 🙂Olivér Atanaszov
01/18/2023, 9:06 AMSander
01/18/2023, 10:22 AMNils
01/18/2023, 10:47 AM