Stefan
01/09/2023, 12:53 PMMichal Mucha
01/09/2023, 1:31 PM.notify(body="message")
I want to tag @ here
in certain circumstances, not getting the intended result thus far - it prints out plain text without raising notifications.
tried various syntax options: <! here> <! here|here> <@here>
and all the combinations I've seen in Slack docs.
I can see Apprise is used under the hood. Does anyone know the correct syntax? Is the syntax deactivated because Apprise formats it as an attachment block? Is the syntax correct but something wrong with my webhook config?
ThanksMatthew Scanlon
01/09/2023, 2:40 PMSubmission failed. PrefectHTTPStatusError: Server error '500 Internal Server Error' for url '<https://api.prefect.cloud/api/accounts/XXXXXXXX/workspaces/XXXXXXXXX/deployments/XXXXXXXXX>' Response: {'exception_message': 'Internal Server Error'} For more information check: <https://httpstatuses.com/500>
Igor Morgunov
01/09/2023, 2:55 PMcluster_config_block = KubernetesClusterConfig.load("data-engineering")
k8s = KubernetesJob(
cluster_config=cluster_config_block
)
deployment = Deployment.build_from_flow(
flow=test,
name="test",
version="0.0.1",
tags={"from-python-object"},
parameters={"name": "test-run"},
infra_overrides={"env": {"PREFECT_LOGGING_LEVEL": "DEBUG"}},
work_queue_name="test",
infrastructure=k8s
)
if __name__ == "__main__":
result = deployment.apply()
print(result)
I don't see where/how to pass the AWS credentials to deployment, without which ofc the flow run results in 401 Unauthorized
responseRasmus Lindqvist
01/09/2023, 3:22 PMscott
01/09/2023, 6:50 PMtry ... catch
with Prefect 2 tasks, if it’s possible that is? I’d like to be able to skip a failed task and let downstream tasks proceed but it seems like a Failed task kills the entire flow. Or maybe I’m wrong?Jean-Michel Provencher
01/09/2023, 7:13 PMalex
01/09/2023, 9:00 PMNace Plesko
01/10/2023, 12:36 AMenv={"PREFECT__CLOUD__HEARTBEAT_MODE": "thread"}
to my run config. I added that but the tasks are still being stuck. Is there anything else I need to configure in order to activate zombie killer?iKeepo w
01/10/2023, 3:57 AMBryan Whiting
01/10/2023, 4:38 AMTibs
01/10/2023, 7:26 AMdeployment build deployment_utils/maintenance.py:maintenance -n maintenance/maintenance -sb s3-bucket/<my_s3_bucket_block_name> -a
f"Successfully uploaded {file_count} files to {deployment.location}",
if not self.storage.basepath.endswith("/")
AttributeError: 'NoneType' object has no attribute 'endswith'
I tried also providing a basepath to the S3, and get a similar error.
AttributeError: 'PosixPath' object has no attribute 'endswith'
Files are uploaded to S3, but this error is raised.
Anyone know what could be the issue?Rasmus Lindqvist
01/10/2023, 9:43 AMStephen Herron
01/10/2023, 9:47 AMSnowflakeCredentials
from a SnowflakeConnector
?Karthik Anavarth
01/10/2023, 9:54 AMMark NS
01/10/2023, 10:38 AMDockerRegistry
block working with AWS ECR, but it seems the password expires after some hours. Another thread suggests that an ECR block is being worked on, but this PR is blocked for a variety of reasons.
In the same thread @Anna Geller suggests using ECSTask
as the run-infrastructure. Is that still the only workaround for using ECR? I'd prefer to continue using DockerContainer
if possible, as I'm not familiar with ECS.Danilo Drobac
01/10/2023, 11:23 AMFROM prefecthq/prefect:2.7.7-python3.8
RUN ["pip", "install", "gcsfs"]
Returns the error:
/bin/sh: 1: ["pip",: not found
Has anybody else had this error/know what the fix it? I'm assuming its not an issue with the base image?Bogdan Serban
01/10/2023, 12:03 PMPrefect 2.7.0
and am trying to set up some hooks to do some stuff (db updates and sending queue messages) whenever the state of a flow changes. I have tried using prefect-alert, but unfortunately that does not trigger when I am running the flow from a deployment. I am thinking that I could try and create a custom notification block, but it is not very clear if it is possible and how I could do so. I would really appreciate any suggestions on that, or, any pointers to other mechanisms to define custom flow state update callbacks that I might have missed.James Phoenix
01/10/2023, 1:00 PMChris Gunderson
01/10/2023, 2:11 PMTorstein Molland
01/09/2023, 3:00 PM0 0 0 5 JAN,MAR,JUN,SEP,DEC * *
. When I click save I get an error message "Failed to update deployment".
How can this be resolved? Thank you in advance! 😊Nikhil Jain
01/10/2023, 1:08 AMCancelled
and Cancelling
states?
2. What is Notify type
in the notification settings? (screenshot below).lialzm
01/10/2023, 3:45 PMDownloading flow code from storage at None
Flow could not be retrieved from deployment.
my code
ali= RemoteFileSystem.load("ali")
deployment = Deployment.build_from_flow(
flow=download,
name="test",
storage=ali,
schedule=(CronSchedule(cron="0 16 * * *"))
)
deployment.apply()
James Phoenix
01/10/2023, 3:46 PMJames Phoenix
01/10/2023, 3:47 PMprefect kubernetes manifest orion | kubectl apply -f -
James Phoenix
01/10/2023, 3:50 PMIdan
01/10/2023, 3:50 PMos.seteuid(priv_user_id)
(and then later resets to original_user_id
).
This is run in a container, so the original_user_id
is root
, which entails PREFECT_HOME
is /root/.prefect/
.
Our tasks are long-running, so we also cache them. Then, every now and then, a task succeeds, but fails with:
Crash detected! Execution was interrupted by an unexpected exception: Traceback (most recent call last):
File "/usr/lib/python3.10/pathlib.py", line 1175, in mkdir
self._accessor.mkdir(self, mode)
PermissionError: [Errno 13] Permission denied: '/root/.prefect/storage'
During handling of the above exception, another exception occurred:
PermissionError: [Errno 13] Permission denied: '/root/.prefect/storage'
Any smart ideas how to facilitate both needs?James Phoenix
01/10/2023, 3:50 PMPaco Ibañez
01/10/2023, 5:54 PMparameter_openapi_schema
Jean-Michel Provencher
01/10/2023, 6:38 PM