Alex F
12/09/2022, 6:40 PM17:06:30 INFO Agent1
Submitted for execution: PID: 3327309
17:06:31 ERROR execute flow-run
Failed to load and execute flow run: PermissionError(13, 'Permission denied')
John-Craig Borman
12/09/2022, 6:40 PMAniruddha Bharadwaj
12/09/2022, 7:50 PMprefect deployment build ./data_source_flows/master_flow.py:master_flow -n master_flow -q test --storage-block github/flows --apply
Dillan Smith
12/09/2022, 8:15 PMhelm install prefect-orion-poc prefect/prefect-orion --values helm-orion-values.yaml
and my values file is
namespaceOverride: helm-prefect
postgresql:
auth:
password: password
ingress:
enabled: true
It outputs Get the application URL by running these commands: <http://prefect.local/>
but that comes back as an unknown host. Im pretty new to K8S so any help is appreciated.Lucas Cavalcanti Rodrigues
12/10/2022, 10:48 PMEdmondo Porcu
12/11/2022, 2:23 PMNico Neumann
12/11/2022, 9:45 PMLucas Cavalcanti Rodrigues
12/11/2022, 10:15 PMEmma Rizzi
12/12/2022, 9:39 AMENTRYPOINT ["./set_umask.sh"]
https://codeyarns.com/tech/2017-07-21-how-to-set-umask-for-docker-container.html#gsc.tab=0
Is there a way to override the entrypoint of the flow ? Or any other solution to set umask?Anco
12/12/2022, 12:23 PMJoël Luijmes
12/12/2022, 1:48 PMrun_deployment
.
Assuming that all prefect flows are contained in the same repository, and are deployed to the same orion server. Are there any benefits/disadvantages over one or the other?Jelle Vegter
12/12/2022, 2:01 PMSanthosh Solomon (Fluffy)
12/12/2022, 2:14 PM12:48:12.659 | ERROR | prefect.infrastructure.process - Process 'optimal-toucanet' exited with status code: -9; This indicates that the process exited due to a SIGKILL signal. Typically, this is caused by high memory usage causing the operating system to terminate the process.
Ashley Felber
12/12/2022, 3:00 PMAdam Roderick
12/12/2022, 3:53 PMscott
12/12/2022, 4:20 PM@task
functions called from a @flow
- all of our work is done outside of Python called via make commands, which I currently use shell_run_command
for. However, you can’t put shell_run_command
within a function decorated with @task
. I could just remove the @task
decorator. Is there a workflow folks use to leverage @task
decorator that run shell commands?Sean Conroy
12/12/2022, 5:18 PMfrom prefect import task, Flow
@task
def get_value():
return 10
with Flow("task-results") as flow:
v = get_value()
print(v)
state = flow.run()
I get <Task: get_value>
instead of 10
. What am I doing wrong?scott
12/12/2022, 6:16 PMprefect deployment build
only allows for pointing at one file. If you want to pull in imports from other files like utility functions (not pypi packages) how do you suggest doing that? I assume we don’t have to have all code in the one file the deployment build command points at?Ashley Felber
12/12/2022, 6:32 PMNicolas Gastaldi
12/12/2022, 7:24 PMscott
12/12/2022, 8:32 PMprefect deployment update
? Do you just nuke your deployment.yaml file, and rerun prefect deployment build
then prefect deployment apply foo-deployment.yaml
? Maybe it depends on where storage is located? Im using GCS storage.Tomas Moreno
12/12/2022, 10:58 PMNikhil Jain
12/12/2022, 11:22 PMDan Marling
12/12/2022, 11:55 PMAshley Felber
12/12/2022, 11:59 PMif __name__ == "__main__":
extract_load_events ('20221030','20221030','<https://us1.api.clevertap.com/1/events.json','https://us1.api.clevertap.com/1/events.json?cursor=>')
scott
12/13/2022, 12:01 AMprefect agent …
on a VM as a service, does anyone have a setup for injecting secrets into the supervisord.conf
file for the prefect url and api key? A solution with chamber
would be ideal, but curious about any solution that worksAndy Yeung
12/13/2022, 1:22 AMDeepanshu Aggarwal
12/13/2022, 9:12 AMAndy Yeung
12/13/2022, 9:35 AMasyncio.gather
, calling submit
is required for asynchronous execution on the ConcurrentTaskRunner
.”Mark NS
12/13/2022, 9:56 AMdbt_cli_profile = DbtCliProfile(
name="dbt_dwh",
target=DEFAULT_BLOCK,
target_configs=PostgresTargetConfigs(
credentials=DatabaseCredentials.load(DEFAULT_BLOCK), schema="public"
),
)
dbt_cli_profile.save(name="dbt_dwh")
TypeError: Type is not JSON serializable: URL
Has anyone else seen this?