Florian Giroud
09/27/2022, 10:57 PMMichael Hadorn
09/28/2022, 5:48 AMRobin Eklund
09/28/2022, 8:14 AMprefect deployment build ./log_flow.py:log_flow -n log-simple -q test
which generate the yaml file. But it looks slightly different for infrastructure
where in the tutorial they have:
infrastructure:
type: process
env: {}
labels: {}
name: null
command:
- python
- -m
- prefect.engine
stream_output: true
and i have:
infrastructure:
type: process
env: {}
labels: {}
name: null
command: null
stream_output: true
block_type_slug: process
_block_type_slug: process
And when i run prefect deployment apply log_flow-deployment.yaml
I get this error:
prefect.exceptions.PrefectHTTPStatusError: Client error '403 Forbidden' for url '<prefect_domain>/api/block_types/016c45c9-6346-49c1-a1cb-da3021f915b2'
Response: {'detail': 'protected block types cannot be updated.'}
For more information check: <https://httpstatuses.com/403>
An exception occurred.
Anyone knows what i need to do?Giorgio Basile
09/28/2022, 10:09 AMCarlos Paiva
09/28/2022, 10:44 AMINFO: pip is looking at multiple versions of feedparser to determine which version is compatible with other requirements. This could take a while.
Collecting feedparser>=5.0.1
Using cached feedparser-6.0.10-py3-none-any.whl (81 kB)
Using cached feedparser-6.0.9-py3-none-any.whl (81 kB)
Using cached feedparser-6.0.8-py3-none-any.whl (81 kB)
Using cached feedparser-6.0.7-py3-none-any.whl (81 kB)
Using cached feedparser-6.0.6-py3-none-any.whl (80 kB)
Using cached feedparser-6.0.5-py3-none-any.whl (80 kB)
Using cached feedparser-6.0.4-py3-none-any.whl (80 kB)
INFO: pip is looking at multiple versions of feedparser to determine which version is compatible with other requirements. This could take a while.
Using cached feedparser-6.0.3-py3-none-any.whl (80 kB)
Using cached feedparser-6.0.2-py3-none-any.whl (80 kB)
Using cached feedparser-5.2.1.zip (1.2 MB)
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [1 lines of output]
error in feedparser setup command: use_2to3 is invalid.
[end of output]
1. How can I solve this?
2. Can’t we upgrade the feedparser requirement?Thomas Fredriksen
09/28/2022, 11:22 AMagent-default
, agent-small
, agent-medium
, agent-large
and agent-huge
, each with different amounts of available RAM and CPU.
Now that we with Orion can set KubernetesJob
-infrastructure blocks in the Deployment
-object, having different agents or queues for the different resource tiers no longer seems necessary.
Does anyone know of examples where agents/queues have been used explicitly? I noticed for examples the documentation mention agent queue prioritiesDavid
09/28/2022, 12:32 PMVille Parkkinen
09/28/2022, 1:00 PMtask_input_hash
hashes the block differently on each flow run, and therefore causing cache misses. I’ll attach code snippets needed to reproduce the issue in this thread.eddy davies
09/28/2022, 1:23 PMhelm install --values k8s-agent.yaml prefect-agent prefect/prefect-agent && \
helm install --values k8s-orion.yaml prefect-orion prefect/prefect-orion
Adam Eury
09/28/2022, 2:02 PMset_state
flow run endpoint would be used for?
https://docs.prefect.io/api-ref/rest-api/#/Flow%20Runs/set_flow_run_state_flow_runs__id__set_state_postHawkar Mahmod
09/28/2022, 2:23 PM.fn
that contains a call to get_run_logger
. I get a RuntimeError: There is no active flow or task run context
exceptionMatthew Millendorf
09/28/2022, 3:11 PMAlexey Stoletny
09/28/2022, 3:26 PMraise PrefectHTTPStatusError.from_httpx_error(exc) from exc.__cause__
prefect.exceptions.PrefectHTTPStatusError: Client error '403 Forbidden' for url '<https://api.prefect.cloud/api/accounts/43db7ccd-9f39-41f2-8989-000b28747858/workspaces/cedd89e9-9f12-421e-a17b-94045c976a2a/block_types/e91e7544-7ecd-4fa6-b6d7-a53068cb67fc>'
Response: {'detail': 'protected block types cannot be updated.'}
For more information check: <https://httpstatuses.com/403>
Alexey Stoletny
09/28/2022, 3:26 PMTomás Emilio Silva Ebensperger
09/28/2022, 3:57 PMprefect agent start --work-queue blabla
Guillaume G
09/28/2022, 4:05 PMget_directory
I got
Exception has occurred: TypeError
object of type 'PosixPath' has no len()
Do you know how to use SMB block ?
I also get this issue https://github.com/PrefectHQ/prefect/issues/6971 when I try to put_directory
Thanks 🙂Ilya Galperin
09/28/2022, 4:05 PM2.4.1
release which include the Flow run URL on Cloud? Our notifications seem to still be coming through in the “old style” i.e.David Cupp
09/28/2022, 4:20 PMLance Cuthbert
09/28/2022, 6:09 PMTomás Emilio Silva Ebensperger
09/28/2022, 6:17 PMcommand=/home/ubuntu/project/env/bin/prefect agent start --work-queue "my queue"
This works fine but then when i run flows in the UI the worker is using the global python runtime and no the one in the virtual environment, please helpChris Gunderson
09/28/2022, 6:34 PMfrom pydantic import BaseModel
class CustomList(BaseModel):
data: list[str]
@flow(name = "Fidelity Allocations")
def FidelityAllocationsFlow(toEmail: CustomList):
#code....
if __name__ == "__main__":
emailAddress = CustomList(data=['<mailto:cgunderson@spiderrockadvisors.com|cgunderson@spiderrockadvisors.com>'])
FidelityAllocationsFlow(toEmail=emailAddress)
Chris Reuter
09/28/2022, 6:58 PMAmol Shirke
09/28/2022, 7:23 PMAndreas Nigg
09/28/2022, 7:59 PMFile "/usr/local/lib/python3.9/site-packages/prefect/client.py", line 226, in raise_for_status
raise PrefectHTTPStatusError.from_httpx_error(exc) from exc.__cause__
prefect.exceptions.PrefectHTTPStatusError: Server error '500 Internal Server Error' for url '<https://api.prefect.cloud/api/accounts/bd169b15-9cf0-41df-9e46-2233ca3fcfba/workspaces/f507fe51-4c9f-400d-8861-ccfaf33b13e4/task_runs/|https://api.prefect.cloud/api/accounts/bd169b15-9cf0-41df-9e46-2233ca3fcfba/workspaces/f507fe51-4c9f-400d-8861-ccfaf33b13e4/task_runs/>'
Response: {'exception_message': 'Internal Server Error'}
Rio McMahon
09/28/2022, 8:34 PMprefect.infrastructure.process - Process 'meticulous-manatee' exited with status code: -9
Any guidance?Nick DeCraene
09/28/2022, 8:45 PM@task(name="extract(ctx.id)")
def extract(ctx):
These would then be displayed in the UI as extract(4)
for example if our flow was running for ctx.id=4.
I haven't been able to find anything like this for 2.0, am I just missing something?James Constable
09/28/2022, 10:09 PMAndrew Reeve
09/28/2022, 10:56 PMAndrew Reeve
09/28/2022, 10:57 PMAttributeError: 'Credentials' object has no attribute 'project'. Did you mean: 'project_id'?
It looks like your PR will fix this @Andrew Huang.Deepak
09/28/2022, 11:08 PMRuntimeError: Java gateway process exited before sending its port number
when I run pyspark methods inside a task.