https://prefect.io
Join Slack
<@ULVA73B9P> my workers cant start Discovered type 'process' for work pool 'default'. Worker 'Proces...
s

Sergei

9 months ago
@Marvin my workers cant start Discovered type 'process' for work pool 'default'. Worker 'ProcessWorker 6c90b577-ffe6-45a4-b4e8-6a0fe718f982' started! 000846.326 | INFO | prefect.workers.process.processworker 6c90b577-ffe6-45a4-b4e8-6a0fe718f982 - Found 1 flow runs awaiting cancellation. 000846.392 | WARNING | prefect.workers.process.processworker 6c90b577-ffe6-45a4-b4e8-6a0fe718f982 - Unable to kill process 19796: The process was not found. Marking flow run as cancelled.
s
m
  • 2
  • 16
  • 70
<@ULVA73B9P> Where does prefect pull the code and run in a local server setup. I am doing a pull cod...
t

Tahir Uddin Khan

10 months ago
@Marvin Where does prefect pull the code and run in a local server setup. I am doing a pull code from git and it says git command not found.
t
m
n
  • 3
  • 34
  • 70
<@ULVA73B9P> Why am I getting this error when calling read_deployments? prefect.exceptions.PrefectH...
n

Nils

12 months ago
@Marvin Why am I getting this error when calling read_deployments? prefect.exceptions.PrefectHTTPStatusError: Client error '422 Unprocessable Entity' for url 'http://server:4200/api/deployments/filter' Response: {'exception_message': 'Invalid request received.', 'exception_detail': [{'type': 'extra_forbidden', 'loc': ['body', 'deployments', 'is_schedule_active'], 'msg': 'Extra inputs are not permitted', 'input': None}], 'request_body': {'flows': None, 'flow_runs': None, 'task_runs': None, 'deployments': {'operator': 'and_', 'id': None, 'name': None, 'paused': None, 'is_schedule_active': None, 'tags': {'operator': 'and_', 'all_': ['XXX'], 'is_null_': None}, 'work_queue_name': None}, 'work_pools': None, 'work_pool_queues': None, 'limit': None, 'offset': 0, 'sort': None}}
n
m
  • 2
  • 3
  • 70
Deprecation of prefect.filesystems.S3 I try to understand what exactly will happen after September 2...
t

Tobias Rohnstock

about 1 year ago
Deprecation of prefect.filesystems.S3 I try to understand what exactly will happen after September 2024. Given it is only removed from the Python package with the first Prefect release in October: • Will we still be able to use an older version of the Python package for managing the S3 blocks? • Will we still be able to retrieve/manage S3 blocks from Prefect Cloud? We currently use this class for creating, using, and removing our S3 blocks for the flow source code and the caching feature. Migrating the S3 blocks and re-deploying all existing flows would result in efforts on our side.
t
n
  • 2
  • 5
  • 70
<@ULVA73B9P> how can i configure pull_steps for deploying a flow when using the `.deploy` method on ...
t

Tom Matthews

over 1 year ago
@Marvin how can i configure pull_steps for deploying a flow when using the
.deploy
method on a flow?
t
m
k
  • 3
  • 29
  • 70
<@ULVA73B9P> How to override resource requirements (job variables) for a flow run running on a kuber...
i

Igor Kaluder

over 1 year ago
@Marvin How to override resource requirements (job variables) for a flow run running on a kubernetes work pool?
i
m
  • 2
  • 1
  • 70
Does anyone else struggle with the pricing for Prefect Cloud? You only get 3 user accounts which mak...
j

Jouke

over 1 year ago
Does anyone else struggle with the pricing for Prefect Cloud? You only get 3 user accounts which makes it completely useless for any org I've ever been in, but it costs more than half of our entire cloud bill (??) For reference something like Gitlab is only ~$40 per user, so prefect is over 10x as expensive! I am really struggling to see how we can justify such a price if our team can't even get individual accounts. And there seems to be no option to get more users without upgrading to the enterprise plan (presumably even more expensive?) Does anyone use the pro plan or is everyone using enterprise? And how can I sell this internally without sounding crazy?
j
b
  • 2
  • 1
  • 70
<@ULVA73B9P> my self-hosted prefect server ui loads, but there is no content shown i.e. no flows lis...
s

Simon

over 1 year ago
@Marvin my self-hosted prefect server ui loads, but there is no content shown i.e. no flows listed, no flow-runs, no content on the dashboard. The dashboard UI elements load, just not the content. The CLI seems to be working fine. I have tried restarting the prefect server, rebooting the ec2 instance on which it is running, and resetting the sqlite db. All to no avail. Have you any suggestions of what to try next?
s
m
  • 2
  • 5
  • 70
Started playing around Prefect today and ran into a problem. I am not able to `submit` some function...
n

Nil

about 2 years ago
Started playing around Prefect today and ran into a problem. I am not able to
submit
some functions as tasks.
class A:
    @task
    def holiday_from_universe(self) -> UniverseHoliday:
        return self._load_source_table("holiday", UniverseHoliday()) #_load_source_table is from a different module

@flow()
def trigger_ingest(name="Ingest Flow"):
    a = A(universe)
    a.holiday_from_universe.submit()

if __name__ == "__main__":
    trigger_ingest()
When I try to run, I get
AttributeError: 'function' object has no attribute 'submit'
.I will appreciate some help here
n
n
  • 2
  • 12
  • 70
I am trying to run a deployment via Docker. However, I receive the following error: ```FileNotFoundE...
s

sundeep

over 2 years ago
I am trying to run a deployment via Docker. However, I receive the following error:
FileNotFoundError: [Errno 2] No such file or directory: '/opt/prefect/flows'
Which is surprising because I don't use the above location to reference the flow. This is what my Docker file look like
FROM python:3.8-slim-buster

ARG PREFECT_API_KEY
ENV PREFECT_API_KEY=$PREFECT_API_KEY

ARG PREFECT_API_URL
ENV PREFECT_API_URL=$PREFECT_API_URL

ARG GCP_DATASET_NAME
ENV GCP_DATASET_NAME=$GCP_DATASET_NAME

ARG GCP_DATASET_TABLE_NAME
ENV GCP_DATASET_TABLE_NAME=$GCP_DATASET_TABLE_NAME

ARG GCP_PROJECT_ID
ENV GCP_PROJECT_ID=$GCP_PROJECT_ID

ARG GCP_REGION
ENV GCP_REGION=$GCP_REGION

COPY poetry.lock .
COPY pyproject.toml .

RUN pip install poetry --trusted-host <http://pypi.python.org|pypi.python.org> --no-cache-dir
RUN poetry config virtualenvs.create false
RUN poetry install --no-root --without dev


RUN mkdir scripts
copy scripts/ scripts

RUN mkdir config
COPY config/ config

RUN mkdir -p dbt/xetra
COPY dbt/xetra dbt/xetra
Any idea why Prefect is looking for the flow in the /opt/prefect/flows directory? I am running this via the Cloud
s
a
+2
  • 4
  • 20
  • 70
Previous919293Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by