https://prefect.io logo
Title
e

eddy davies

01/25/2023, 1:20 PM
Where does prefect decide which packages to install?
👍 1
e

eddy davies

01/25/2023, 1:50 PM
Does it work with
pyproject.toml
?
c

Christopher Boyd

01/25/2023, 2:14 PM
My understanding is that
pyproject.toml
supplants
setup.py
, which currently our repository is not configured for
If you want to open an issue for a feature enhancement on this, I’m sure it can be reviewed
e

eddy davies

01/25/2023, 2:40 PM
Ye it keeps everything nicely in one file, I will open a feature enhancement
Found this issue, could you add the feature enhancement label to it please?
z

Zanie

01/25/2023, 4:28 PM
Sorry I’m confused about how the internal file we are using affects your usage
You can use Prefect with a
pyproject.toml
even though we are not using one for development ourselves.
e

eddy davies

01/25/2023, 4:56 PM
Oh I got the two mixed up, how do I tell prefect to install from my
pyproject.toml
my kubernetes deployment is erroring on package not found?
z

Zanie

01/25/2023, 4:58 PM
The most common pattern is to create an image based on the Prefect image with your project installed.
e

eddy davies

01/25/2023, 5:30 PM
When specifying that image I create in my
kubernetes-job
block here, will it be looking on docker hub, so something like 'eddywd/prefect_pandas'?
z

Zanie

01/25/2023, 5:33 PM
You could push it to DockerHub or make it available on a registry on Kubernetes / GCP / etc. depending on your infrastructure.
e

eddy davies

01/25/2023, 8:07 PM
My
pyproject.toml
was created to work with poetry and so has this in the build systems:
[build-system]
requires = ["poetry-core"]
build-backend = "poetry.core.masonry.api"
Does that need to be changed to setup tools:
[build-system]
requires = ["setuptools>=61.0"]
build-backend = "setuptools.build_meta"
to match the base prefect image?
z

Zanie

01/25/2023, 8:12 PM
The Prefect base image doesn’t care what tool you’re using to build your project
:thank-you: 1
We don’t use a virtual environment though, so you’ll probably want to ensure Poetry does not attempt to install into one.
e

eddy davies

01/26/2023, 6:05 PM
Great thanks