Stéphan Taljaard
09/16/2022, 1:44 PMModuleNotFoundError: No module named 'gcsfs'
It's strange because the environment that my agent is running in has gsfs
installed and I have "EXTRA_PIP_PACKAGES": "gcsfs"
in my Docker Block...
Any tips?{
"EXTRA_PIP_PACKAGES": "gcsfs",
"GOOGLE_APPLICATION_CREDENTIALS": "/opt/prefect/dev-user-staljaard.json"
}
Volumes = [ "/home/stephan/di/dev-user-staljaard.json:/opt/prefect/dev-user-staljaard.json" ]
Auto Remove = trueAnna Geller
Stéphan Taljaard
09/16/2022, 2:06 PMprefect.exceptions.PrefectHTTPStatusError: Server error '500 Internal Server Error' for url '<https://api.prefect.cloud/api/accounts/xxx/workspaces/xxx/deployments/>'
Response: {'exception_message': 'Internal Server Error'}
For more information check: <https://httpstatuses.com/500>
Any issues currently with the API for which I should wait before testing again and completing the ticket? https://prefect.status.io/ seems clear.Anna Geller
Stéphan Taljaard
09/19/2022, 11:03 AMAttributeError: module 'docker' has no attribute 'from_env'
I'm trying out a Subprocess block for now; need to make progress. I'll revisit gain and create a detailed issue.Anna Geller
import json
from prefect.infrastructure import DockerContainer
from prefect.filesystems import GCS
service_account_info = json.load(open("/Users/anna/sa.json"))
gcs = GCS(
bucket_path="prefect-orion/flows",
service_account_info=str(service_account_info),
)
gcs.save("dev", overwrite=True)
docker_block = DockerContainer(
image="prefecthq/prefect:2-python3.10", env={"EXTRA_PIP_PACKAGES": "gcsfs"}
)
docker_block.save("dev", overwrite=True)
# CLI
pip install gcsfs
prefect deployment build -n dev -q dev -sb gcs/dev -ib docker-container/dev -a flows/healthcheck.py:healthcheck
prefect deployment run healthcheck/dev
prefect agent start -q dev
Stéphan Taljaard
09/19/2022, 11:12 AMAnna Geller
Stéphan Taljaard
09/19/2022, 11:14 AMAnna Geller
Stéphan Taljaard
09/21/2022, 11:06 AMAnna Geller
Stéphan Taljaard
09/21/2022, 11:39 AM