Marcelo Ortega
08/30/2022, 2:35 PMkarteek
08/30/2022, 3:53 PMMatt Melgard
08/30/2022, 3:54 PMRuntimeError: File system created with scheme 'gcs' from base path '<gcs://mattmelgard-test-bucket-01>' could not be created. You are likely missing a Python module required to use the given storage protocol.
This is the CLI command I’m using to build the deployment:
prefect deployment build tutorial-flow/flow/tutorial-flow.py:my_flow -n tutorial-flow-k8s -t test -i kubernetes-job -sb gcs/tutorial-bucket
and I have a block defined for the bucket with the name tutorial-bucket
but I’m not sure what could be missing here, I have pretty much all the python packages installed via pip install 'prefect[all_extras]'
Anna Geller
08/30/2022, 4:26 PMresults
and state_handler
in 2.0?
with Flow(
"Subscriptions API Import",
result=GCSResult(bucket="platformsh-vendor-prefect"),
# executor=LocalExecutor(),
executor=LocalDaskExecutor(scheduler="threads", num_workers=5),
state_handlers=[flow_failure],
Florent VanDeMoortele
08/30/2022, 4:46 PMprefect.environments.storage.Docker
to create an image with my flow, context, scheduler and all the required virtual environnement. Then I register flow to Prefect with prefect.environments.DaskKubernetesEnvironment
as environment. I'm using prefect.executors.DaskExecutor
to run it.
To deploy on 2.x, I simply try to use DockerContainer
but it doesn't work without storage. So I try to install main branch of Prefect because of a merged PR ( https://discourse.prefect.io/t/how-to-build-deployments-with-flow-code-and-dependencies-being-baked-into-a-docker-image/1341 ) to use DockerPackager
but it's not compatible with Deployment.build_from_flow
. I also try to push directly my Docker image with push_image
but push doesn't already work. So, I'm a bit confused because I can't find explicit documentation on Discourse and I read different responses because of the different releases on 2.x.
Is DockerPackager
the best practice to deploy a completely self contained flow? In this case, do you have any idea of the release roadmap to fix this (and to update documentation) ? If not, what can I should use?
Thank you !Dylan McReynolds
08/30/2022, 5:25 PMflow
, is there a way to schedule a subflow to start at a particular time in the future? Or some other way to accomplish a long-delayed subflow/task?Shaoyi Zhang
08/30/2022, 5:51 PMEXTRA_PIP_PACKAGES
to Cloud UI? When using Kubernetes agent, those logs only show up in job pods logs and are not available in Cloud UI.Renan Matias
08/30/2022, 5:52 PM<http://127.0.0.1:4200/api/deployments/{id}/create_flow_run>
and it worked normally (I used Insomnia).
Now, I need to make this same request through Prefect Cloud. I was already able to create the deployment and I was able to run the flow normally through the Prefect UI with the agent active.
Can you help me?Ashley Felber
08/30/2022, 6:23 PMMarcos
08/30/2022, 6:27 PM@flow
async def test():
connected = await connect_db.submit()
task1 = await db_stuff.submit(wait_for=[connected])
await disconnect_db.submit(wait_for=[task1])
If db_stuff
fails, disconnect_db
never is executed but I’d like it to do itAmol Shirke
08/30/2022, 7:01 PMJosh
08/30/2022, 7:28 PMJohn
08/30/2022, 9:11 PMSophia Alice
08/30/2022, 9:16 PMFlow Run Succeeded
but the process doesn’t exit after success and instead hangs. Any idea what’s happening?Matt Melgard
08/30/2022, 9:18 PMJeffrey Lai
08/30/2022, 11:07 PMAdam Brusselback
08/31/2022, 12:41 AMChris L.
08/31/2022, 4:56 AMLow Kim Hoe
08/31/2022, 5:17 AM$ prefect cloud login --key xxx_XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
But i get the following error Unable to authenticate with Prefect Cloud. Please ensure your credentials are correct.
My env is pipenv. And I am using prefect 2.2.0
$ prefect --version
2.2.0
And I have created the API Key hereLow Kim Hoe
08/31/2022, 5:20 AMyuvipanda
08/31/2022, 6:29 AMyuvipanda
08/31/2022, 6:29 AMyuvipanda
08/31/2022, 6:31 AMAbimbola Adebayo
08/31/2022, 6:46 AMiñigo
08/31/2022, 7:40 AMOlivér Atanaszov
08/31/2022, 8:29 AMSatsuki Nagae
08/31/2022, 8:56 AMRikimaru Yamaguchi
08/31/2022, 9:43 AMChris L.
08/31/2022, 9:59 AMChris Keeley
08/31/2022, 10:28 AMChris Keeley
08/31/2022, 10:28 AMChristopher Boyd
08/31/2022, 2:14 PMChris Keeley
08/31/2022, 2:20 PMChristopher Boyd
08/31/2022, 2:23 PM