Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Title
n
Naga Sravika Bodapati
05/13/2022, 2:00 PMSeeing this error: can't pickle CompiledFFI objects , can someone help what might be the issue?
✅ 1
a
Anna Geller
05/13/2022, 2:03 PMyou would need to provide a bit more information 🙂
is it for Prefect 1.0 or 2.0?
usually, pickle errors occur due to flow serialization issues, often happens when you serialized your flow with one Python and Prefect version during registration, but then ran it in an environment that had different versions
n
Naga Sravika Bodapati
05/13/2022, 2:06 PMprefect 1.0
I am trying to register the flow
and seeing this error
in prefect 1.0, is there a way to call one task from another task function?
k
Kevin Kho
05/13/2022, 2:09 PMYou need to call
mytask.run()a
Anna Geller
05/13/2022, 2:09 PMtheoretically yes, you can invoke the .run() method but it's not recommended
n
Naga Sravika Bodapati
05/13/2022, 2:10 PMok
found the issue - i am using storage client for bigquery in one of the tasks and that is throwing this error. Why is it happening?
can we remove this pickling?
k
Kevin Kho
05/13/2022, 2:40 PMWhat storage are you using? You can store it as a script, but a client instantiated inside a task should be fine for registration because that code is not actually run yet
n
Naga Sravika Bodapati
05/13/2022, 2:41 PMyes, i am not sure why i am seeing this because i have used similar logic elsewhere and it worked
GCS bucket
k
Kevin Kho
05/13/2022, 2:44 PMYou can use the
stored_as_scriptTrueYou can find more info the in docstrings here
n
Naga Sravika Bodapati
05/13/2022, 2:46 PMi tried to run the script on a different prefect vm
and registration went through!
what must have changed?
this first vm is on GCP and the second is on premise - will it make a difference?
k
Kevin Kho
05/13/2022, 2:56 PMNo that shouldn’t 😅.
n
Naga Sravika Bodapati
05/13/2022, 2:57 PMyes! I am not understanding this! Prefect version on both is the same.