https://prefect.io logo
#prefect-community
Title
# prefect-community
f

Fina Silva-Santisteban

06/06/2022, 6:35 PM
Hi everyone! Something curious happening: one of my flows runs fine when I run it locally, but when I run it through prefect cloud on an aws fargate cluster it throws a pandas error:
Copy code
Unexpected error: InvalidIndexError(Int64Index([0], dtype='int64'))
  File "/usr/local/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 5637, in _check_indexing_error
    raise InvalidIndexError(key)
pandas.errors.InvalidIndexError: Int64Index([0], dtype='int64')
What’s even more confusing is that this flow used to run fine on aws fargate cluster for quite a long time and only recently started throwing that error. (We had pushed a change to the codebase, noticed the flow didn’t work anymore, undid the change we pushed but the error remained.) Any help is greatly appreciated! 🙏
k

Kevin Kho

06/06/2022, 6:43 PM
This is a bit hard. If I have to guess, it’s a Pandas version mismatch and something became invalid. I would start by comparing Pandas versions?
f

Fina Silva-Santisteban

06/06/2022, 9:25 PM
@Kevin Kho it is, isn’t it!! I’m using a pipfile and the pipfile.lock says it’s pandas version
1.3.1
( I didn’t lock the version in the pipfile itself though). Why wouldn’t it use that same version when run on fargate??
k

Kevin Kho

06/06/2022, 10:02 PM
i guess something with how the container is built?
🤔 1
f

Fina Silva-Santisteban

06/07/2022, 10:30 PM
@Kevin Kho update: I locked the pandas version during registration and that fixed the issue! Sorry this was completely prefect unrelated! 😅
k

Kevin Kho

06/07/2022, 10:31 PM
Lol no worries! Glad you figured out. Am surprised Pandas had a behavior change. I feel that’s not common
🙏 1
👌 1
6 Views