Hi everyone! Something curious happening: one of my flows runs fine when I run it locally, but when I run it through prefect cloud on an aws fargate cluster it throws a pandas error:

Unexpected error: InvalidIndexError(Int64Index([0], dtype='int64'))
  File "/usr/local/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 5637, in _check_indexing_error
    raise InvalidIndexError(key)
pandas.errors.InvalidIndexError: Int64Index([0], dtype='int64')

What’s even more confusing is that this flow used to run fine on aws fargate cluster for quite a long time and only recently started throwing that error. (We had pushed a change to the codebase, noticed the flow didn’t work anymore, undid the change we pushed but the error remained.) Any help is greatly appreciated! 🙏

This is a bit hard. If I have to guess, it’s a Pandas version mismatch and something became invalid. I would start by comparing Pandas versions?

@Kevin Kho it is, isn’t it!! I’m using a pipfile and the pipfile.lock says it’s pandas version

1.3.1

( I didn’t lock the version in the pipfile itself though). Why wouldn’t it use that same version when run on fargate??

i guess something with how the container is built?

@Kevin Kho update: I locked the pandas version during registration and that fixed the issue! Sorry this was completely prefect unrelated! 😅

Lol no worries! Glad you figured out. Am surprised Pandas had a behavior change. I feel that’s not common