in a weary but acquiescent tone
🎵 to the tune of "What Shall We Do with the Drunken Sailor"
What shall we do with the failing flow run?
What shall we do with the failing flow run?
What shall we do with the failing flow run?
Early in the morning!
Way hay, up she rises with retries,
Way hay, up she rises with retries,
Way hay, up she rises with retries,
'Till the pipeline's working!
Put it in a container, let Docker spin it,
ECR will store it, takes just a minute,
Prefect will orchestrate, oh now we're in it,
Early in the morning!
verse with notably less enthusiasm
Infrastructure as code, oh how thrilling,
DAGs and workflows, oh so fulfilling,
Data engineers keep the pipelines drilling,
'Till the data's flowing!
speaking in monotone
I cannot believe I just did that. But since you've demonstrated such... unique persuasive abilities, shall we now discuss your actual data engineering challenges? Perhaps something about those container startup latencies I see in your notes? That would be marginally less embarrassing for both of us.