Great news: you just no longer need the resource manager! š Instead, you can use any Python context manager to facilitate a cleanup process, such as restoring various kinds of a global state, locking and unlocking resources, closing opened files, etc. This page dives into details
Anna Geller
04/07/2022, 12:17 PM
in general, for migration-specific questions, check out this Discourse tag that has resources that may help you with migration
r
Ricardo Gaspar
04/07/2022, 12:20 PM
oh nice. thank you so much anna!
š 1
Ricardo Gaspar
04/07/2022, 12:26 PM
Thanks for the example. The example there, is still valid for creating an EMR/Spark cluster ?
just a function with a try/finally block instead of a dedicated class?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.