I have a few Airtable tasks I’ve written and reused a few times. They snarf a whole Airtable table into a DataFrame, apply updates, and insert new records. The existing Airtable tasks in prefect only insert/read records a row at a time. I’d be interested in contributing them. Here’s the source:
https://gist.github.com/jasonprado/0c71196bf21398d3b79123b9172987dd
I would guess that most people want to read records from Airtable into python dicts/lists rather than DataFrames, right? If I wrote these classes that way but still wanted to use DFs in my project, would I then write my own tasks that turn the dicts/lists into DataFrames? Or should the tasks take a parameter to specify what kind of output they want (dicts vs DFs)? Just curious what the most idiomatic way to publish these tasks would be.