Hello everybody! When i use prefect to ETL data. I cant track mapping from fields data source to fields destination
k
Kevin Kho
09/08/2021, 2:01 PM
Hey @Anh Nguyen, could you give me more details on what you’re trying to do? Are you using the Prefect tasks?
a
Anh Nguyen
09/13/2021, 7:47 AM
yes, i am using Prefect. the first time, I select data from source table. After that, the result for selected is loaded to destination table.
In the processing i cant tracking:
• How many fields of source table I selected ?
Example i use Talend tool ETL data. I can tracking that
k
Kevin Kho
09/13/2021, 4:47 PM
Ah I know what you are saying. We don’t do this my default. I think you need to get the task output and use Python to check the number of fields.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.