@Anna Geller I have a flow with three tasks the first two ran successfully-looking at it from the UI, however the third and last task which essentially writes all the data to a parquet file in s3 is still in running state. However 23 out of 104 delivered to s3. what could be wrong expecially as cloudwatch log “delivering data to s3”
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.