HI. I have a flow in Prefect 1 that has tasks that maps to send COPY INTO statements to snowflake using the SnowflakeQuery task. It only runs 2 sql statements at a time, I’d expect this to scale as our snowflake warehouse can scale up to 5 clusters. We don’t have any concurrency limits set in the UI. Does anyone know what would limit this?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.