Hi I m trying to use the Snowflake Task to execute a COPY IN

Question

Hi I m trying to use the Snowflake Task to execute a COPY INTO query It works fine with SELECT queries but it just isn t running the query when I switch it to a copy into and the task is coming back with TriggerFailed

Jonathan Mathews · Answer

This is the task I m using <https docs prefect io api latest tasks snowflake html snowflakequery>

Jonathan Mathews · Answer

I m not 100 sure how to get any logs out on the prefect local end but I can see from the snowflake logs that the query isn t executing

Jonathan Mathews · Answer

I ve tried setting `autocommit` to true

Kevin Kho · Answer

I am looking at <https stackoverflow com questions 70865412 snowflake copy into rejecting file without error in python snowflake connector|this>

Kevin Kho · Answer

Could you try without Prefect using `snowflake connector` and seeing if there is no error too

Jonathan Mathews · Answer

thanks you mean using the native Snowflake Python connector within a prefect task

Jonathan Mathews · Answer

I ve tried the same command in the snowflake console and it works

Kevin Kho · Answer

No I mean Snowflake Python connector but no task first just to see it works

Jonathan Mathews · Answer

ok just tried that works fine

Andrew Huang · Answer

Can you share your query

Jonathan Mathews · Answer

``` copy into raw azure all tables all clients from select $1 variant as value cast split part split part metadata$filename 1 1 as varchar 100 as client name cast split part split part metadata$filename 1 2 as varchar 100 as table name cast ltrim split part split part metadata$filename 1 1 parquet as datetime as export time cast split part metadata$filename 1 as varchar 200 as filename cast metadata$filename as varchar 500 as filepath from reporting raw test test parquet ```

Andrew Huang · Answer

I wonder if it s because the Prefect task tries to fetchall after

Andrew Huang · Answer

```executed = cursor execute query params=data fetchall ```

Andrew Huang · Answer

may need to create a separate task for just execution <https github com PrefectHQ prefect blob 40e2e2bd1c1de5651bc7fb484c823e43cfc69877 src prefect tasks snowflake snowflake py L186>

Jonathan Mathews · Answer

Ok I think the issue was actually nothing to do with this task I had another problem with my code that I ve now resolved I m now using the python connector so haven t verified but will do later Thanks for your help

Jonathan Mathews · Answer

Confirmed it works

Jonathan Mathews · Answer

Sorry about that

Kevin Kho · Answer

No worries