I have a flow that executes sql query on redshift using pref

Question

I have a flow that executes sql query on redshift using prefect sqlalchemy and my queries are always aborted

Jeff Hale · Answer

It might be helpful to set the default logging level to debug instead of info to change the default logging levels for Prefect to `DEBUG` you can set the environment variable `PREFECT LOGGING LEVEL= DEBUG ` <https docs prefect io concepts logs >

Rohith · Answer

HI Jeff even with the DEBUG logging level I see no error

Rohith · Answer

when I run python flow script

Kalise Richmond · Answer

moving to thread Rohith 3 09 AM how can I find the causes of the abort

Kalise Richmond · Answer

< Rohith> just to clarify are you able to run your query directly against the database you re querying Does that fail as well or is that successful

Rohith · Answer

the query has been successful

Rohith · Answer

I have used redshift+redshift connector by setting this value in sqlalchemy block to connect to redshift and execute the queries

Rohith · Answer

commit was not being called after sqlalchemy execute

Rohith · Answer

I had to use a connection like sqlaldb block get engine

Rohith · Answer

`dbengine = database block get engine ` `with dbengine begin as conn ` `r = conn execute f select count from kochava kochava cprefix first 0 ` `print f Record count for kochava cprefix before insert r ` `conn execute ` `f CREATE TABLE IF NOT EXISTS kochava temp cprefix LIKE kochava kochava cprefix `