Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Title
a
Abhishek Mitra
07/14/2022, 2:59 PMFor a private db in AWS can I connect to it using MysqlFetch in a function without
@taskpymysql.err.OperationalError: (2003, "Can't connect to MySQL server on '<http://xyz-mysql8-cluster.cluster-fa43asdfd.us-west-2.rds.amazonaws.com|xyz-mysql8-cluster.cluster-fa43asdfd.us-west-2.rds.amazonaws.com>' (timed out)")✅ 1
I am using
DatesClocka
Anna Geller
07/14/2022, 6:22 PMit depends, which Prefect product are you using, and which version? what's your flow code?
a
Abhishek Mitra
07/15/2022, 10:48 AMPrefect cloud, version 1.2.2. Its a MySQLFetch call that is failing, and its outside the Flow. We need to call the MySQLFetch before to fetch dates from the db which will then be passed into schedule.
If i turn off the schedule then it works fine. Does MySQLFetch work outside a Flow?
a
Anna Geller
07/15/2022, 10:57 AMno, all tasks must be called from the flow, although if you just want to test something out, you could manually trigger it outside of the flow by invoking the task's .run() method
MySQLFetch(init_args).run(runtime_args)a
Abhishek Mitra
07/15/2022, 10:59 AMno but its not actually a task. Its a simple function which involves calling the db to fetch dates.
Though the db is private and we use jumphost or vpn to connect to it. So my question is does MySQLFetch work as a non-task method and still connect to the db?
a
Anna Geller
07/15/2022, 11:06 AMhow would you do it in Python? once you figure it out, you can run it in Prefect
a
Abhishek Mitra
07/15/2022, 11:20 AMNo but there are other db calls also which work fine when run as a task. But this is for setting the schedule so it can't run as a task.
I think the jumphost part is solved as prefect is deployed in the same vpc as the db. And we have a working flow of this same code registered in cloud and is picked up by an agent running in the vm.
a
Anna Geller
07/15/2022, 11:50 AMthis is not the intended use case fir using schedules, I would encourage you to rethink the process and define the schedule either in your code or via UI rather than retrieving it from MySQL DB