Hi everyone,
I have an existing streaming lambda function that I deployed using prefect and git actions [ serverless pipeline] my lambda function is triggering prefect flow as it receives event.
Now I am adding enhancement to this code where I need to do a data quality check by running queries against data in redshift.
So in order for my lambda function to connect to redshift over private VPC I added VPC and subnet to my function , after this I am facing an error where my lambda is no more able to connect to prefect API over internet. Its giving me timeout error.
How can I make my lambda function connect to Prefect API and trigger flow and also connect to my redshift cluster over VPC?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.