on your local machine is intended to test the flow locally and will not submit your Flow Run to Fargate. For that you’ll need a Fargate Agent. Once you register the Flow with Prefect Cloud your scheduled runs will be submitted to Fargate by the agent 👍
j
jamodes
11/12/2020, 3:30 PM
thank you @Dylan,
do we have to register to Perfect cloud? Can't we do this in local machine?
d
Dylan
11/12/2020, 3:33 PM
Since Prefect Flows can run in many environments and most users wish to run their workflow on a schedule or in response to an event (which can make an API call to Prefect Cloud), we’ve designed the Agents as our mechanism to submit work to cloud environments
Dylan
11/12/2020, 3:35 PM
You can write a Flow that runs locally and submits tasks to Fargate using the AWS python clients
Thanks a lot.
I just want to understand whether we are able to deploy our flows to our proprietary server or not.
d
Dylan
11/12/2020, 4:04 PM
What do you mean by proprietary here? In a private cloud?
m
Michael Ludwig
11/13/2020, 6:11 AM
@jamodes it should be no problem starting Fargate runs from on premise. Just use flow.register and a fargate agent. The fargate agent will pick up the flow and run it. Without Prefect cloud
Michael Ludwig
11/13/2020, 6:13 AM
I had issues in the past with FargateTaskEnvironment and used a normal RemoteEnvironment. The FargateAgent was used and got all the Fargate related configs
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.