Santiago Gonzalez
09/13/2021, 6:52 PMKevin Kho
09/13/2021, 6:59 PMSantiago Gonzalez
09/13/2021, 7:13 PMNone
. So I assume that the output is being lost.Kevin Kho
09/13/2021, 7:14 PMSantiago Gonzalez
09/13/2021, 7:43 PM@task
def create_ec2_instance():
instances = boto3,create_ec2_instance('..........')
instance = instances[0]
waiter = ec2_client.get_waiter('instance_status_ok')
waiter.wait(InstanceIds=[instance.instance_id])
return instance,instance_id
@task
def create_commands(warmup: Boolean):
return ['something to execute', "something else", "something more"]
@task
def execute_job_in_ec2_instance(instance_id, commands: List):
ssm = get_boto_client('ssm', region_name='us-west-2', use_session=True)
command_invocation = ssm.send_command(InstanceIds=[instance_id],....., commands=commands)
@task(name="Manual check", trigger=manual_only)
def manual_check():
return
Flow('flow') as flow:
.....
warmup_commands = create_commands(True)
full_commands = create_commands(False)
instance_id = create_ec2_instance()
warm_up_execution = execute_job_in_ec2_instance(instance_id=instance_id,
commands=warmup_commands)
manual_check = manual_check()
manual_check.set_upstream(warm_up_execution)
full_execution = execute_job_in_ec2_instance(instance_id=instance_id,
commands=full_commands)
full_execution.set_upstream(warm_up_execution)
full_execution.set_upstream(manual_check)
Kevin Kho
09/13/2021, 7:54 PMSantiago Gonzalez
09/13/2021, 8:01 PM