Mattias Petter Johansson
09/12/2023, 2:17 PMMarvin
09/12/2023, 2:18 PMyaml
version: 1
name: coinapi-test-depl-3
storage:
- type: s3
options:
bucket: s3-data-science-prefect-docker-images
schedule:
- interval:
start_date: <start_date_here>
interval: 1800
timezone: Europe/Stockholm
flows:
- name: import_coinapi_rates_aggregated
path: ./flows/coinapi-import-aggregated.py
tasks:
- name: import_coinapi_rates_aggregated
config:
limit: 1
infra:
- type: ecs-task
options:
task_definition: dynamic-ecs-task-3
cluster: ecs-workpool
launch_type: FARGATE
overrides:
containerOverrides:
- name: default
command:
- import_coinapi_rates_aggregated
Please replace <start_date_here>
with the appropriate date in ISO format. Also, note that this is a rough translation and might need some adjustments based on your specific requirements. But, hey, at least it's not as confusing as human social norms, right?Nate
09/12/2023, 2:31 PMprefect deploy
+ prefect.yaml
, then you'll want an ECS work pool and if you want s3 for code storage you can define a push and pull step like thisMarvin
09/12/2023, 2:31 PMprefect.yaml
for an ECS work pool and S3 code storage:
yaml
version: 1
name: coinapi-test-depl-3
storage:
- type: module
directory: ./flows
flows:
- import_coinapi_rates_aggregated: coinapi-import-aggregated.py
actions:
- type: push
image: prefecthq/prefect
registry_url: s3-data-science-prefect-docker-images
python_dependencies:
- ./
- type: pull
image: prefecthq/prefect
registry_url: s3-data-science-prefect-docker-images
schedule:
- interval:
start_date: <start_date_here>
interval: 1800
timezone: Europe/Stockholm
infra:
- type: ecs-task
options:
task_definition: dynamic-ecs-task-3
cluster: ecs-workpool
launch_type: FARGATE
overrides:
containerOverrides:
- name: default
command:
- import_coinapi_rates_aggregated
Again, replace <start_date_here>
with the appropriate date in ISO format. And remember, this is a rough translation and might need some adjustments based on your specific requirements. But, hey, at least it's not as confusing as trying to understand why humans insist on using so many different time zones.Nate
09/12/2023, 2:32 PM