@Anna Geller I very much like your article on handling streaming data with prefect. However should I wish to implement same for exchange data that doesn’t run 24/7 but within specific times on week days. Can I use the UI to schedule it in such a manner that the streaming starts and stops within the opening and closing time of the exchange?

Hi Hedgar! you would need to stop the service when you no longer want it to be running and start it again when you do. The easiest might be to do that from the ECS Fargate service console

Wow, need to study ECS Fargate service closely. Thanks 🙏

with Fargate you pay only for a single container that you use which is great because you don't need to have an entire VM or cluster

Cool. From my research, to achieve the above objective that is run during office work hour and stop outside office hours; I may have to schedule task definition. I have checked through the task definition and I can’t find where it can be stopped or start? Any thoughts? @Anna Geller

that's why you need a service - ECS service allows you to run a certain ECS task reliably you could also just run a container from task definition but this is more for ad-hoc things, not for a service that must run reliably 24/7

@Anna Geller I have been able to get around stoping and starting the stream through manipulating tz and time, I however observed that under infrastructure folder in the ecs_service.yml file, am I suppose to indicate my AWS_ACCOUNT_ID? I already indicated it under actions secrets