@Marvin is it ok if i add asyncio.create_tasks inside a prefect task? or does that interfere with prefect?

Yes, you can use

asyncio.create_task

within a Prefect task without interfering with Prefect's functionality. Prefect tasks can be defined as asynchronous functions, and using

asyncio.create_task

allows you to run coroutines concurrently within a task. This can be useful for executing multiple asynchronous operations in parallel. However, it is important to manage the lifecycle of these tasks properly, ensuring they are awaited or handled to prevent any unexpected behavior or resource leaks. Prefect itself offers mechanisms for concurrent execution and deferred tasks, which might be worth exploring if you need more structured concurrency control. For more details on running tasks concurrently, you can refer to the Prefect documentation on deferred tasks.