@Marvin is it possible to pipe a

DbtCoreOperation

into a regular

ShellOperation

using the

prefect-dbt

library?

Yes, it is possible to pipe a

DbtCoreOperation

into a

ShellOperation

using the

prefect-dbt

library. The

DbtCoreOperation

block in

prefect-dbt

runs dbt Core commands as shell commands, which means you can chain it with a

ShellOperation

. Here's a basic example of how you might set this up:

python
from prefect import flow
from prefect_dbt import DbtCoreOperation
from prefect_shell import ShellOperation

@flow
def dbt_to_shell_flow():
    # Run a dbt Core command
    dbt_op = DbtCoreOperation(
        commands=["dbt run"],
        project_dir="/path/to/your/dbt/project"
    )
    dbt_result = dbt_op.run()

    # Use the result in a shell operation
    shell_op = ShellOperation(
        command=f"echo 'DBT run completed with status: {dbt_result.status}'"
    )
    shell_op.run()

dbt_to_shell_flow()

This flow will execute a dbt command and then pass the result to a shell command. For more details, you can refer to the Prefect Dbt documentation.