Hey folks, just trying out prefect for the first time after using some other workflow systems before, loving the UX! Quick question, I’m using the

ExecuteNotebook

task and it’s spilling the cell content to stdout during normal execution, is there an option to supress? I’m using a target file to cache the output and that’s working fine

Hey @Evan Curtin, glad you are enjoying Prefect. Do you hvae

log_output=True

by chance?

notebook_task = ExecuteNotebook(
            str(nb_path),
            kernel_name="dev",
            parameters={**opts},
            result=LocalResult(dir=cachedir, serializer=PlainTextSerializer()),
            target="output.ipynb",
        )

this is how I’m calling it, PlainTextSerializer is just a simple serializer i wrote to dump strings as-is

Canb you try adding

log_output=False

to

ExecuteNotebook

and see what happens?

sure

Maybe you can try the different output_formats?

- output_format (str, optional): Notebook output format, should be a valid
            nbconvert Exporter name. 'json' is treated as 'notebook'.
            Valid exporter names: asciidoc, custom, html, latex, markdown,
            notebook, pdf, python, rst, script, slides, webpdf. (default: notebook)

ok let me see

Just curious, do you have experience with papermill before this? Wondering if the task can be improved.

only a little, this doesn’t happen when i run papermill manually

Gotcha, PR’s are definitely welcome if you’re interested 🙂

nb: nbformat.NotebookNode = pm.execute_notebook(
            path,
            "-",
            parameters=parameters,
            kernel_name=self.kernel_name,
            log_output=self.log_output,
        )

I think this is the cause here, in

prefect.tasks.jupyter.jupyter.ExecuteNotebook.run

the

"-"

argument is being used as the output path which when i run on the CLI pipes to stdout it seems

That would be appreciated!