What's the best way to see the first 10 rows of data I've transformed in prefect without running in the cloud? I can manually embed my credentials temporarily and want to do something like this and see the result in the terminal:

flow = Flow("myflow")
with flow:
    df = extract(stuff)
print(df.head(10)) # This does not work

That won’t work because

df

is not a

DataFrame

. It is a

Task

that eventually resolves to a DataFrame so you need to do the

df.head()

inside a task so that it is deferred also. Otherwise, this will try to execute immediately when

df

doesn’t exist

what's the best option to do this fast? Just for local testing

Making a task to do it.

@task
def the_head(df):
    <http://prefect.context.logger.info|prefect.context.logger.info>(df.head(10)
    return

or you can add the logging statement inside your extract task

Add

import prefect

to your script

done. how do I set up the flow now? It ran but doesn't print anything

Did you use the task in your flow?

yes

One sec let me try

Thanks!!

It seems to work for me, can you try this snippet:

import pandas as pd
from prefect import Flow, task
import prefect

@task
def extract():
    return pd.DataFrame({"a": [1,2,3,4], "b":[1,2,3,4]})

@task
def the_head(df):
    <http://prefect.context.logger.info|prefect.context.logger.info>(df.head(10))
    return

with Flow("df_test") as flow:
    df = extract()
    the_head(df)

flow.run()

That worked, thank you!

Of course!

@Kevin Kho one other quick

It would be

base_df

Thank you!