Hey everyone! I'm trying to log some parameter in ...
# ask-communityj
Jérémy Trudel
04/15/2021, 2:05 PMHey everyone! I'm trying to log some parameter in a prefect flow. After launching a quick run, I can't find any mention of my log on cloud. It looks a bit like this:
Copy code
@task
def extract_copy_history(cursor, schema_table):
logger = prefect.context.get("logger")
<http://logger.info|logger.info>(f"Schema table name is {schema_table}.")k
Kevin Kho
04/15/2021, 2:07 PM
Hi @Jérémy Trudel! Is this a normal Python function or did you decorate it with
@taskj
Jérémy Trudel
04/15/2021, 2:08 PMI decorated it with a task! Yeah I'll edit it with it
k
Kevin Kho
04/15/2021, 2:09 PM
This seems good do me. Do you have a minimum working example?
j
Jérémy Trudel
04/15/2021, 2:10 PMYes I can send you what the logs look like privately
k
Kevin Kho
04/15/2021, 2:14 PM
If the flow is quick to run, can you try changing
<http://logger.info|logger.info>logger.warningj
Jérémy Trudel
04/15/2021, 2:18 PMYes I'll try that
k
Kevin Kho
04/15/2021, 2:19 PM
“Showing all log levels” in the UI is because you can filter the ones you want to look at there. It doesn’t mean that all levels of logs were outputted
j
Jérémy Trudel
04/15/2021, 2:25 PMTried warning and same story
Jérémy Trudel
04/15/2021, 2:26 PMOh I forgot an important part: the task is a mapped task
k
Kevin Kho
04/15/2021, 2:26 PM
I see. Does logging work for your non mapped tasks?
j
Jérémy Trudel
04/15/2021, 2:27 PMLooks like this:
Copy code
errors = extract_copy_history.map(cursor=unmapped(cursor), schema_table=tables)Jérémy Trudel
04/15/2021, 2:27 PMI'll try it right now
Jérémy Trudel
04/15/2021, 2:35 PMLogging does work for my non-mapped tasks
k
Kevin Kho
04/15/2021, 2:37 PM
Logging for your non-mapped tasks was set as INFO? I tried logging on mapped tasks and it worked. Let me try doing it with an
unmappedKevin Kho
04/15/2021, 2:41 PM
Could you try a simple flow:
Copy code
import prefect
from prefect import Flow, task, unmapped
@task
def get_numbers():
logger = prefect.context.get("logger")
<http://logger.info|logger.info>(f"Testing the log.")
return [1,2,3]
@task
def plus_one(constant,x):
logger = prefect.context.get("logger")
<http://logger.info|logger.info>(f"Mapped logger value {x}")
return x+constant
with Flow('logging-flow') as flow:
n = get_numbers()
plus_one.map(constant = unmapped(1), x = n)
flow.run()j
Jérémy Trudel
04/15/2021, 5:18 PMI just realized the problem was that I was mapping on an empty parameter 😰 that's why I had no logs. Sorry abotu that and thank you for your help!
k
Kevin Kho
04/15/2021, 5:23 PM
Wow I hope that wasn’t too painful to find! All good. Happy to help 🙂