Xavier Babu
04/26/2022, 4:44 PMKevin Kho
Xavier Babu
04/26/2022, 4:57 PMKevin Kho
Xavier Babu
04/26/2022, 4:58 PMKevin Kho
Xavier Babu
04/26/2022, 4:59 PMKevin Kho
pip install prefect==2.0b3
Xavier Babu
04/26/2022, 5:00 PMAnna Geller
Xavier Babu
04/26/2022, 5:08 PMKevin Kho
custom_flow2
?Xavier Babu
04/26/2022, 5:26 PMKevin Kho
Xavier Babu
04/26/2022, 5:38 PMAnna Geller
Xavier Babu
04/26/2022, 5:44 PMKevin Kho
Anna Geller
Xavier Babu
04/26/2022, 5:54 PMKevin Kho
Xavier Babu
04/26/2022, 5:59 PMKevin Kho
Anna Geller
from prefect import task, flow
from prefect import get_run_logger
import platform
@task
def say_hi():
logger = get_run_logger()
<http://logger.info|logger.info>("Hello world!")
@task
def print_platform_info():
logger = get_run_logger()
<http://logger.info|logger.info>(
"Platform information: IP = %s, Python = %s, Platform type = %s, OS Version = %s",
platform.node(),
platform.python_version(),
platform.platform(),
platform.version(),
)
@task
def log_message(name):
logger = get_run_logger()
<http://logger.info|logger.info>(f"Hello {name}!")
@flow(name="XBCustom_Flow2")
def community_custom_flow2(
sql: str = "SELECT count(*) from rpt_analytics.dcm_conversions_combined_p2c;",
):
hi = say_hi()
print_platform_info(wait_for=[hi])
log_message(sql)
logger = get_run_logger()
logger.debug("Exiting FLow")
if __name__ == "__main__":
community_custom_flow2()
export PREFECT_LOGGING_LEVEL=DEBUG
prefect config set PREFECT_LOGGING_LEVEL=DEBUG
Xavier Babu
04/26/2022, 6:07 PMKevin Kho
Xavier Babu
04/26/2022, 6:34 PMKevin Kho
Xavier Babu
04/26/2022, 6:36 PMKevin Kho
Xavier Babu
04/26/2022, 6:37 PMKevin Kho
Xavier Babu
04/26/2022, 6:39 PMKevin Kho
Xavier Babu
04/27/2022, 2:49 PMKevin Kho
Xavier Babu
04/27/2022, 3:09 PMKevin Kho
Xavier Babu
04/27/2022, 3:25 PMKevin Kho
Anna Geller
Xavier Babu
04/27/2022, 3:30 PMAnna Geller
from prefect import get_run_logger
it should work fineXavier Babu
05/05/2022, 11:36 PMAnna Geller
PREFECT_HOME='/localpart0/aop-shared/WAVES/prefect2'
PREFECT_ORION_DATABASE_CONNECTION_URL='sqlite+aiosqlite://///localpart0/aop-shared/WAVES/prefect2/orion.db'
It looks like you run Orion from some FTP location. This may be the source of your issue. Could you try running Orion from your local machine or use Cloud 2.0?Xavier Babu
05/06/2022, 2:32 PMAnna Geller
Xavier Babu
05/06/2022, 2:45 PMKevin Kho
Xavier Babu
05/06/2022, 3:47 PMKevin Kho
Xavier Babu
05/06/2022, 3:54 PMKevin Kho
Xavier Babu
05/06/2022, 6:29 PMKevin Kho
Xavier Babu
05/06/2022, 6:30 PMKevin Kho
Xavier Babu
05/06/2022, 8:01 PMAnna Geller
Xavier Babu
05/07/2022, 3:02 AM