My project architecture looks pretty much like this :

/src
  /projects
     /project_1
        /flows
          /some_flow
            /data
              script1.sql
            /tasks
              sometask.py
            flow.py

I am using recursive glob to register all of my flows with the following bash :

#!/bin/bash

export PYTHONPATH=$(pwd):$PYTHONPATH

for folder in $(ls -d ./src/projects/*/ | grep -v '__'); do
    project_name=$(basename $folder)
    prefect create project $project_name
    prefect register --project $project_name --path "${folder}**/*"
done

It worked great with other flows, even some that had

.txt

files as data. However, it looks like Prefect tries to parse the SQL scripts as if they were python :

Collecting flows...
Error loading './src/projects/source_updater/flows/theriaque/data/excipients.sql':
  Traceback (most recent call last):
    File "/home/sylvain/.pyenv/versions/3.8.12/envs/prefect/lib/python3.8/site-packages/prefect/cli/build_register.py", line 134, in load_flows_from_script
    namespace = runpy.run_path(abs_path, run_name="<flow>")
    File "/home/sylvain/.pyenv/versions/3.8.12/lib/python3.8/runpy.py", line 264, in run_path
    code, fname = _get_code_from_file(run_name, path_name)
    File "/home/sylvain/.pyenv/versions/3.8.12/lib/python3.8/runpy.py", line 239, in _get_code_from_file
    code = compile(f.read(), fname, 'exec')
    File "/home/sylvain/workspace/prefect-source-updater/src/projects/source_updater/flows/theriaque/data/excipients.sql", line 2
      USE theriaque;
          ^
  SyntaxError: invalid syntax

Is there something specific in the registration method that has any effect on SQL scripts ?

Using

${folder]***/**.py

in the registration script seems to have fixed the issue. I still don't understand why there was no problem with

.txt

files but

.sql

caused some though 😅

Thanks for the help anyway 🙂