Sander12/02/2022, 7:03 PM
Malek Naski12/02/2022, 7:38 PM
. However, this makes it not possible to manually retry a failed subflow, is there a better way to do this? My use case is mostly the parent flow fetching inputs and then each subflow run would handle one of the inputs (I'm looping over the task that triggers the subflow deployment runs) Thanks!
Chris McClellan12/03/2022, 2:17 AM
merlin12/03/2022, 6:51 AM
Tim Galvin12/03/2022, 8:18 AM
at all? I was previously using it successfully in combination with
to capture logs from another package. It seems though with an updated to
I have lost this ability. I do see the logs being printed to my slurm output files, and I do see it is formatted in the
style, but I am not seeing these logs being submitted through to my self-hosted Orion server (as presented by the web UI). Any ideas?
Andreas Nigg12/03/2022, 1:33 PM
Tim Galvin12/04/2022, 8:46 AM
no longer reporting logs through to orion. I went reading through
and see in #7569 that there was some change to the logic. Now there is a test made against
before the orion log handler is attached to the logger of the extra module. I am not sure exactly what
is in this sense, but when I disable this check to force the orion handler to attach itself to my extra module, things work as expected and logs are streamed to orion. It seems that by default that this
is set to
(at least I have not knowingly set it), and the test made against its value is negative when evaluating whether to attach the orion logger. So my question is what is this
configurable, and how does one set it? Is the check made against it actually intended to be negated? Once I remove the check my logs for extra modules outlined in
behave the same as pre v2.6.9 / #7569 @Anna Geller @Michael Adkins - I see both your names on the change -- please don't hate me for tagging you directly 🙂
Marwan Sarieddine12/04/2022, 2:26 PM
HAITAM BORQANE12/04/2022, 4:09 PM
Yaron Levi12/04/2022, 6:57 PM
Are there any shortcuts to apply many yaml files at once?
prefect deployment apply jobs/selfServiceDaily.yaml
João Coelho12/04/2022, 8:45 PM
datamongus12/05/2022, 12:16 AM
Abhinav Ayalur12/05/2022, 1:05 AM
Abhinav Ayalur12/05/2022, 1:27 AM
oliverek1212/05/2022, 4:25 AM
Ben Muller12/05/2022, 6:15 AM
with no cluster. It seems like about two tasks run at a time and then another two start, my assumption was that all 8 would start and Dask handles them and they finish when they are ready? I know this would be limited by the threads too, but the machine it is running on should have more than enough threads to handle those 8 tasks.
Deepanshu Aggarwal12/05/2022, 6:56 AM
iñigo12/05/2022, 9:07 AM
Joël Luijmes12/05/2022, 10:44 AM
Vadym Dytyniak12/05/2022, 11:17 AM
exception to fail and do not retry the task, does it exist in Prefect 2?
Timo12/05/2022, 1:26 PM
Luca Schneider12/05/2022, 2:02 PM
State Message Flow run infrastructure exited with non-zero status code -1.
Justin Trautmann12/05/2022, 2:30 PM
Matthew Ferry12/05/2022, 3:06 PM
Vadym Dytyniak12/05/2022, 3:06 PM
? When I try to use task.fn it fails with no task or flow context.
Vadym Dytyniak12/05/2022, 4:06 PM
@task() def copy_file(n: int): get_run_logger().info('Start file copying') time.sleep(n) get_run_logger().info('Completed file copying') @flow(task_runner=SequentialTaskRunner()) def sample() -> None: copy_file.map([3, 4]) if __name__ == '__main__': sample()
18:05:29.909 | INFO | Flow run 'devious-aardwolf' - Created task run 'copy_file-6cc8b0a3-0' for task 'copy_file' 18:05:29.910 | INFO | Flow run 'devious-aardwolf' - Executing 'copy_file-6cc8b0a3-0' immediately... 18:05:29.916 | INFO | Flow run 'devious-aardwolf' - Created task run 'copy_file-6cc8b0a3-1' for task 'copy_file' 18:05:29.917 | INFO | Flow run 'devious-aardwolf' - Executing 'copy_file-6cc8b0a3-1' immediately... 18:05:30.468 | INFO | Task run 'copy_file-6cc8b0a3-1' - Start file copying 18:05:30.534 | INFO | Task run 'copy_file-6cc8b0a3-0' - Start file copying 18:05:33.536 | INFO | Task run 'copy_file-6cc8b0a3-0' - Completed file copying 18:05:33.726 | INFO | Task run 'copy_file-6cc8b0a3-0' - Finished in state Completed() 18:05:34.469 | INFO | Task run 'copy_file-6cc8b0a3-1' - Completed file copying 18:05:34.658 | INFO | Task run 'copy_file-6cc8b0a3-1' - Finished in state Completed()
Tim-Oliver12/05/2022, 4:37 PM
tr = await client.read_task_runs(limit=1, flow_run_filter=FlowRunFilter.construct(id="562d1705cfcc48a0b55df98373fd10bd"))
Christian Vogel12/05/2022, 5:14 PM
Ashley Felber12/05/2022, 5:39 PM
Jean-Michel Provencher12/05/2022, 6:48 PM
Jean-Michel Provencher12/05/2022, 6:48 PM
Rob Freedy12/06/2022, 4:18 PM
flag which will skip uploading all of the files to remote storage. You can submit a feature request for specifying files here: https://github.com/PrefectHQ/prefect/issues/new/choose The prefect ignore file has the same syntax as a gitignore file, which should support wildcards: https://git-scm.com/docs/gitignore