worked out a way around it, I made my initial discovery task catch all errors and simply made a return item that indicated the exception, then, in the following filter I removed those items.
But the main issues was I didn't want to decorate the task because when I use the same task later I wanted it to have failures. Making it catch the failures and filter them out seems the correct model now I used it that way.