This only happens when using the kubernetes work pool. When I am using a local process work pool, S3 works.

The backoff limit error makes me think your k8s job was in a cycle of failing and retrying. Is it possible the environment in k8s doesn't have the right credentials or vars to access S3 that you may have set up locally?