Hui Zheng
01/20/2021, 12:58 AMHTTPSConnectionPool(host='10.124.0.1', port=443): Max retries exceeded with url: /apis/batch/v1/namespaces/default/jobs (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fa7a7705668>: Failed to establish a new connection: [Errno 111] Connection refused',))
Riley Hun
01/20/2021, 1:06 AM0.14.4
and I can no longer run flow.environment.executor = executor
. I get the following error AttributeError: 'NoneType' object has no attribute 'executor'
. Does anyone know how to attach an executor to a flow registered to Prefect Server using Docker Storage in the latest version of Prefect. Had no issues with this is Prefect version 0.13.18
.
In the meantime, I'll downgrade to 0.13.8
for the time being.SK
01/20/2021, 2:28 AMSK
01/20/2021, 2:28 AMAiden Price
01/20/2021, 4:49 AMlatest
tag and Always
pull so I can be sure I'm getting the latest dependencies. I'd like to minimise the delay by changing to a IfNotPresent
image pull policy, but then I'd need to pin the image tag to a specific version, but then I'd want to make sure that specific tag could be updated as I keep pushing updates.
Does anyone have any advice? Thanks.Riley Hun
01/20/2021, 5:33 AMPrefect 0.14.4
. My flow, which is using Docker storage and Dask Gateway as the executor, is working fine after the transition. I finished reading the updated documentation and I'm trying to understand the concept of Run Configuration
. I don't quite understand it, especially since my scheduled flow worked without it, so how do I know when a Run Config is applicable?Vitaly Shulgin
01/20/2021, 1:31 PMPaul Vanetti
01/20/2021, 1:35 PMMarwan Sarieddine
01/20/2021, 1:48 PMStartFlowRun
- I just want to make sure I am doing this correctly - please see the example in the thread.Vitaly Shulgin
01/20/2021, 2:34 PMMatthew Blau
01/20/2021, 3:23 PMVipul
01/20/2021, 4:32 PMJ. Martins
01/20/2021, 5:19 PMLuis Gallegos
01/20/2021, 6:22 PMSK
01/20/2021, 7:44 PMZach
01/20/2021, 8:37 PMZach
01/20/2021, 8:37 PMZach
01/20/2021, 8:37 PMBK Lau
01/20/2021, 8:55 PMAlberto de Santos
01/20/2021, 9:06 PMSean Talia
01/20/2021, 9:15 PMaws
extras?Vitaly Shulgin
01/20/2021, 9:26 PMMatic Lubej
01/20/2021, 9:49 PMSai Srikanth
01/20/2021, 10:11 PMLuis Gallegos
01/20/2021, 11:28 PMwith Flow("example-flow") as flow:
example_param = Parameter('example')
print(example_param)
Thanks for your help!!Darshan
01/20/2021, 11:37 PM@task
def task_1(some_param):
// Do something
@task
def task_2():
// Do something
@task
def task_3(some_other_param):
// Do something
flow.set_dependencies(task = task_1)
flow.set_dependencies(task = task_2, upstream_tasks=[task_1])
flow.set_dependencies(task = task_3, upstream_tasks=[task_2])
Hui Zheng
01/21/2021, 1:15 AMGCS_result
. It happened to flow runs on different agents and k8e clusters. I wonder if there is a Prefect-cloud infrastructure issue?Sagun Garg
01/21/2021, 3:23 AMNoCredentialsError('Unable to locate credentials')Traceback
Reference Blog: https://makeitnew.io/prefect-a-modern-python-native-data-workflow-engine-7ece02ceb396
```
Unexpected error while reading from result handler: NoCredentialsError('Unable to locate credentials')Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/prefect/engine/results/s3_result.py", line 136, in read Bucket=self.bucket, Key=location, Fileobj=stream File "/usr/local/lib/python3.7/site-packages/boto3/s3/inject.py", line 678, in download_fileobj return future.result() File "/usr/local/lib/python3.7/site-packages/s3transfer/futures.py", line 106, in result return self._coordinator.result() File "/usr/local/lib/python3.7/site-packages/s3transfer/futures.py", line 265, in result raise self._exception
Loc Nguyen
01/21/2021, 3:26 AMsudo docker run -d prefecthq/prefect:latest
Checking docker logs, i have this:
tini (tini version 0.18.0)
Usage: tini [OPTIONS] PROGRAM -- [ARGS] | --version
Execute a program under the supervision of a valid init process (tini)
Command line options:
--version: Show version and exit.
-h: Show this help message and exit.
-s: Register as a process subreaper (requires Linux >= 3.4).
-p SIGNAL: Trigger SIGNAL when parent dies, e.g. "-p SIGKILL".
-v: Generate more verbose output. Repeat up to 3 times.
-w: Print a warning when processes are getting reaped.
-g: Send signals to the child's process group.
-e EXIT_CODE: Remap EXIT_CODE (from 0 to 255) to 0.
-l: Show license and exit.
Environment variables:
TINI_SUBREAPER: Register as a process subreaper (requires Linux >= 3.4).
TINI_VERBOSITY: Set the verbosity level (default: 1).
TINI_KILL_PROCESS_GROUP: Send signals to the child's process group.
It is quite unclear what is the issue 😞eamonn faherty
01/21/2021, 11:11 AM