Darragh
07/09/2020, 12:27 PMFargateTaskEnvironment
. I have a self hosted Prefect 0.12.2 instance running on AWS, and am trying to run a flow against Fargate, but getting the following error that seems to only relate to Cloud hosted versions. Any ideas?
From fargate_task.py287
container_overrides = [
{
"name": "flow-container",
"environment": [
{
"name": "PREFECT__CLOUD__AUTH_TOKEN",
"value": config.cloud.agent.auth_token
or config.cloud.auth_token,
},
{"name": "PREFECT__CONTEXT__FLOW_RUN_ID", "value": flow_run_id},
{"name": "PREFECT__CONTEXT__IMAGE", "value": get_flow_image(flow)},
],
}
]
itay livni
07/09/2020, 1:08 PMDarragh
07/09/2020, 1:09 PMFargateTaskEnvironment
itay livni
07/09/2020, 1:14 PMitay livni
07/09/2020, 1:14 PMitay livni
07/09/2020, 1:17 PMDarragh
07/09/2020, 1:18 PMDarragh
07/09/2020, 3:23 PMjosh
07/09/2020, 3:27 PMDarragh
07/09/2020, 3:28 PMjosh
07/09/2020, 3:32 PMjosh
07/09/2020, 3:35 PMDarragh
07/09/2020, 3:45 PMDarragh
07/09/2020, 3:46 PMjosh
07/09/2020, 3:46 PMDarragh
07/09/2020, 3:52 PMjosh
07/09/2020, 3:52 PMDarragh
07/09/2020, 3:55 PMjosh
07/09/2020, 3:58 PMDarragh
07/09/2020, 4:00 PMDarragh
07/09/2020, 4:03 PMjosh
07/09/2020, 4:04 PMmetadata["job_spec_1"]
or something and it would use that specific job specDarragh
07/09/2020, 4:06 PMDarragh
07/09/2020, 5:53 PMprefect_version="master"
in my DockerStorage, or other?Darragh
07/10/2020, 2:56 PMjosh
07/10/2020, 2:57 PMDarragh
07/10/2020, 5:14 PMDarragh
07/13/2020, 10:45 AMflow.storage = Docker(…., prefect_version="master")
• Local installation for build/register: pip install git+<https://github.com/PrefectHQ/prefect.git@master>
• Server updatedL pip install git+<https://github.com/PrefectHQ/prefect.git@master>
And still
Failed to load and execute Flow's environment: BoxKeyError("'Config' object has no attribute 'auth_token'",)
josh
07/13/2020, 12:55 PMDarragh
07/13/2020, 1:32 PMStep 3/9 : RUN pip show prefect || pip install git+<https://github.com/PrefectHQ/prefect.git@master#egg=prefect[kubernetes]>
josh
07/13/2020, 1:38 PMDarragh
07/13/2020, 1:49 PMDarragh
07/13/2020, 1:50 PMDarragh
07/13/2020, 1:51 PMjosh
07/13/2020, 1:54 PM<http://registry.gitlab.com/STUFF/parallell:latest|registry.gitlab.com/STUFF/parallell:latest>
already has prefect baked into it then it won’t install from master. python:3.7-slim
image as my baseDarragh
07/13/2020, 1:56 PMFROM prefecthq/prefect:0.12.2-python3.6
What would I need to change to so I can get master?josh
07/13/2020, 1:57 PMprefecthq/prefect:master
Darragh
07/13/2020, 1:58 PMDarragh
07/13/2020, 2:52 PMDarragh
07/13/2020, 5:07 PMThe security token included in the request is invalid'
josh
07/13/2020, 5:11 PMDarragh
07/13/2020, 5:48 PMlaunch_type="FARGATE",
region="us-east-1",
aws_session_token="FwoGZXIvYXdzEOL//////////wEaDFSgRMmr3M07yXJ3gCKCAdZO6f/LRZc6b7DjDip0lrTvCa+FDQpFAGJEyB6Ka1tF9By3fTgKkbqSM6EnuHQgTEviQJrOn13E7wlvKKVV1++YGaa3gb1Pn9q12BxCN7I6SvQ8oBW9AE73Judo0tuYTdTc5eYC7m2PaYU/d5fkRIj29EJWp9EpO3+yq/S1saxiGvYosKGy+AUyKBOOerH4ymGN9lxo/5aprU5DXumyaC6yg2satDNNoUdPaSBQ2R8fNq0=",
cpu="256",
memory="512"
josh
07/13/2020, 5:58 PMDarragh
07/14/2020, 8:25 AM