Shaun Cutts
08/24/2020, 3:36 AM# deploy environment, which impacts default values for some settings.
# Make sure this is lower case because config keys are lower case.
env = “local”Where are the defaults that it impacts, and should I use (/create) a new
env
setting? (“kubernetes” — for instance?)
Question 5d)
What about the config.toml [services] block? With “host=0.0.0.0”, is this outbound config?
I was thinking that this is config for graphql and for towel. Is it config for apollo to? Do I eg. need to set PREFECT__SERVICES__APOLLO__PORT in the apollo container? … hmm… afaikt … this isn’t read there. Is this then obsolete config? Or in fact inbound config?
EDIT — so apollo env in docker-compose has PREFECT_SERVER__TELEMETRY__ENABLED: ${PREFECT_SERVER__TELEMETRY__ENABLED:-true}
. Is there something in the apollo that is reading the toml and these interpolations? (If so, why use different form for HASURA etc here?)Shaun Cutts
08/25/2020, 1:06 AM{"status":"ok","version":"UNKNOWN"}
GraphQL service healthy!
> @ serve /apollo
> node dist/index.js
2020-08-25T00:43:27.136Z Building schema...
2020-08-25T00:43:27.155Z Error: Could not obtain introspection result, received: {"path":"$","error":"resource does not exist","code":"not-found"}
at getSchemaFromIntrospection (/apollo/node_modules/@graphql-tools/wrap/index.cjs.js:981:15)
at introspectSchema (/apollo/node_modules/@graphql-tools/wrap/index.cjs.js:990:12)
at process._tickCallback (internal/process/next_tick.js:68:7) Could not obtain introspection result, received: {"path":"$","error":"resource does not exist","code":"not-found"} Error: Could not obtain introspection result, received: {"path":"$","error":"resource does not exist","code":"not-found"}
at getSchemaFromIntrospection (/apollo/node_modules/@graphql-tools/wrap/index.cjs.js:981:15)
at introspectSchema (/apollo/node_modules/@graphql-tools/wrap/index.cjs.js:990:12)
at process._tickCallback (internal/process/next_tick.js:68:7)
2020-08-25T00:43:27.155Z
Trying again in 3 seconds...
Shaun Cutts
08/25/2020, 1:11 AM- name: HASURA_API_URL
value: <http://prefect-server-hasura.prefect-server.svc.cluster.local:3000/v1alpha/graphql>
- name: PREFECT_API_URL
value: <http://prefect-server-graphql.prefect-server.svc.cluster.local:4201/graphql/>
- name: PREFECT_API_HEALTH_URL
value: <http://prefect-server-graphql.prefect-server.svc.cluster.local:4201/health>
- name: GRAPHQL_SERVICE_HOST
value: <http://prefect-server-graphql.prefect-server.svc.cluster.local>
- name: GRAPHQL_SERVICE_PORT
value: "4201"
which I think are correct:
prefect-server-graphql ClusterIP 172.20.137.57 <none> 4201/TCP 38m
prefect-server-hasura ClusterIP 172.20.185.76 <none> 3000/TCP 38m
Do I also need PREFECT_SERVER__* settings here? Any other debugging info?
chart code is in https://github.com/PrefectHQ/server/pull/57
@Chris White @Jeremiah — any thoughts?Shaun Cutts
09/02/2020, 4:50 PMitay livni
09/03/2020, 6:09 PMMichael Ludwig
09/05/2020, 10:20 PMRobin
09/08/2020, 8:17 AMimport prefect
takes more than 1s. However, this can't be due to my small changes, can it?
Background:
I had problems with the NoRegionError
for the boto client. It seems like setting the region_name
as kwarg of the secret manager's run method is the most elegant way of solving this issue. Therefore, I added the kwargs to the run method.Alex Cano
09/10/2020, 8:27 PMflow_groups
? I can’t seem to find docs on what they exactly are. As a guess, they look like they can be used to apply settings across many flows? I’m specifically thinking about flow_groups
with regards to implementing Flow Concurrency Limits into the new server codebase, so it’s looking like (based on some other code) we look at the flow_group
labels first, then default to the environment
labels? Is that how it should be implemented for this as well? Or should it be checking both sets of labels? I’d guess both sets, but not sureShaun Cutts
09/12/2020, 1:15 AMitay livni
09/15/2020, 8:45 PMalex
09/18/2020, 12:50 AMresults = []
for op in operations:
op = task(op)
most_recent = op
.. a few more conditional tasks defined at compile time
if do_recovery:
recovery_task = recover(trigger=any_failed_else_raise_skip_signal)
most_recent = recovery_task
results.append(most_recent)
backup_task = Backup('mydatabasename', upstream_tasks=[results], skip_on_upstream_skip=False)
mapped = Aggregate.map(
results,
target=unmapped('mydatabasename')
)
mapped.set_upstream([backup_task])
As you can see from the image, instead of getting one list, I have 2 lists and due to this, my Aggregate task is being skipped even though it is downstream of a skip_on_upstream_skip
task. Is there a way to cleanly resolve this (ie. only get 1 list) ?Alex Cano
09/22/2020, 7:04 PMlabeler
in github actions? It looks like the action is failing on this PR: https://github.com/PrefectHQ/server/actions/runs/266743999Tenzin Choedak
10/03/2020, 11:08 PMmaster
or is there a different branch I should use?
For context i’m fixing issue 3318 and my fixes are in my branch.max
10/06/2020, 6:53 PMmax
10/06/2020, 6:53 PMale
10/08/2020, 4:23 PMlast_modified_start
and last_modified_end
to leverage the last_modified
property of keys, to make it possible to filter keys based on time.
I’m struggling to find a way to mock boto3 put_object to write a meaningful test.
Any suggestions?Laura Lorenz
10/15/2020, 9:10 PMBraun Reyes
10/26/2020, 7:20 PMextra_containers
argument to support adding sidecars to the flow run container
2 - add the ability to skip the task definition registration based a run context key of task_arn_override
. This would allow folks using a map to submit flow run(subflow pattern) to skip the task registration issue that @Darragh and @Lukas were running intoBraun Reyes
10/26/2020, 7:20 PMBraun Reyes
10/26/2020, 7:22 PMGraphQLResult
?Braun Reyes
10/26/2020, 7:37 PMserialized_state.context
Lonneke
11/02/2020, 9:24 AMBut also, one thing we'd really like is a user written example on how you use and deploy prefect to do real work! (Realize that's not quite what you were asking about so no worries if you'd rather focus on adding to the code!). We also really welcome additions and contributions to the docs!@Jenny This is exactly what I was trying to find, do you know if anyone else started on this?
Jenny
11/02/2020, 2:18 PMHenry
11/05/2020, 5:38 PMHenry
11/05/2020, 5:38 PMLaura Lorenz
11/06/2020, 8:48 PMLaura Lorenz
11/06/2020, 8:49 PMLaura Lorenz
11/09/2020, 9:15 PMLaura Lorenz
11/09/2020, 9:15 PMLaura Lorenz
11/20/2020, 9:12 PMLaura Lorenz
11/20/2020, 9:12 PM