Akshey
09/15/2023, 2:06 PMprefect config set PREFECT_API_URL=<http://127.0.0.1:4200/api>
• run the python script
09:40:56.066 | INFO | prefect.engine - Created flow run 'jasper-dachshund' for flow 'main_flow'
09:40:56.070 | INFO | Flow run 'jasper-dachshund' - View at <http://127.0.0.1:4200/flow-runs/flow-run/27bd6913-5bf8-440c-958c-5ebfceea0b7b>
09:40:56.176 | INFO | Flow run 'jasper-dachshund' - Created task run 'load_combine_dataset-0' for task 'load_combine_dataset'
09:40:56.178 | INFO | Flow run 'jasper-dachshund' - Executing 'load_combine_dataset-0' immediately...
09:41:27.748 | INFO | Task run 'load_combine_dataset-0' - Finished in state Completed()
09:41:30.110 | INFO | Flow run 'jasper-dachshund' - Created task run 'lexical_features-0' for task 'lexical_features'
09:41:30.112 | INFO | Flow run 'jasper-dachshund' - Executing 'lexical_features-0' immediately...
09:42:34.146 | INFO | Task run 'lexical_features-0' - Finished in state Completed()
09:42:38.077 | INFO | Flow run 'jasper-dachshund' - Created task run 'data_preprocess-0' for task 'data_preprocess'
09:42:38.078 | INFO | Flow run 'jasper-dachshund' - Executing 'data_preprocess-0' immediately...
09:46:31.694 | INFO | Task run 'data_preprocess-0' - Finished in state Completed()
09:46:31.759 | INFO | Flow run 'jasper-dachshund' - Finished in state Completed('All states completed.')
Can anyone please help to debug this?Islam Otmani
09/15/2023, 9:51 PMprefect profile ls
, and prefect profile inspect
, are the values matching your expectation?PREFECT_API_URL=<http://127.0.0.1:4200/api>
?Akshey
09/15/2023, 9:52 PMIslam Otmani
09/15/2023, 9:52 PMAkshey
09/15/2023, 9:56 PMIslam Otmani
09/15/2023, 9:57 PMAkshey
09/15/2023, 9:58 PMIslam Otmani
09/15/2023, 10:02 PMcurl '<http://127.0.0.1:4200/api/work_pools/filter>' -H 'Content-Type: application/json' --data-raw '{}'
curl '<http://127.0.0.1:4200/api/flow_runs/count>' -H 'Content-Type: application/json' --data-raw '{}'
Akshey
09/15/2023, 10:04 PM[{"id":"a1feda9c-ad3f-4c9d-8d18-ea7ab61427d0","created":"2023-08-11T18:47:58.348000+00:00","updated":"2023-08-11T18:47:58.348000+00:00","name":"default-agent-pool","description":null,"type":"prefect-agent","base_job_template":{},"is_paused":false,"concurrency_limit":null,"default_queue_id":"eadb5e37-d20e-4d36-af62-511fc7f3b930"},{"id":"837881d4-0795-4e82-8401-281ccd731700","created":"2023-08-18T23:04:52.405877+00:00","updated":"2023-08-18T23:04:52.417000+00:00","name":"zoompool","description":null,"type":"process","base_job_template":{"job_configuration":{"command":"{{ command }}","env":"{{ env }}","labels":"{{ labels }}","name":"{{ name }}","stream_output":"{{ stream_output }}","working_dir":"{{ working_dir }}"},"variables":{"type":"object","properties":{"name":{"title":"Name","description":"Name given to infrastructure created by a worker.","type":"string"},"env":{"title":"Environment Variables","description":"Environment variables to set when starting a flow run.","type":"object","additionalProperties":{"type":"string"}},"labels":{"title":"Labels","description":"Labels applied to infrastructure created by a worker.","type":"object","additionalProperties":{"type":"string"}},"command":{"title":"Command","description":"The command to use when starting a flow run. In most cases, this should be left blank and the command will be automatically generated by the worker.","type":"string"},"stream_output":{"title":"Stream Output","description":"If enabled, workers will stream output from flow run processes to local standard output.","default":true,"type":"boolean"},"working_dir":{"title":"Working Directory","description":"If provided, workers will open flow run processes within the specified path as the working directory. Otherwise, a temporary directory will be created.","type":"string","format":"path"}}}},"is_paused":false,"concurrency_limit":null,"default_queue_id":"c0c5a6c5-b6cb-4706-9fe6-df9783fbd741"}](prefect-ops)
Islam Otmani
09/15/2023, 10:05 PMAkshey
09/15/2023, 10:07 PMIslam Otmani
09/15/2023, 10:08 PM4200
and this is 4201
Akshey
09/15/2023, 10:09 PMIslam Otmani
09/15/2023, 10:09 PMAkshey
09/15/2023, 10:10 PMIslam Otmani
09/15/2023, 10:11 PMcurl '<http://127.0.0.1:4201/api/flow_runs/count>' -H 'Content-Type: application/json' --data-raw '{}'
Akshey
09/15/2023, 10:12 PMcurl: (7) Failed to connect to 127.0.0.1 port 4201 after 0 ms: Connection refused
Islam Otmani
09/15/2023, 10:13 PMAkshey
09/15/2023, 10:13 PMIslam Otmani
09/15/2023, 10:16 PMAkshey
09/15/2023, 10:18 PMIslam Otmani
09/15/2023, 10:22 PMAkshey
09/15/2023, 10:24 PMIslam Otmani
09/15/2023, 10:25 PMcount
(the first row), and 'Preview', do you see your expected count of 39
by any chance?Akshey
09/15/2023, 10:27 PMIslam Otmani
09/15/2023, 10:28 PMAkshey
09/15/2023, 10:29 PMIslam Otmani
09/15/2023, 10:37 PMAkshey
09/15/2023, 10:39 PMIslam Otmani
09/15/2023, 10:43 PMAkshey
09/15/2023, 10:44 PMssh -L [LOCAL_IP:]LOCAL_PORT:DESTINATION:DESTINATION_PORT [USER@]SSH_SERVER
Islam Otmani
09/15/2023, 11:14 PMssh -L 4300:myec2:4200 myuser@myec2
Akshey
09/15/2023, 11:15 PMIslam Otmani
09/15/2023, 11:17 PMAkshey
09/15/2023, 11:17 PMPermission Denied
when I am trying to sshIslam Otmani
09/15/2023, 11:19 PMAkshey
09/15/2023, 11:23 PMPermission denied (publickey).
Islam Otmani
09/15/2023, 11:24 PMAkshey
09/15/2023, 11:24 PMIslam Otmani
09/15/2023, 11:27 PMAkshey
09/15/2023, 11:28 PMIslam Otmani
09/16/2023, 12:10 AMAkshey
09/16/2023, 4:29 PMIslam Otmani
09/17/2023, 4:30 AMAkshey
09/17/2023, 4:36 AM