I’m trying to setup a simple one node cluster using on-prem provider config and the process failed at ‘Starting Master Process’ task.
the error log are like this:
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - PLAY RECAP *********************************************************************
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - 34.146.143.75 : ok=10 changed=4 unreachable=0 failed=0 skipped=38 rescued=0 ignored=0
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 -
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Monday 02 December 2024 04:43:47 +0000 (0:00:00.203) 0:00:17.897 *******
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - ===============================================================================
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Gathering Facts --------------------------------------------------------- 2.01s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Perform start on the yb-master ------------------------------------------ 1.41s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Enable the yb-master ---------------------------------------------------- 1.41s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Reload daemon ----------------------------------------------------------- 1.41s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Determine system or user scope ------------------------------------------ 1.41s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Reload daemon ----------------------------------------------------------- 1.41s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Remove server conf file of master --------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Perform daemon-reload for removed services ------------------------------ 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Print systemd_user ------------------------------------------------------ 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Remove cron job that collects metrics ----------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - set_fact ---------------------------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Delete clean cores service ---------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Perform stop on the yb-master ------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Print systemd_status_output.rc ------------------------------------------ 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Reload daemon ----------------------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Reload daemon ----------------------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Print ctl_script_stat --------------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Check ctl script exists ------------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Log node_exporter_stat -------------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Delete purge logs service ----------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Print systemd_prefix ---------------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Stop node exporter service ---------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.365Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Delete metrics collection service --------------------------------------- 0.21s
YW 2024-12-02T04:43:47.366Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Set the systemd prefix -------------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.366Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Delete yb-controller service -------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.366Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Delete yb-tserver service ----------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.366Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Delete otel collector service ------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.366Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Delete yb-master service ------------------------------------------------ 0.21s
YW 2024-12-02T04:43:47.366Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Call the ctl script with appropriate args ------------------------------- 0.21s
YW 2024-12-02T04:43:47.366Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Disable the yb-master --------------------------------------------------- 0.21s
YW 2024-12-02T04:43:47.366Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 -
YW 2024-12-02T04:43:47.366Z [INFO] 2da31905-4368-4683-a611-bccafe5ee413 from ShellProcessHandler in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Completed proc ‘bin/ybcloud.sh onprem --region asia-northeast-1 instance control yb-dev-yb-universe-3-n1’ status=success [ 19527 ms ]
YW 2024-12-02T04:43:47.367Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from TaskExecutor in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Completed task AnsibleClusterServerCtl(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)(2a9bdf0f-7817-4bad-b4c5-922a71471e2b, yb-dev-yb-universe-3-n1)(yb-dev-yb-universe-3-n1, master: start) in 19s
YW 2024-12-02T04:43:47.368Z [INFO] 2da31905-4368-4683-a611-bccafe5ee413 from DefaultTaskExecutionListener in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Task taskType : AnsibleClusterServerCtl, taskState: Success is completed
YW 2024-12-02T04:43:47.368Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from TaskExecutor in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Task WaitForServer(2a9bdf0f-7817-4bad-b4c5-922a71471e2b, yb-dev-yb-universe-3-n1, type=MASTER) waited for 0s
YW 2024-12-02T04:43:47.368Z [INFO] 2da31905-4368-4683-a611-bccafe5ee413 from DefaultTaskExecutionListener in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - About to execute task taskType : WaitForServer, taskState: Created
YW 2024-12-02T04:43:47.369Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from TaskExecutor in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Invoking run() of task WaitForServer(2a9bdf0f-7817-4bad-b4c5-922a71471e2b, yb-dev-yb-universe-3-n1, type=MASTER)
YW 2024-12-02T04:43:47.369Z [INFO] 2da31905-4368-4683-a611-bccafe5ee413 from ServerSubTaskBase in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Running WaitForServer(2a9bdf0f-7817-4bad-b4c5-922a71471e2b, yb-dev-yb-universe-3-n1, type=MASTER) on masterAddress = 34.146.143.75:7100.
YW 2024-12-02T04:44:44.568Z [WARN] 2da31905-4368-4683-a611-bccafe5ee413 from YBClient in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Hit 100 errors so far. Latest is : [Peer fakeUUID → 34.146.143.75:7100] Connection reset on [id: 0xe4142cf8, L:null ! R:/34.146.143.75:7100].
YW 2024-12-02T04:44:53.929Z [INFO] c851a80c-4a89-4c9d-9a2b-c6ab51cdc15f from SetUniverseKey in application-pekko.actor.default-dispatcher-20573 - Skipping setting universe keys as 2a9bdf0f-7817-4bad-b4c5-922a71471e2b does not have EAR enabled.
YW 2024-12-02T04:44:53.970Z [DEBUG] 06188840-8baa-4a91-9dc9-50febc1dfdf1 from AutoMasterFailoverScheduler in application-pekko.actor.default-dispatcher-20573 - Automated master failover for universe 2a9bdf0f-7817-4bad-b4c5-922a71471e2b is disabled
YW 2024-12-02T04:45:42.254Z [WARN] 2da31905-4368-4683-a611-bccafe5ee413 from YBClient in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Hit 200 errors so far. Latest is : [Peer fakeUUID → 34.146.143.75:7100] Connection reset on [id: 0x5eb42d47, L:null ! R:/34.146.143.75:7100].
YW 2024-12-02T04:45:42.254Z [INFO] 2da31905-4368-4683-a611-bccafe5ee413 from YBClient in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Tried operation 200 times so far.
YW 2024-12-02T04:46:39.939Z [WARN] 2da31905-4368-4683-a611-bccafe5ee413 from YBClient in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Hit 300 errors so far. Latest is : [Peer fakeUUID → 34.146.143.75:7100] Connection reset on [id: 0xea8e5da4, L:null ! R:/34.146.143.75:7100].
YW 2024-12-02T04:46:53.950Z [INFO] 25d7ea1f-94a5-4103-ae0c-975824acb37f from SetUniverseKey in application-pekko.actor.default-dispatcher-20561 - Skipping setting universe keys as 2a9bdf0f-7817-4bad-b4c5-922a71471e2b does not have EAR enabled.
YW 2024-12-02T04:46:53.990Z [DEBUG] a8d24aad-ab2e-465c-a133-7c59542c012e from AutoMasterFailoverScheduler in application-pekko.actor.default-dispatcher-20561 - Automated master failover for universe 2a9bdf0f-7817-4bad-b4c5-922a71471e2b is disabled
YW 2024-12-02T04:47:37.617Z [WARN] 2da31905-4368-4683-a611-bccafe5ee413 from YBClient in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Hit 400 errors so far. Latest is : [Peer fakeUUID → 34.146.143.75:7100] Connection reset on [id: 0x16ee9173, L:null ! R:/34.146.143.75:7100].
YW 2024-12-02T04:47:37.618Z [INFO] 2da31905-4368-4683-a611-bccafe5ee413 from YBClient in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Tried operation 400 times so far.
YW 2024-12-02T04:48:35.310Z [WARN] 2da31905-4368-4683-a611-bccafe5ee413 from YBClient in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Hit 500 errors so far. Latest is : [Peer fakeUUID → 34.146.143.75:7100] Connection reset on [id: 0xa09ee8d2, L:null ! R:/34.146.143.75:7100].
YW 2024-12-02T04:48:47.923Z [ERROR] 2da31905-4368-4683-a611-bccafe5ee413 from YBClient in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Hit too many errors, final exception is [Peer fakeUUID → 34.146.143.75:7100] Connection reset on [id: 0xf3ef7848, L:null ! R:/34.146.143.75:7100].
YW 2024-12-02T04:48:47.923Z [ERROR] 2da31905-4368-4683-a611-bccafe5ee413 from YBClient in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Returning failure after 521 iterations, num errors = 521.
YW 2024-12-02T04:48:47.924Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from LocalYBClientService in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Closing client masters=34.146.143.75:7100.
YW 2024-12-02T04:48:47.926Z [ERROR] 2da31905-4368-4683-a611-bccafe5ee413 from TaskExecutor in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Failed to execute task type WaitForServer UUID a569c3e7-812d-44f2-85d6-52084a2b2466 details {“platformVersion”:“2.23.1.0-b220”,“sleepAfterMasterRestartMillis”:180000,“sleepAfterTServerRestartMillis”:180000,“nodeExporterUser”:“prometheus”,“universeUUID”:“2a9bdf0f-7817-4bad-b4c5-922a71471e2b”,“enableYbc”:false,“installYbc”:false,“ybcInstalled”:false,“encryptionAtRestConfig”:{“encryptionAtRestEnabled”:false,“opType”:“UNDEFINED”,“type”:“DATA_KEY”},“communicationPorts”:{“masterHttpPort”:7000,“masterRpcPort”:7100,“tserverHttpPort”:9000,“tserverRpcPort”:9100,“ybControllerHttpPort”:14000,“ybControllerrRpcPort”:18018,“redisServerHttpPort”:11000,“redisServerRpcPort”:6379,“yqlServerHttpPort”:12000,“yqlServerRpcPort”:9042,“ysqlServerHttpPort”:13000,“ysqlServerRpcPort”:5433,“internalYsqlServerRpcPort”:6433,“nodeExporterPort”:9300,“otelCollectorMetricsPort”:8889},“extraDependencies”:{“installNodeExporter”:true},“nodeName”:“yb-dev-yb-universe-3-n1”,“serverType”:“MASTER”,“serverWaitTimeoutMs”:300000,“targetXClusterConfigs”:,“sourceXClusterConfigs”:}, hit error.
java.lang.RuntimeException: WaitForServer(2a9bdf0f-7817-4bad-b4c5-922a71471e2b, yb-dev-yb-universe-3-n1, type=MASTER) did not respond in the set time.
at com.yugabyte.yw.commissioner.tasks.subtasks.WaitForServer.run(WaitForServer.java:104)
at com.yugabyte.yw.commissioner.TaskExecutor$AbstractRunnableTask.run(TaskExecutor.java:934)
at com.yugabyte.yw.commissioner.TaskExecutor$RunnableSubTask.run(TaskExecutor.java:1367)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at com.yugabyte.yw.common.logging.MDCAwareRunnable.run(MDCAwareRunnable.java:46)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
YW 2024-12-02T04:48:47.926Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from TaskExecutor in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Task creator callstack:
com.yugabyte.yw.commissioner.TaskExecutor$SubTaskGroup.addSubTask(TaskExecutor.java:605)
com.yugabyte.yw.commissioner.tasks.UniverseTaskBase.createWaitForServersTasks(UniverseTaskBase.java:3019)
com.yugabyte.yw.commissioner.tasks.UniverseTaskBase.createWaitForServersTasks(UniverseTaskBase.java:2966)
com.yugabyte.yw.commissioner.tasks.UniverseDefinitionTaskBase.createStartMasterProcessTasks(UniverseDefinitionTaskBase.java:2568)
com.yugabyte.yw.commissioner.tasks.CreateUniverse.run(CreateUniverse.java:190)
com.yugabyte.yw.commissioner.TaskExecutor$AbstractRunnableTask.run(TaskExecutor.java:934)
com.yugabyte.yw.commissioner.TaskExecutor$RunnableTask.run(TaskExecutor.java:1151)
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
java.base/java.util.concurrent.FutureTask.run(Unknown Source)
com.yugabyte.yw.common.logging.MDCAwareRunnable.run(MDCAwareRunnable.java:46)
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.base/java.lang.Thread.run(Unknown Source)
YW 2024-12-02T04:48:47.927Z [DEBUG] 2da31905-4368-4683-a611-bccafe5ee413 from TaskExecutor in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Completed task WaitForServer(2a9bdf0f-7817-4bad-b4c5-922a71471e2b, yb-dev-yb-universe-3-n1, type=MASTER) in 300s
YW 2024-12-02T04:48:47.927Z [INFO] 2da31905-4368-4683-a611-bccafe5ee413 from DefaultTaskExecutionListener in TaskPool-CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b)-2 - Task taskType : WaitForServer, taskState: Failure is completed
YW 2024-12-02T04:48:47.927Z [ERROR] 2da31905-4368-4683-a611-bccafe5ee413 from TaskExecutor in TaskPool-11 - Error occurred in subtask taskType : WaitForServer, taskState: Failure
java.lang.RuntimeException: WaitForServer(2a9bdf0f-7817-4bad-b4c5-922a71471e2b, yb-dev-yb-universe-3-n1, type=MASTER) did not respond in the set time.
at com.yugabyte.yw.commissioner.tasks.subtasks.WaitForServer.run(WaitForServer.java:104)
at com.yugabyte.yw.commissioner.TaskExecutor$AbstractRunnableTask.run(TaskExecutor.java:934)
at com.yugabyte.yw.commissioner.TaskExecutor$RunnableSubTask.run(TaskExecutor.java:1367)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at com.yugabyte.yw.common.logging.MDCAwareRunnable.run(MDCAwareRunnable.java:46)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
YW 2024-12-02T04:48:47.927Z [ERROR] 2da31905-4368-4683-a611-bccafe5ee413 from CreateUniverse in TaskPool-11 - Error executing task CreateUniverse(2a9bdf0f-7817-4bad-b4c5-922a71471e2b), error=‘SubTaskGroup WaitForServer of type StartingMasterProcess at position 17: completed 1 out of 1 tasks failed.’
java.lang.RuntimeException: SubTaskGroup WaitForServer of type StartingMasterProcess at position 17: completed 1 out of 1 tasks failed.
at com.yugabyte.yw.commissioner.TaskExecutor$RunnableTask.runSubTasks(TaskExecutor.java:1281)
at com.yugabyte.yw.commissioner.TaskExecutor$RunnableTask.runSubTasks(TaskExecutor.java:1236)
at com.yugabyte.yw.commissioner.tasks.CreateUniverse.run(CreateUniverse.java:215)
at com.yugabyte.yw.commissioner.TaskExecutor$AbstractRunnableTask.run(TaskExecutor.java:934)
at com.yugabyte.yw.commissioner.TaskExecutor$RunnableTask.run(TaskExecutor.java:1151)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at com.yugabyte.yw.common.logging.MDCAwareRunnable.run(MDCAwareRunnable.java:46)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.lang.RuntimeException: WaitForServer(2a9bdf0f-7817-4bad-b4c5-922a71471e2b, yb-dev-yb-universe-3-n1, type=MASTER) did not respond in the set time.
at com.yugabyte.yw.commissioner.tasks.subtasks.WaitForServer.run(WaitForServer.java:104)
at com.yugabyte.yw.commissioner.TaskExecutor$AbstractRunnableTask.run(TaskExecutor.java:934)
at com.yugabyte.yw.commissioner.TaskExecutor$RunnableSubTask.run(TaskExecutor.java:1367)
… 6 common frames omitted