안녕하세요 이전에 물리서버에 cp-portal 구축이 잘 안되는점에 대해서 문의글 작성했었는데 여전히 되지 않아 다시 글 남깁니다.

 

네트워크적으로는 문제가 없다고 말씀해주셔서 ubuntu 권한에 대해서 확인하였는데 권한은 충분히 부여된것으로 보입니다.

 

# vi /etc/sudoers

ubuntu ALL=(ALL) NOPASSWD: ALL
ubuntu ALL=(ALL:ALL) ALL
 

 

추가로 키값도 정상적으로 등록되어 서버들끼리 ssh 접근이 잘 되고있으며, 방화벽은 OFF 상태입니다. 

 

추가로 작업해야할게 있다면 알려주시면 감사드립니다. 

 

에러 문구입니다.

TASK [cp-install : Run container platform deployment] *************************************************

fatal: [master_node]: FAILED! => {
    "changed": true,
    "cmd": "cd /home/ubuntu/cp-deployment/standalone\n./deploy-cp-cluster.sh > /home/ubuntu/cp-deployment/standalone/deploy-result.log\n",
    "delta": "0:00:09.667767",
    "end": "2024-04-11 14:23:49.166668",
    "invocation": {
        "module_args": {
            "_raw_params": "cd /home/ubuntu/cp-deployment/standalone\n./deploy-cp-cluster.sh > /home/ubuntu/cp-deployment/standalone/deploy-result.log\n",
            "_uses_shell": true,
            "argv": null,
            "chdir": null,
            "creates": null,
            "executable": null,
            "removes": null,
            "stdin": null,
            "stdin_add_newline": true,
            "strip_empty_ends": true
        }
    },
    "msg": "non-zero return code",
    "rc": 2,
    "start": "2024-04-11 14:23:39.498901",
    "stderr": "./deploy-cp-cluster.sh: line 208: return: can only `return' from a function or sourced Script\nWarning: Permanently added '192.168.118.32' (ED25519) to the list of known hosts.\r\nWarning: Permanently added '192.168.118.33' (ED25519) to the list of known hosts.\r\nWarning: Permanently added '192.168.118.34' (ED25519) to the list of known hosts.\r\nWarning: Permanently added '192.168.118.35' (ED25519) to the list of known hosts.\r\nWarning: Permanently added '192.168.118.36' (ED25519) to the list of known hosts.\r\nWarning: Permanently added '192.168.118.37' (ED25519) to the list of known hosts.\r\nWarning: Permanently added '192.168.118.38' (ED25519) to the list of known hosts.\r\n[WARNING]: Skipping callback plugin 'ara_default', unable to load\n[WARNING]: Could not match supplied host pattern, ignoring: kube-master\n[WARNING]: Could not match supplied host pattern, ignoring: kube-node\n[WARNING]: Could not match supplied host pattern, ignoring: k8s-cluster\n[WARNING]: Could not match supplied host pattern, ignoring: calico-rr\n[WARNING]: Could not match supplied host pattern, ignoring: no-floating\n[WARNING]: Could not match supplied host pattern, ignoring: bastion\n[WARNING]: raw module does not support the environment keyword\n[WARNING]: raw module does not support the environment keyword\n[WARNING]: raw module does not support the environment keyword\n[WARNING]: raw module does not support the environment keyword\n[WARNING]: raw module does not support the environment keyword\n[WARNING]: raw module does not support the environment keyword\n[WARNING]: raw module does not support the environment keyword",
    "stderr_lines": [
        "./deploy-cp-cluster.sh: line 208: return: can only `return' from a function or sourced Script",
        "Warning: Permanently added '192.168.118.32' (ED25519) to the list of known hosts.",
        "Warning: Permanently added '192.168.118.33' (ED25519) to the list of known hosts.",
        "Warning: Permanently added '192.168.118.34' (ED25519) to the list of known hosts.",
        "Warning: Permanently added '192.168.118.35' (ED25519) to the list of known hosts.",
        "Warning: Permanently added '192.168.118.36' (ED25519) to the list of known hosts.",
        "Warning: Permanently added '192.168.118.37' (ED25519) to the list of known hosts.",
        "Warning: Permanently added '192.168.118.38' (ED25519) to the list of known hosts.",
        "[WARNING]: Skipping callback plugin 'ara_default', unable to load",
        "[WARNING]: Could not match supplied host pattern, ignoring: kube-master",
        "[WARNING]: Could not match supplied host pattern, ignoring: kube-node",
        "[WARNING]: Could not match supplied host pattern, ignoring: k8s-cluster",
        "[WARNING]: Could not match supplied host pattern, ignoring: calico-rr",
        "[WARNING]: Could not match supplied host pattern, ignoring: no-floating",
        "[WARNING]: Could not match supplied host pattern, ignoring: bastion",
        "[WARNING]: raw module does not support the environment keyword",
        "[WARNING]: raw module does not support the environment keyword",
        "[WARNING]: raw module does not support the environment keyword",
        "[WARNING]: raw module does not support the environment keyword",
        "[WARNING]: raw module does not support the environment keyword",
        "[WARNING]: raw module does not support the environment keyword",
        "[WARNING]: raw module does not support the environment keyword"
    ],
    "stdout": "",
    "stdout_lines": []
}
 

 

deploy-result.log 내용입니다.

PLAY [Check Ansible version] ***************************************************
Thursday 11 April 2024  14:23:46 +0900 (0:00:00.015)       0:00:00.015 ******** 

TASK [Check 2.14.0 <= Ansible version < 2.15.0] ********************************
ok: [localhost] => {
    "changed": false,
    "msg": "All assertions passed"
}
Thursday 11 April 2024  14:23:46 +0900 (0:00:00.032)       0:00:00.048 ******** 

TASK [Check that python netaddr is installed] **********************************
ok: [localhost] => {
    "changed": false,
    "msg": "All assertions passed"
}
Thursday 11 April 2024  14:23:46 +0900 (0:00:00.068)       0:00:00.117 ******** 

TASK [Check that jinja is not too old (install via pip)] ***********************
ok: [localhost] => {
    "changed": false,
    "msg": "All assertions passed"
}

PLAY [Add kube-master nodes to kube_control_plane] *****************************
skipping: no hosts matched

PLAY [Add kube-node nodes to kube_node] ****************************************
skipping: no hosts matched

PLAY [Add k8s-cluster nodes to k8s_cluster] ************************************
skipping: no hosts matched

PLAY [Add calico-rr nodes to calico_rr] ****************************************
skipping: no hosts matched

PLAY [Add no-floating nodes to no_floating] ************************************
skipping: no hosts matched

PLAY [Install bastion ssh config] **********************************************
skipping: no hosts matched

PLAY [Bootstrap hosts for Ansible] *********************************************
Thursday 11 April 2024  14:23:46 +0900 (0:00:00.087)       0:00:00.205 ******** 
Thursday 11 April 2024  14:23:47 +0900 (0:00:00.097)       0:00:00.302 ******** 
Thursday 11 April 2024  14:23:47 +0900 (0:00:00.039)       0:00:00.342 ******** 
Thursday 11 April 2024  14:23:47 +0900 (0:00:00.033)       0:00:00.376 ******** 
Thursday 11 April 2024  14:23:47 +0900 (0:00:00.115)       0:00:00.491 ******** 
Thursday 11 April 2024  14:23:47 +0900 (0:00:00.101)       0:00:00.593 ******** 
Thursday 11 April 2024  14:23:47 +0900 (0:00:00.102)       0:00:00.696 ******** 
Thursday 11 April 2024  14:23:47 +0900 (0:00:00.107)       0:00:00.803 ******** 
Thursday 11 April 2024  14:23:47 +0900 (0:00:00.038)       0:00:00.842 ******** 
Thursday 11 April 2024  14:23:47 +0900 (0:00:00.108)       0:00:00.950 ******** 
Thursday 11 April 2024  14:23:47 +0900 (0:00:00.304)       0:00:01.255 ******** 

TASK [kubespray-defaults : Configure defaults] *********************************
ok: [master01] => {
    "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
ok: [master02] => {
    "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
ok: [master03] => {
    "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
ok: [worker01] => {
    "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
ok: [worker02] => {
    "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
ok: [worker03] => {
    "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
ok: [worker04] => {
    "msg": "Check roles/kubespray-defaults/defaults/main.yml"
}
Thursday 11 April 2024  14:23:48 +0900 (0:00:00.138)       0:00:01.394 ******** 
Thursday 11 April 2024  14:23:48 +0900 (0:00:00.053)       0:00:01.448 ******** 
Thursday 11 April 2024  14:23:48 +0900 (0:00:00.018)       0:00:01.467 ******** 
Thursday 11 April 2024  14:23:48 +0900 (0:00:00.084)       0:00:01.551 ******** 
Thursday 11 April 2024  14:23:48 +0900 (0:00:00.018)       0:00:01.570 ******** 
Thursday 11 April 2024  14:23:48 +0900 (0:00:00.083)       0:00:01.653 ******** 
Thursday 11 April 2024  14:23:48 +0900 (0:00:00.107)       0:00:01.760 ******** 

TASK [bootstrap-os : Fetch /etc/os-release] ************************************
fatal: [master01]: FAILED! => {"msg": "Missing sudo password"}
fatal: [worker01]: FAILED! => {"msg": "Missing sudo password"}
fatal: [worker02]: FAILED! => {"msg": "Missing sudo password"}
fatal: [master02]: FAILED! => {"msg": "Missing sudo password"}
fatal: [master03]: FAILED! => {"msg": "Missing sudo password"}
fatal: [worker03]: FAILED! => {"msg": "Missing sudo password"}
fatal: [worker04]: FAILED! => {"msg": "Missing sudo password"}

NO MORE HOSTS LEFT *************************************************************

PLAY RECAP *********************************************************************
localhost                  : ok=3    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
master01                   : ok=1    changed=0    unreachable=0    failed=1    skipped=16   rescued=0    ignored=0   
master02                   : ok=1    changed=0    unreachable=0    failed=1    skipped=10   rescued=0    ignored=0   
master03                   : ok=1    changed=0    unreachable=0    failed=1    skipped=10   rescued=0    ignored=0   
worker01                   : ok=1    changed=0    unreachable=0    failed=1    skipped=10   rescued=0    ignored=0   
worker02                   : ok=1    changed=0    unreachable=0    failed=1    skipped=10   rescued=0    ignored=0   
worker03                   : ok=1    changed=0    unreachable=0    failed=1    skipped=10   rescued=0    ignored=0   
worker04                   : ok=1    changed=0    unreachable=0    failed=1    skipped=10   rescued=0    ignored=0   

Thursday 11 April 2024  14:23:48 +0900 (0:00:00.479)       0:00:02.240 ******** 
=============================================================================== 
bootstrap-os : Fetch /etc/os-release −−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−− 0.48s
download : Download | Download files / images −−−−−−−−−−−−−−−−−−−−−−−−−−- 0.30s
kubespray-defaults : Configure defaults −−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−- 0.14s
download : Prep_download | Parse the outputs of the previous commands −−- 0.12s
download : Download | Get kubeadm binary and list of required images −−−− 0.11s
download : Prep_download | Create staging directory on remote node −−−−−− 0.11s
kubespray-defaults : Set `etcd_deployment_type` to "kubeadm" if `etcd_kubeadm_enabled` is true −−- 0.11s
download : Prep_download | Register docker images info −−−−−−−−−−−−−−−−−− 0.10s
download : Prep_download | Check that local user is in group or can become root −−- 0.10s
download : Prep_download | Set a few facts −−−−−−−−−−−−−−−−−−−−−−−−−−−−−− 0.10s
Check that jinja is not too old (install via pip) −−−−−−−−−−−−−−−−−−−−−−- 0.09s
kubespray-defaults : Set fallback_ips −−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−- 0.08s
kubespray-defaults : Populates no_proxy to all hosts −−−−−−−−−−−−−−−−−−−− 0.08s
Check that python netaddr is installed −−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−− 0.07s
kubespray-defaults : Gather ansible_default_ipv4 from all hosts −−−−−−−−- 0.05s
download : Prep_download | On localhost, check if passwordless root is possible −−- 0.04s
download : Prep_download | Create local cache for files and images on control node −−- 0.04s
download : Prep_download | On localhost, check if user has access to the container runtime without using sudo −−- 0.03s
Check 2.14.0 <= Ansible version < 2.15.0 −−−−−−−−−−−−−−−−−−−−−−−−−−−−−−−− 0.03s
kubespray-defaults : Set no_proxy to all assigned cluster IPs and hostnames −−- 0.02s