From DElder at novacoast.com Mon Oct 2 22:00:29 2017 From: DElder at novacoast.com (Dan Elder) Date: Tue, 3 Oct 2017 04:00:29 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <1506524690.17636.76.camel@suse.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> Message-ID: <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: caasp-cli.txt URL: From rob.decanha-knight at suse.com Tue Oct 3 07:56:08 2017 From: rob.decanha-knight at suse.com (Rob de Canha-Knight) Date: Tue, 3 Oct 2017 13:56:08 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> Message-ID: <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [005168] [cid:image002.png at 01D33C57.BDEACF60] [cid:image003.png at 01D33C57.BDEACF60] [cid:image004.png at 01D33C57.BDEACF60] [cid:image005.png at 01D33C57.BDEACF60] [cid:image006.png at 01D33C57.BDEACF60] [cid:image007.png at 01D33C57.BDEACF60] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2957 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1200 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 790 bytes Desc: image003.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 764 bytes Desc: image004.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 756 bytes Desc: image005.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 944 bytes Desc: image006.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 802 bytes Desc: image007.png URL: From rob.decanha-knight at suse.com Tue Oct 3 09:05:23 2017 From: rob.decanha-knight at suse.com (Rob de Canha-Knight) Date: Tue, 3 Oct 2017 15:05:23 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> Message-ID: <61D5C7DA-74B8-4774-8059-7F0D099B8E07@suse.com> Hi Dan. My apologies but the port I previously gave is incorrect. The login string should look like: caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob at suse.com -p password So port 6443. Please also make sure you?re using the master nodes full fqdn that you inputted during the velum setup phase as well. ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [005168] [cid:image002.png at 01D33C61.6A46DE80] [cid:image003.png at 01D33C61.6A46DE80] [cid:image004.png at 01D33C61.6A46DE80] [cid:image005.png at 01D33C61.6A46DE80] [cid:image006.png at 01D33C61.6A46DE80] [cid:image007.png at 01D33C61.6A46DE80] From: on behalf of Rob de Canha-Knight Date: Tuesday, 3 October 2017 at 14:58 To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [05168] [cid:image009.png at 01D33C61.6A46DE80] [cid:image010.png at 01D33C61.6A46DE80] [cid:image011.png at 01D33C61.6A46DE80] [cid:image012.png at 01D33C61.6A46DE80] [cid:image013.png at 01D33C61.6A46DE80] [cid:image014.png at 01D33C61.6A46DE80] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2957 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1200 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 790 bytes Desc: image003.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 764 bytes Desc: image004.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 756 bytes Desc: image005.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 944 bytes Desc: image006.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 802 bytes Desc: image007.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image008.png Type: image/png Size: 2958 bytes Desc: image008.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.png Type: image/png Size: 1201 bytes Desc: image009.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image010.png Type: image/png Size: 791 bytes Desc: image010.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image011.png Type: image/png Size: 765 bytes Desc: image011.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image012.png Type: image/png Size: 757 bytes Desc: image012.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image013.png Type: image/png Size: 945 bytes Desc: image013.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image014.png Type: image/png Size: 803 bytes Desc: image014.png URL: From rushi.ns at sap.com Tue Oct 3 09:07:16 2017 From: rushi.ns at sap.com (Ns, Rushi) Date: Tue, 3 Oct 2017 15:07:16 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> Message-ID: Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [05168] [cid:image002.png at 01D33C1E.A22E8700] [cid:image003.png at 01D33C1E.A22E8700] [cid:image004.png at 01D33C1E.A22E8700] [cid:image005.png at 01D33C1E.A22E8700] [cid:image006.png at 01D33C1E.A22E8700] [cid:image007.png at 01D33C1E.A22E8700] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2958 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1201 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 791 bytes Desc: image003.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 765 bytes Desc: image004.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 757 bytes Desc: image005.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 945 bytes Desc: image006.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 803 bytes Desc: image007.png URL: From rob.decanha-knight at suse.com Tue Oct 3 09:17:57 2017 From: rob.decanha-knight at suse.com (Rob de Canha-Knight) Date: Tue, 3 Oct 2017 15:17:57 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> Message-ID: Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [005168] [cid:image002.png at 01D33C63.2B67FB20] [cid:image003.png at 01D33C63.2B67FB20] [cid:image004.png at 01D33C63.2B67FB20] [cid:image005.png at 01D33C63.2B67FB20] [cid:image006.png at 01D33C63.2B67FB20] [cid:image007.png at 01D33C63.2B67FB20] From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [5168] [cid:image009.png at 01D33C63.2B67FB20] [cid:image010.png at 01D33C63.2B67FB20] [cid:image011.png at 01D33C63.2B67FB20] [cid:image012.png at 01D33C63.2B67FB20] [cid:image013.png at 01D33C63.2B67FB20] [cid:image014.png at 01D33C63.2B67FB20] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2957 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1200 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 790 bytes Desc: image003.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 764 bytes Desc: image004.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 756 bytes Desc: image005.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 944 bytes Desc: image006.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 802 bytes Desc: image007.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image008.png Type: image/png Size: 2959 bytes Desc: image008.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.png Type: image/png Size: 1202 bytes Desc: image009.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image010.png Type: image/png Size: 792 bytes Desc: image010.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image011.png Type: image/png Size: 766 bytes Desc: image011.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image012.png Type: image/png Size: 758 bytes Desc: image012.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image013.png Type: image/png Size: 946 bytes Desc: image013.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image014.png Type: image/png Size: 804 bytes Desc: image014.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Documentation_RBAC_RBAC-LoggingIn.pdf Type: application/pdf Size: 122165 bytes Desc: Documentation_RBAC_RBAC-LoggingIn.pdf URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Documentation_RBAC_RBAC-AdminHowto.pdf Type: application/pdf Size: 171023 bytes Desc: Documentation_RBAC_RBAC-AdminHowto.pdf URL: From DElder at novacoast.com Tue Oct 3 09:52:57 2017 From: DElder at novacoast.com (Dan Elder) Date: Tue, 3 Oct 2017 15:52:57 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <61D5C7DA-74B8-4774-8059-7F0D099B8E07@suse.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <61D5C7DA-74B8-4774-8059-7F0D099B8E07@suse.com> Message-ID: <0c0e8b87-c92c-eeae-64ea-ce8779d0bcde@novacoast.com> Hi Rob, I apologize, my naming conventions are a little different so for clarification purposes: caasp-controller.suserd.com -> admin (Velum) node caasp-admin.suserd.com -> k8 master node caasp-worker1.suserd.com -> k8 worker node caasp-worker2.suserd.com -> k8 worker node In my case, caasp-admin.suserd.com is the master node (I'll cleanup the names in the future). I've tried using caasp-cli on an OpenSUSE Leap 42.3 (caasp-cli-0.0.1+20170929.git_r32_b195256-1.1.x86_64) and the k8 master (caasp-cli-0.0.1+20170914.git_r18_acbee3b-1.2.x86_64) but get the same result. The only system listening on 6443 in my environment is the k8 master (caasp-admin.suserd.com). The nodes themselves are assigned addresses and hostnames from the DHCP server and all entries are also in DNS. Time is in sync across the nodes. I don't see anything obvious in any of the logs on the k8 master but any pointers on what I should be looking for would be helpful. Thanks, Dan On 10/03/2017 08:05 AM, Rob de Canha-Knight wrote: Hi Dan. My apologies but the port I previously gave is incorrect. The login string should look like: caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob at suse.com -p password So port 6443. Please also make sure you?re using the master nodes full fqdn that you inputted during the velum setup phase as well. ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [005168] [cid:part4.714502EC.5AADC203 at novacoast.com] [cid:part5.842FE9DB.80951553 at novacoast.com] [cid:part7.F607605D.3B851C1C at novacoast.com] [cid:part9.990F13B7.D6C7161C at novacoast.com] [cid:part11.EC41E238.27F56FAE at novacoast.com] [cid:part13.FCB4F465.A70B313C at novacoast.com] From: on behalf of Rob de Canha-Knight Date: Tuesday, 3 October 2017 at 14:58 To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [05168] [cid:part19.B071E236.E51BA630 at novacoast.com] [cid:part20.36AA1A29.2A18AF08 at novacoast.com] [cid:part22.2C336149.D98F4C92 at novacoast.com] [cid:part24.66A991B7.C5771134 at novacoast.com] [cid:part26.40204B51.02A8D9DB at novacoast.com] [cid:part28.E493266E.994C27B6 at novacoast.com] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2957 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1200 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 790 bytes Desc: image003.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 764 bytes Desc: image004.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 756 bytes Desc: image005.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 944 bytes Desc: image006.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 802 bytes Desc: image007.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image008.png Type: image/png Size: 2958 bytes Desc: image008.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.png Type: image/png Size: 1201 bytes Desc: image009.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image010.png Type: image/png Size: 791 bytes Desc: image010.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image011.png Type: image/png Size: 765 bytes Desc: image011.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image012.png Type: image/png Size: 757 bytes Desc: image012.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image013.png Type: image/png Size: 945 bytes Desc: image013.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image014.png Type: image/png Size: 803 bytes Desc: image014.png URL: From paul.gonin at suse.com Tue Oct 3 09:55:33 2017 From: paul.gonin at suse.com (Paul Gonin) Date: Tue, 03 Oct 2017 17:55:33 +0200 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> Message-ID: <1507046133.22040.5.camel@suse.com> Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgdsPaul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : > Rushi. > > > The details I provided below on caasp-cli is how I?ve been using > caasp-cli since day one. > > I?ve just tried again on a new cluster and running > > > caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u > rob.decanha-knight at suse.com -p mypassword > > Where ?u is the email address of the user I created during velum > first startup/login. > > Worked fine for me. > > I don?t have any other documents to hand (other than the attached) > around logging in so all I can personally suggest is to make sure > you?re using https and port 6443 of the kubernetes master > after -s. > > I?ve also attached the main bit of documentation we have around the > caasp-cli client (which will make it?s way into the version 2 final > release). > > > I would suggest trying again from scratch with a new cluster instance > of RC1 (including downloading and installing the updated caasp-cli > client available from > https://github.com/kubic-project/caasp-cli/releases as this one is > working fine for me). > Make a note of every command you are running and the output it > provides and you can send those details to this list as at the moment > the information in the thread is a bit scattered and I can?t tell > accurately what?s going on or what?s > being done by the user. > > Yes there are a lot of changes in this release mainly an updated k8s > version and a feature much requested by customers (I remember during > 1.0 betas you also requested for user management and this is how > we?ve implemented it). I?ve also > attached the details on how to create/manage additional user > accounts through ldap as well as the caasp-cli guidance that we have. > > As one of our closest partners you also have the option of reaching > out to your partner sales engineer/rep for your region and discussing > it directly with them. They should be able to go onsite and help you > if asked to get things up and > running for your team. > > All the best, > Rob > > > ---- > Rob de Canha-Knight > > EMEA Platform and Management Technical Strategist > > SUSE > > rob.decanha-knight at suse.com > (Fuze/VOIP) +44 (0) 1635 937689 > > (M) +44 (0) 7392 087303 > (TW) > rssfed23 > ---- > > > > > > > > From: "Ns, Rushi" > > Date: Tuesday, 3 October 2017 at 16:07 > > To: "caasp-beta at lists.suse.com" , Dan > Elder , Rob de Canha-Knight @suse.com> > > Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires > username and password > > > > > Hi Rob, > > Whatever you have mentioned is not really working in reality. Using > CAASP-cli is not at all authenticating and I spent 2 days to find a > way to connect to cluster. > > > VELUM is fine, I can logon with registed email but nothing can be > done after that such as installing kubernetes dashboard is not ? > first of all need to know how to connect with CAASP-CLI because there > is no users created other than VELUM web login which was > registered. > > Can you provide some steps how you have doing with caasp-cli..i see > lot of things changed on this new release. > > > > > Best Regards, > > Rushi. > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A > DIFFERENCE > > > > > From: on behalf of Rob de Canha- > Knight > > Date: Tuesday, October 3, 2017 at 6:57 AM > > To: Dan Elder , "caasp-beta at lists.suse.com" asp-beta at lists.suse.com> > > Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires > username and password > > > > > Hi Dan. > > In the log you?ve provided you?re using the admin server for the ?s > argument I believe. > > You must use https://:8443 as the address for the > k8s master node (noting correct port and https). > > Please let us know how you get on. > > Rob > > > > > ---- > Rob de Canha-Knight > > EMEA Platform and Management Technical Strategist > > SUSE > > rob.decanha-knight at suse.com > (Fuze/VOIP) +44 (0) 1635 937689 > > (M) +44 (0) 7392 087303 > (TW) > rssfed23 > ---- > > > > > > > > From: on behalf of Dan Elder der at novacoast.com> > > Date: Tuesday, 3 October 2017 at 05:15 > > To: "caasp-beta at lists.suse.com" > > Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires > username and password > > > > > > I haven't had any luck authentication with caasp-cli unfortunately. > The credentials I supply work fine for Velum but caasp-cli says > they're invalid (output attached). Is there some log I can pull from > the admin node or somewhere else to troubleshoot this? > I've done 2 installs and gotten the same result both times. > Thanks, > > Dan > > > On 09/27/2017 08:04 AM, Paul Gonin wrote: > > > Hi, > > > > > > > > > > > > It should be on the media so you can install it on the admin node > > > > > > It is installed by default on admin node. > > > > > > > > > > > > You can also get (currently) rpms for different openSUSE/SUSE > > flavors > > > > > > https://build.opensuse.org/repositories/devel:CaaSP:Head:Controller > > Node/caasp-cli > > > > > > > > > > > > And there is also a windows Build from Rob > > > > > > https://github.com/rssfed23/caasp-cli-windows/releases > > > > > > > > > > > > Tested / works but not supported (yet, but I assume to come) > > > > > > > > > > > > > > > > > > Once you have caasp-cli > > > > > > > > export KUBECONFIG= (set KUBECONFIG=kubeconfig in > > windows cmd shell) > > > > > > caasp-cli login -u caasp-user -p caasp-password -s > > https://caasp.fqdn:6443 > > > > > > > > > > > > and then you can use kubectl as previously > > > > > > > > > > > > For caasp-user and caasp-password you can use caasp admin > > credentials. > > > > > > You can also create users in local ldap > > > > > > > > > > > > rgds > > > > > > Paul > > > > > > > > > > > > > > Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : > > > > > Thanks, where can I download . I see from github I can?t download > > > the link . > > > > > > https://github.com/kubic-project/caasp-cli > > > > > > > > > > > > Best Regards, > > > > > > Rushi. > > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A > > > DIFFERENCE > > > > > > > > > > > > > > > From: Paul Gonin > > > > > > > > > Date: Tuesday, September 26, 2017 at 1:31 PM > > > > > > To: "caasp-beta at lists.suse.com" > > > , Rushi NS > > > > > > > > > Subject: RE : [caasp-beta] kubectl requires username and password > > > > > > > > > > > > > > > Hi, > > > > > > > > > > > > > > > With RC1, RBAC is available > > > > > > > > > Consequence is that you have to use caasp-ctl to login to CaaSP > > > and modify your kubectl and inject credentials in it. > > > > > > > > > > > > > > > > > > Rgds > > > > > > > > > Paul > > > > > > > > > > > > > > > > > > > > > > > > > > > -------- Message d'origine -------- > > > > > > > > > De : "Ns, Rushi" > > > > > > > > > > > > Date : 26/09/2017 22:04 (GMT+01:00) > > > > > > > > > ? : SUSE Beta Program > > > , caasp-beta at lists.suse.com > > > > > > > > > > > > Objet : [caasp-beta] kubectl requires username and password > > > > > > > > > > > > > > > > > > > > > > > > >>> "Ns, Rushi" 09/26/2017 21:04 >>> > > > > > > Hi > > > > > > I setup new cluster with this release and everything worked. I > > > have 3 masters/10 workers ..looks fine VELUM web page as well and > > > I have downloaded kubeconfig and tried to do some workload test > > > but issue with > > > access cluster. > > > > > > > > > I have issue with using KUBECTL command line ..whatever ?kubectl? > > > I run requires permission. I setup velum with my userid email > > > and password, I thought it requires that and I tried but its not > > > ? > > > > > > > > > I have also tried root (linux) master/workers but it doesn?t take > > > that too? > > > > > > > > > Does anyone know what is the issue. > > > > > > > > > kubectl get cluster-info > > > > > > > > > kubectl get nodes > > > Please enter Username: > > > rushi.ns at sap.com > > > Please enter Password: ********* > > > Error from server (Forbidden): > > > User "system:anonymous" cannot list nodes at the cluster scope. > > > (get nodes) > > > > > > kubectl get nodes > > > Please enter Username: admin > > > Please enter Password: ******** > > > Unable to connect to the server: > > > x509: certificate is valid for 172.24.0.1, 172.16.18.0, > > > 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 > > > > > > kubectl get nodes > > > Please enter Username: root > > > Please enter Password: ******** > > > Unable to connect to the server: > > > x509: certificate is valid for 172.24.0.1, 172.16.22.0, > > > 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 > > > > > > Best Regards, > > > > > > Rushi. > > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A > > > DIFFERENCE > > > > > > > > > > > > > > > From: on behalf of SUSE Beta > > > Program > > > > > > > > > Reply-To: SUSE Beta Program > > > > > > > > > Date: Friday, September 22, 2017 at 7:48 AM > > > > > > To: "caasp-beta at lists.suse.com" > > > > > > > > > Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service > > > Platform 2 RC 1 is available! > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Having trouble viewing this email? Please check the plain text > > > version of it with your mailer. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > We are happy to announce > > > SUSE CaaS Platform 2 > > > Release Candidate 1! > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Download > > > ? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Please check out our dedicated > > > SUSE CaaS Platform Beta web page, where you will find all the > > > information needed around SUSE CaaS Platform Beta. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > What?s New with SUSE CaaS Platform 2 RC 1? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > K8s Multi-Master: Kubernetes Multi Master for building High- > > > Availability clusters. > > > > > > caasp-cli: It's the new command line client for interacting with > > > a CaaS Platform cluster. > > > See for details. > > > > > > Dex: Dex is an identity service that uses OpenID Connect to drive > > > authentication for other > > > apps. See for details. > > > > > > OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Things to consider for this Beta? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > DHCP > > > > > > > > > Your DHCP server should provide resolveable hostnames. If this is > > > not the case like with libvirt/KVM, you should consider providing > > > one yourself by appending this kernel parameter > > > "hostname=HOSTNAME" during installation. > > > > > > However, the kubeconfig file downloaded from the Dashboard could > > > contain an incorrect "server" hostname that should be replaced > > > with the IP address of your Master. For more information > > > read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration > > > > > > > > > Autoyast/VMX-Images > > > > > > > > > If you install via autoyast or one of the provided VMX beta > > > images (KVM,Xen,VMware,...) please set a password or SSH key via > > > cloud-init to be able to login. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Release > > > plan ? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Release > > > Notes ? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Documentation > > > ? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Have fun beta testing! > > > > > > Your SUSE Linux Enterprise Team > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Please refer to our dedicated > > > SUSE CaaSP Beta Program webpage for any general information. > > > However, do not hesitate to contact us at > > > beta-programs at lists.suse.com if you have any questions. > > > You received this email because you're signed up to get updates > > > from us. > > > > > > Click here to unsubscribe. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > caasp-beta mailing list > > > caasp-beta at lists.suse.com > > > http://lists.suse.com/mailman/listinfo/caasp-beta > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > caasp-beta mailing list > > caasp-beta at lists.suse.com > > http://lists.suse.com/mailman/listinfo/caasp-beta > > > -- > Senior Engineer > Linux Services Manager > Novacoast, Inc. > Mobile: (310) 243-6971 > Office: (800) 949-9933 x1337 > http://www.novacoast.com/ > > > > > _______________________________________________ > caasp-beta mailing list > caasp-beta at lists.suse.com > http://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image014.png Type: image/png Size: 804 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image013.png Type: image/png Size: 946 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image012.png Type: image/png Size: 758 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image011.png Type: image/png Size: 766 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image010.png Type: image/png Size: 792 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.png Type: image/png Size: 1202 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image008.png Type: image/png Size: 2959 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 802 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 944 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 756 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 764 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 790 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1200 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2957 bytes Desc: not available URL: From rushi.ns at sap.com Tue Oct 3 12:15:53 2017 From: rushi.ns at sap.com (Ns, Rushi) Date: Tue, 3 Oct 2017 18:15:53 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <1507046133.22040.5.camel@suse.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> Message-ID: <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [05168] [cid:image002.png at 01D33C38.FB83A460] [cid:image003.png at 01D33C38.FB83A460] [cid:image004.png at 01D33C38.FB83A460] [cid:image005.png at 01D33C38.FB83A460] [cid:image006.png at 01D33C38.FB83A460] [cid:image007.png at 01D33C38.FB83A460] From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [168] [cid:image009.png at 01D33C38.FB83A460] [cid:image010.png at 01D33C38.FB83A460] [cid:image011.png at 01D33C38.FB83A460] [cid:image012.png at 01D33C38.FB83A460] [cid:image013.png at 01D33C38.FB83A460] [cid:image014.png at 01D33C38.FB83A460] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2958 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1201 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 791 bytes Desc: image003.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 765 bytes Desc: image004.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 757 bytes Desc: image005.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 945 bytes Desc: image006.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 803 bytes Desc: image007.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image008.png Type: image/png Size: 2960 bytes Desc: image008.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.png Type: image/png Size: 1203 bytes Desc: image009.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image010.png Type: image/png Size: 793 bytes Desc: image010.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image011.png Type: image/png Size: 767 bytes Desc: image011.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image012.png Type: image/png Size: 759 bytes Desc: image012.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image013.png Type: image/png Size: 947 bytes Desc: image013.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image014.png Type: image/png Size: 805 bytes Desc: image014.png URL: From rushi.ns at sap.com Tue Oct 3 12:29:47 2017 From: rushi.ns at sap.com (Ns, Rushi) Date: Tue, 3 Oct 2017 18:29:47 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> Message-ID: <30EE7D5E-4A26-4F76-9D3C-9A971734F479@sap.com> Hi Paul, Is this DEX (openID connect provider) required for CAASP to use the client authentication https://github.com/coreos/dex Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rushi NS Date: Tuesday, October 3, 2017 at 11:16 AM To: Paul Gonin , Rob de Canha-Knight , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [5168] [cid:image002.png at 01D33C3A.ED1C2210] [cid:image003.png at 01D33C3A.ED1C2210] [cid:image004.png at 01D33C3A.ED1C2210] [cid:image005.png at 01D33C3A.ED1C2210] [cid:image006.png at 01D33C3A.ED1C2210] [cid:image007.png at 01D33C3A.ED1C2210] From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [68] [cid:image009.png at 01D33C3A.ED1C2210] [cid:image010.png at 01D33C3A.ED1C2210] [cid:image011.png at 01D33C3A.ED1C2210] [cid:image012.png at 01D33C3A.ED1C2210] [cid:image013.png at 01D33C3A.ED1C2210] [cid:image014.png at 01D33C3A.ED1C2210] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2959 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1202 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 792 bytes Desc: image003.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 766 bytes Desc: image004.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 758 bytes Desc: image005.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 946 bytes Desc: image006.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 804 bytes Desc: image007.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image008.png Type: image/png Size: 2961 bytes Desc: image008.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.png Type: image/png Size: 1204 bytes Desc: image009.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image010.png Type: image/png Size: 794 bytes Desc: image010.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image011.png Type: image/png Size: 768 bytes Desc: image011.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image012.png Type: image/png Size: 760 bytes Desc: image012.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image013.png Type: image/png Size: 948 bytes Desc: image013.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image014.png Type: image/png Size: 806 bytes Desc: image014.png URL: From rob.decanha-knight at suse.com Tue Oct 3 12:32:11 2017 From: rob.decanha-knight at suse.com (Rob de Canha-Knight) Date: Tue, 3 Oct 2017 18:32:11 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <30EE7D5E-4A26-4F76-9D3C-9A971734F479@sap.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> <30EE7D5E-4A26-4F76-9D3C-9A971734F479@sap.com> Message-ID: Hi Rushi. Yes we are using CoreOS Dex to do the openldap > OpenID translation. But you don?t need to set up Dex ? CaaSP does that for you after the cluster has bootstrapped (although it may take a couple of minutes for the Dex pods to start). It may be best if you log a bug for this in the public Bugzilla we have attaching all the details and steps you have provided so far so the developers can take a look into it for you. ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [005168] [cid:image002.png at 01D33C7E.4D6002C0] [cid:image003.png at 01D33C7E.4D6002C0] [cid:image004.png at 01D33C7E.4D6002C0] [cid:image005.png at 01D33C7E.4D6002C0] [cid:image006.png at 01D33C7E.4D6002C0] [cid:image007.png at 01D33C7E.4D6002C0] From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 19:30 To: "caasp-beta at lists.suse.com" , Dan Elder , Paul Gonin , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Paul, Is this DEX (openID connect provider) required for CAASP to use the client authentication https://github.com/coreos/dex Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rushi NS Date: Tuesday, October 3, 2017 at 11:16 AM To: Paul Gonin , Rob de Canha-Knight , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [168] [cid:image009.png at 01D33C7E.4D6002C0] [cid:image010.png at 01D33C7E.4D6002C0] [cid:image011.png at 01D33C7E.4D6002C0] [cid:image012.png at 01D33C7E.4D6002C0] [cid:image013.png at 01D33C7E.4D6002C0] [cid:image014.png at 01D33C7E.4D6002C0] From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [8] [cid:image016.png at 01D33C7E.4D6002C0] [cid:image017.png at 01D33C7E.4D6002C0] [cid:image018.png at 01D33C7E.4D6002C0] [cid:image019.png at 01D33C7E.4D6002C0] [cid:image020.png at 01D33C7E.4D6002C0] [cid:image021.png at 01D33C7E.4D6002C0] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2957 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1200 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 790 bytes Desc: image003.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 764 bytes Desc: image004.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 756 bytes Desc: image005.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 944 bytes Desc: image006.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 802 bytes Desc: image007.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image008.png Type: image/png Size: 2960 bytes Desc: image008.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.png Type: image/png Size: 1203 bytes Desc: image009.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image010.png Type: image/png Size: 793 bytes Desc: image010.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image011.png Type: image/png Size: 767 bytes Desc: image011.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image012.png Type: image/png Size: 759 bytes Desc: image012.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image013.png Type: image/png Size: 947 bytes Desc: image013.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image014.png Type: image/png Size: 805 bytes Desc: image014.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image015.png Type: image/png Size: 2962 bytes Desc: image015.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image016.png Type: image/png Size: 1205 bytes Desc: image016.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image017.png Type: image/png Size: 795 bytes Desc: image017.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image018.png Type: image/png Size: 769 bytes Desc: image018.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image019.png Type: image/png Size: 761 bytes Desc: image019.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image020.png Type: image/png Size: 949 bytes Desc: image020.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image021.png Type: image/png Size: 807 bytes Desc: image021.png URL: From rushi.ns at sap.com Tue Oct 3 12:45:06 2017 From: rushi.ns at sap.com (Ns, Rushi) Date: Tue, 3 Oct 2017 18:45:06 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> Message-ID: <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> Hi Robert, I don?t think bootstrap failed as the cluster completed without any errors and VELUM shows all active. Also on the master node, I see that dex.yaml and roles.yaml which all exist but not sure if the PODS running .. In a worst case I will try to rebuild the cluster to see if it works. By the way , in which node the DEX was running, I checked all my ndoes and I can?t find DEX running as POD ? lvsusekub5:~ # ls -ltr total 16 drwxr-xr-x 1 root root 0 Jun 27 08:59 bin drwxr-xr-x 1 root root 36 Sep 26 02:13 inst-sys -rw-r--r-- 1 root root 156 Sep 26 04:18 flannel-config.json -rw-r--r-- 1 root root 3034 Sep 26 04:19 dex.yaml -rw-r--r-- 1 root root 1161 Sep 26 04:19 roles.yaml -rw-r--r-- 1 root root 3295 Oct 3 18:37 kubeconfig [cid:image001.png at 01D33C3D.0FA157E0] Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Robert Roland Date: Tuesday, October 3, 2017 at 11:38 AM To: "caasp-beta at lists.suse.com" , "DElder at novacoast.com" , Rushi NS , Paul Gonin , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password That "Forbidden" error implies that your cluster bootstrap didn't complete successfully. Please submit a bug with a full supportconfig dump. Dex is set up by the bootstrap process. This error means that one of the steps in setting up Dex failed. Thanks, Rob >>> "Ns, Rushi" 10/03/17 11:16 AM >>> Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [5168] [cid:image003.png at 01D33C3D.0FA157E0] [cid:image004.png at 01D33C3D.0FA157E0] [cid:image005.png at 01D33C3D.0FA157E0] [cid:image006.png at 01D33C3D.0FA157E0] [cid:image007.png at 01D33C3D.0FA157E0] [cid:image008.png at 01D33C3D.0FA157E0] From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [68] [cid:image010.png at 01D33C3D.0FA157E0] [cid:image011.png at 01D33C3D.0FA157E0] [cid:image012.png at 01D33C3D.0FA157E0] [cid:image013.png at 01D33C3D.0FA157E0] [cid:image014.png at 01D33C3D.0FA157E0] [cid:image015.png at 01D33C3D.0FA157E0] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 119301 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 2959 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 1202 bytes Desc: image003.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 792 bytes Desc: image004.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 766 bytes Desc: image005.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 758 bytes Desc: image006.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 946 bytes Desc: image007.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image008.png Type: image/png Size: 804 bytes Desc: image008.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.png Type: image/png Size: 2961 bytes Desc: image009.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image010.png Type: image/png Size: 1204 bytes Desc: image010.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image011.png Type: image/png Size: 794 bytes Desc: image011.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image012.png Type: image/png Size: 768 bytes Desc: image012.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image013.png Type: image/png Size: 760 bytes Desc: image013.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image014.png Type: image/png Size: 948 bytes Desc: image014.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image015.png Type: image/png Size: 806 bytes Desc: image015.png URL: From Liam.McCafferty at smartodds.co.uk Tue Oct 3 13:24:16 2017 From: Liam.McCafferty at smartodds.co.uk (Liam McCafferty) Date: Tue, 3 Oct 2017 19:24:16 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> Message-ID: <15a292e8-5d12-40bc-9287-c34a0c3bceb5@smartodds.co.uk> If I remember correctly dex runs on the cassp admin node. Any luck finding it there? Sent from Blue On 3 Oct 2017, at 7:45 pm, "Ns, Rushi" > wrote: Hi Robert, I don?t think bootstrap failed as the cluster completed without any errors and VELUM shows all active. Also on the master node, I see that dex.yaml and roles.yaml which all exist but not sure if the PODS running .. In a worst case I will try to rebuild the cluster to see if it works. By the way , in which node the DEX was running, I checked all my ndoes and I can?t find DEX running as POD ? lvsusekub5:~ # ls -ltr total 16 drwxr-xr-x 1 root root 0 Jun 27 08:59 bin drwxr-xr-x 1 root root 36 Sep 26 02:13 inst-sys -rw-r--r-- 1 root root 156 Sep 26 04:18 flannel-config.json -rw-r--r-- 1 root root 3034 Sep 26 04:19 dex.yaml -rw-r--r-- 1 root root 1161 Sep 26 04:19 roles.yaml -rw-r--r-- 1 root root 3295 Oct 3 18:37 kubeconfig [cid:image001.png at 01D33C3D.0FA157E0] Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Robert Roland Date: Tuesday, October 3, 2017 at 11:38 AM To: "caasp-beta at lists.suse.com" , "DElder at novacoast.com" , Rushi NS , Paul Gonin , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password That "Forbidden" error implies that your cluster bootstrap didn't complete successfully. Please submit a bug with a full supportconfig dump. Dex is set up by the bootstrap process. This error means that one of the steps in setting up Dex failed. Thanks, Rob >>> "Ns, Rushi" 10/03/17 11:16 AM >>> Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [5168] [cid:image003.png at 01D33C3D.0FA157E0] [cid:image004.png at 01D33C3D.0FA157E0] [cid:image005.png at 01D33C3D.0FA157E0] [cid:image006.png at 01D33C3D.0FA157E0] [cid:image007.png at 01D33C3D.0FA157E0] [cid:image008.png at 01D33C3D.0FA157E0] From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [68] [cid:image010.png at 01D33C3D.0FA157E0] [cid:image011.png at 01D33C3D.0FA157E0] [cid:image012.png at 01D33C3D.0FA157E0] [cid:image013.png at 01D33C3D.0FA157E0] [cid:image014.png at 01D33C3D.0FA157E0] [cid:image015.png at 01D33C3D.0FA157E0] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL -------------- next part -------------- An HTML attachment was scrubbed... URL: From robert.roland at suse.com Tue Oct 3 13:24:45 2017 From: robert.roland at suse.com (Robert Roland) Date: Tue, 3 Oct 2017 12:24:45 -0700 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> Message-ID: <82770eab-e2e5-c86d-5f68-6d0853cbb2ca@suse.com> There will be three Dex pods, all spread out across the worker nodes. It certainly seems like your cluster installation failed, even if Velum didn't report that. From your master node, what is the output of: kubectl get pods --namespace=kube-system and: kubectl get roles --namespace=kube-system ??? - Rob On 10/03/2017 11:45 AM, Ns, Rushi wrote: > > Hi Robert, > > I don?t think bootstrap failed ?as the cluster completed without any > errors and VELUM shows all active. > > Also on the master node, I see that dex.yaml and roles.yaml which all > exist but not sure if the PODS running .. > > In a worst case I will try to rebuild the cluster to see if it works. > By the way , in which node the DEX was running, I checked all my ndoes > and I can?t find DEX running as POD ? > > lvsusekub5:~ #?? ls -ltr > > total 16 > > drwxr-xr-x 1 root root??? 0 Jun 27 08:59 bin > > drwxr-xr-x 1 root root?? 36 Sep 26 02:13 inst-sys > > -rw-r--r-- 1 root root? 156 Sep 26 04:18 flannel-config.json > > -rw-r--r-- 1 root root 3034 Sep 26 04:19 dex.yaml > > -rw-r--r-- 1 root root 1161 Sep 26 04:19 roles.yaml > > -rw-r--r-- 1 root root 3295 Oct? 3 18:37 kubeconfig > > Best Regards, > > Rushi. > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE > > *From: *Robert Roland > *Date: *Tuesday, October 3, 2017 at 11:38 AM > *To: *"caasp-beta at lists.suse.com" , > "DElder at novacoast.com" , Rushi NS > , Paul Gonin , Rob de Canha-Knight > > *Subject: *Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires > username and password > > That "Forbidden" error implies that your cluster bootstrap didn't > complete successfully. Please submit a bug with a full supportconfig dump. > > Dex is set up by the bootstrap process. This error means that one of > the steps in setting up Dex failed. > > Thanks, > > Rob > > > > >>> "Ns,?Rushi"? 10/03/17 11:16 AM >>> > > Hi Paul, > > Thank you . I have tried the same one with latest caasp-cli and the > result is same. ?FYI, I setup 3 masters with 6 workers and I tried all > 3 masters hostname one by one with the command line caasp-cli but > nothing is really working. > > Do I have to setup any DEX container on the cluster ? or it does > embedded part of it and why it is asking me DEX? > > caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx > > Error: unable to find Dex service in CaaS Platform cluster, error was > Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: > Forbidden > > Best Regards, > > Rushi. > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE > > *From: *Paul Gonin > *Date: *Tuesday, October 3, 2017 at 8:55 AM > *To: *Rob de Canha-Knight , Rushi NS > , "caasp-beta at lists.suse.com" > , Dan Elder > *Subject: *Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires > username and password > > Hi, > > You need to check that between master node and admin node the port 389 > is open - for example if you're using OpenStack you need the check > that the security group is properly defined to allow this port > > rgds > > Paul > > Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit?: > > Rushi. > > > The details I provided below on caasp-cli is how I?ve been using > caasp-cli since day one. > > I?ve just tried again on a new cluster and running > > caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u > rob.decanha-knight at suse.com -p mypassword > > Where ?u is the email address of the user I created during velum > first startup/login. > > Worked fine for me. > > I don?t have any other documents to hand (other than the attached) > around logging in so all I can personally suggest is to make sure > you?re using https and port 6443 of the*kubernetes master* after -s. > > I?ve also attached the main bit of documentation we have around > the caasp-cli client (which will make it?s way into the version 2 > final release). > > I would suggest trying again from scratch with a new cluster > instance of RC1 (including downloading and installing the updated > caasp-cli client available from > https://github.com/kubic-project/caasp-cli/releases as this one is > working fine for me). > > Make a note of every command you are running and the output it > provides and you can send those details to this list as at the > moment the information in the thread is a bit scattered and I > can?t tell accurately what?s going on or what?s being done by the > user. > > Yes there are a lot of changes in this release mainly an updated > k8s version and a feature much requested by customers (I remember > during 1.0 betas you also requested for user management and this > is how we?ve implemented it). I?ve also attached the details on > how to create/manage additional user accounts through ldap as well > as the caasp-cli guidance that we have. > > As one of our closest partners you also have the option of > reaching out to your partner sales engineer/rep for your region > and discussing it directly with them. They should be able to go > onsite and help you if asked to get things up and running for your > team. > > All the best, > > Rob > > ---- > > *Rob de Canha-Knight* > EMEA Platform and Management Technical Strategist > SUSE > rob.decanha-knight at suse.com > > (Fuze/VOIP) +44 (0) 1635 937689 > (M) +44 (0) 7392 087303 > > (TW) rssfed23 > > ---- > > 5168 > > > > *From: *"Ns, Rushi" > *Date: *Tuesday, 3 October 2017 at 16:07 > *To: *"caasp-beta at lists.suse.com" , Dan > Elder , Rob de Canha-Knight > > *Subject: *Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires > username and password > > Hi Rob, > > Whatever you have mentioned is not really working in reality. > Using CAASP-cli is not at all authenticating and I spent 2 days to > find a way to connect to cluster. > > > VELUM is fine, I can logon with registed email but nothing can be > done after that such as installing kubernetes dashboard is not? ? > first of all need to know how to connect with CAASP-CLI because > there is no users created other than VELUM web login which was > registered. > > Can you provide some steps how you have doing with caasp-cli..i > see lot of things changed on this new release. > > Best Regards, > > Rushi. > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A > DIFFERENCE > > *From: * on behalf of Rob de > Canha-Knight > *Date: *Tuesday, October 3, 2017 at 6:57 AM > *To: *Dan Elder , > "caasp-beta at lists.suse.com" > *Subject: *Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires > username and password > > Hi Dan. > > In the log you?ve provided you?re using the admin server for the > ?s argument I believe. > > You must use https://:8443 as the address for > the k8s master node (noting correct port and https). > > Please let us know how you get on. > > Rob > > ---- > > *Rob de Canha-Knight* > EMEA Platform and Management Technical Strategist > SUSE > rob.decanha-knight at suse.com > > (Fuze/VOIP) +44 (0) 1635 937689 > (M) +44 (0) 7392 087303 > > (TW) rssfed23 > > ---- > > 68 > > > > *From: * on behalf of Dan Elder > > *Date: *Tuesday, 3 October 2017 at 05:15 > *To: *"caasp-beta at lists.suse.com" > *Subject: *Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires > username and password > > I haven't had any luck authentication with caasp-cli > unfortunately.? The credentials I supply work fine for Velum but > caasp-cli says they're invalid (output attached).? Is there some > log I can pull from the admin node or somewhere else to > troubleshoot this?? I've done 2 installs and gotten the same > result both times. > > Thanks, > Dan > > > On 09/27/2017 08:04 AM, Paul Gonin wrote: > > Hi, > > It should be on the media so you can install it on the admin node > > It is installed by default on admin node. > > You can also get (currently) rpms for different openSUSE/SUSE > flavors > > https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli > > And there is also a windows Build from Rob > > https://github.com/rssfed23/caasp-cli-windows/releases > > Tested / works but not supported (yet, but I assume to come) > > Once you have caasp-cli > > export KUBECONFIG=(set KUBECONFIG=kubeconfig > in windows cmd shell) > > caasp-cli login -u caasp-user -p caasp-password -s > https://caasp.fqdn:6443 > > and then you can use kubectl as previously > > For caasp-user and caasp-password you can use caasp admin > credentials. > > You can also create users in local ldap > > rgds > > Paul > > Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit?: > > Thanks, where can I download . I see from github I can?t > download the link . > > https://github.com/kubic-project/caasp-cli > > Best Regards, > > Rushi. > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO > MAKES A DIFFERENCE > > *From: *Paul Gonin > *Date: *Tuesday, September 26, 2017 at 1:31 PM > *To: *"caasp-beta at lists.suse.com" > > > , Rushi NS > > *Subject: *RE : [caasp-beta] kubectl requires username and > password > > Hi, > > With RC1, RBAC is available > > Consequence is that you have to use caasp-ctl to login to > CaaSP and modify your kubectl and inject credentials in it. > > Rgds > > Paul > > -------- Message d'origine -------- > > De : "Ns, Rushi" > > Date : 26/09/2017 22:04 (GMT+01:00) > > ? : SUSE Beta Program > , > caasp-beta at lists.suse.com > > Objet : [caasp-beta] kubectl requires username and password > > > >>> "Ns, Rushi" 09/26/2017 21:04 >>> > > Hi > > I setup new cluster with this release and everything > worked. I have 3 masters/10 workers ..looks fine VELUM web > page as well and I have downloaded kubeconfig and tried to > do some workload test but issue with access cluster. > > I have issue with using KUBECTL command line ..whatever > ?kubectl? I run? requires permission. I setup velum with > my userid email and password, I thought it requires that > and I tried but its not ? > > I have also tried root (linux) master/workers but it > doesn?t take that too? > > Does anyone know what is the issue. > > kubectl get cluster-info > > kubectl get nodes > > Please enter Username: rushi.ns at sap.com > > > Please enter Password: ********* > > Error from server (Forbidden): User "system:anonymous" > cannot list nodes at the cluster scope. (get nodes) > > kubectl get nodes > > Please enter Username: admin > > Please enter Password: ******** > > Unable to connect to the server: x509: certificate is > valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, > 10.48.164.142, not 10.48.164.144 > > kubectl get nodes > > Please enter Username: root > > Please enter Password: ******** > > Unable to connect to the server: x509: certificate is > valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, > 10.48.164.141, not 10.48.164.144 > > Best Regards, > > Rushi. > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO > MAKES A DIFFERENCE > > *From: * > on behalf of > SUSE Beta Program > > *Reply-To: *SUSE Beta Program > > > *Date: *Friday, September 22, 2017 at 7:48 AM > *To: *"caasp-beta at lists.suse.com" > > > *Subject: *[caasp-beta] [ANNOUNCE] SUSE Container as a > Service Platform 2 RC 1 is available! > > Having trouble viewing this email? Please check the plain > text version of it with your mailer. > > > > > > > > > > We are happy to announce *SUSE CaaS Platform 2****Release > Candidate 1*! > > > > *Download ?* > > > > > Please check out our dedicated SUSE CaaS Platform Beta web > page , where > you will find all the information needed around SUSE CaaS > Platform Beta. > > > > > What?s New with SUSE CaaS Platform 2 RC 1? > > * *K8s Multi-Master*: Kubernetes Multi Master for > building High-Availability clusters. > * *caasp-cli*: It's the new command line client for > interacting with a CaaS Platform cluster. See for > details . > * *Dex*: Dex is an identity service that uses OpenID > Connect to drive authentication for other apps. See > for details . > * *OpenLDAP2*: OpenLDAP2 running on an SLE12 container > guest. > > > Things to consider for this Beta? > > * *DHCP* > > Your DHCP server should provide resolveable hostnames. If > this is not the case like with libvirt/KVM, you should > consider providing one yourself by appending this kernel > parameter "hostname=HOSTNAME" during installation. > > However, the kubeconfig file downloaded from the Dashboard > could contain an incorrect "server" hostname that should > be replaced with the IP address of your Master. For more > information read: > https://en.opensuse.org/SDB:Linuxrc#Network_Configuration > > * *Autoyast/VMX-Images* > > If you install via autoyast or one of the provided VMX > beta images (KVM,Xen,VMware,...) please set a password or > SSH key via cloud-init to be able to login. > > *Release plan ?* > > > > > *Release Notes ?* > > > > > *Documentation ?* > > > Have fun beta testing! > > Your SUSE Linux Enterprise Team > > Please refer to our dedicated SUSE CaaSP Beta Program > webpage for > any general information. However, do not hesitate to > contact us at beta-programs at lists.suse.com > if you have any > questions. > > You received this email because you're signed up to get > updates from us. Click here to unsubscribe. > > > _______________________________________________ > > caasp-beta mailing list > > caasp-beta at lists.suse.com > > http://lists.suse.com/mailman/listinfo/caasp-beta > > > > > > > _______________________________________________ > > caasp-beta mailing list > > caasp-beta at lists.suse.com > > http://lists.suse.com/mailman/listinfo/caasp-beta > > -- > > Senior Engineer > > Linux Services Manager > > Novacoast, Inc. > > Mobile: (310) 243-6971 > > Office: (800) 949-9933 x1337 > > http://www.novacoast.com/ > > _______________________________________________ > > caasp-beta mailing list > > caasp-beta at lists.suse.com > > http://lists.suse.com/mailman/listinfo/caasp-beta > > > > _______________________________________________ > caasp-beta mailing list > caasp-beta at lists.suse.com > http://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 119301 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 2959 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 1202 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 792 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 766 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 758 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 946 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image008.png Type: image/png Size: 804 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.png Type: image/png Size: 2961 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image010.png Type: image/png Size: 1204 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image011.png Type: image/png Size: 794 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image012.png Type: image/png Size: 768 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image013.png Type: image/png Size: 760 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image014.png Type: image/png Size: 948 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image015.png Type: image/png Size: 806 bytes Desc: not available URL: From Liam.McCafferty at smartodds.co.uk Tue Oct 3 13:26:35 2017 From: Liam.McCafferty at smartodds.co.uk (Liam McCafferty) Date: Tue, 3 Oct 2017 19:26:35 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <15a292e8-5d12-40bc-9287-c34a0c3bceb5@smartodds.co.uk> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> <15a292e8-5d12-40bc-9287-c34a0c3bceb5@smartodds.co.uk> Message-ID: <305a6eba-6d23-42b0-8e1e-995885077097@smartodds.co.uk> Actually I'm mistaken they run under the system namespace so -n kube-system should get you what you need Sent from Blue On 3 Oct 2017, at 8:24 pm, Liam McCafferty > wrote: If I remember correctly dex runs on the cassp admin node. Any luck finding it there? Sent from Blue On 3 Oct 2017, at 7:45 pm, "Ns, Rushi" < rushi.ns at sap.com> wrote: Hi Robert, I don?t think bootstrap failed as the cluster completed without any errors and VELUM shows all active. Also on the master node, I see that dex.yaml and roles.yaml which all exist but not sure if the PODS running .. In a worst case I will try to rebuild the cluster to see if it works. By the way , in which node the DEX was running, I checked all my ndoes and I can?t find DEX running as POD ? lvsusekub5:~ # ls -ltr total 16 drwxr-xr-x 1 root root 0 Jun 27 08:59 bin drwxr-xr-x 1 root root 36 Sep 26 02:13 inst-sys -rw-r--r-- 1 root root 156 Sep 26 04:18 flannel-config.json -rw-r--r-- 1 root root 3034 Sep 26 04:19 dex.yaml -rw-r--r-- 1 root root 1161 Sep 26 04:19 roles.yaml -rw-r--r-- 1 root root 3295 Oct 3 18:37 kubeconfig [cid:image001.png at 01D33C3D.0FA157E0] Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Robert Roland Date: Tuesday, October 3, 2017 at 11:38 AM To: "caasp-beta at lists.suse.com" , "DElder at novacoast.com" , Rushi NS , Paul Gonin , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password That "Forbidden" error implies that your cluster bootstrap didn't complete successfully. Please submit a bug with a full supportconfig dump. Dex is set up by the bootstrap process. This error means that one of the steps in setting up Dex failed. Thanks, Rob >>> "Ns, Rushi" 10/03/17 11:16 AM >>> Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [5168] [cid:image003.png at 01D33C3D.0FA157E0] [cid:image004.png at 01D33C3D.0FA157E0] [cid:image005.png at 01D33C3D.0FA157E0] [cid:image006.png at 01D33C3D.0FA157E0] [cid:image007.png at 01D33C3D.0FA157E0] [cid:image008.png at 01D33C3D.0FA157E0] From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [68] [cid:image010.png at 01D33C3D.0FA157E0] [cid:image011.png at 01D33C3D.0FA157E0] [cid:image012.png at 01D33C3D.0FA157E0] [cid:image013.png at 01D33C3D.0FA157E0] [cid:image014.png at 01D33C3D.0FA157E0] [cid:image015.png at 01D33C3D.0FA157E0] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL -------------- next part -------------- An HTML attachment was scrubbed... URL: From rushi.ns at sap.com Tue Oct 3 13:28:52 2017 From: rushi.ns at sap.com (Ns, Rushi) Date: Tue, 3 Oct 2017 19:28:52 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <305a6eba-6d23-42b0-8e1e-995885077097@smartodds.co.uk> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> <15a292e8-5d12-40bc-9287-c34a0c3bceb5@smartodds.co.uk> <305a6eba-6d23-42b0-8e1e-995885077097@smartodds.co.uk> Message-ID: <9CB51FD7-D00E-455F-A047-F753D3A282AD@sap.com> I searched everynode and nothing found , I?m going to rebuild it to see if anything can make difference. Keep you posted. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Liam McCafferty Date: Tuesday, October 3, 2017 at 12:27 PM To: Rushi NS Cc: "rroland at suse.com" , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Actually I'm mistaken they run under the system namespace so -n kube-system should get you what you need Sent from Blue On 3 Oct 2017, at 8:24 pm, Liam McCafferty > wrote: If I remember correctly dex runs on the cassp admin node. Any luck finding it there? Sent from Blue On 3 Oct 2017, at 7:45 pm, "Ns, Rushi" < rushi.ns at sap.com> wrote: Hi Robert, I don?t think bootstrap failed as the cluster completed without any errors and VELUM shows all active. Also on the master node, I see that dex.yaml and roles.yaml which all exist but not sure if the PODS running .. In a worst case I will try to rebuild the cluster to see if it works. By the way , in which node the DEX was running, I checked all my ndoes and I can?t find DEX running as POD ? lvsusekub5:~ # ls -ltr total 16 drwxr-xr-x 1 root root 0 Jun 27 08:59 bin drwxr-xr-x 1 root root 36 Sep 26 02:13 inst-sys -rw-r--r-- 1 root root 156 Sep 26 04:18 flannel-config.json -rw-r--r-- 1 root root 3034 Sep 26 04:19 dex.yaml -rw-r--r-- 1 root root 1161 Sep 26 04:19 roles.yaml -rw-r--r-- 1 root root 3295 Oct 3 18:37 kubeconfig [cid:image001.png at 01D33C3D.0FA157E0] Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Robert Roland Date: Tuesday, October 3, 2017 at 11:38 AM To: "caasp-beta at lists.suse.com" , "DElder at novacoast.com" , Rushi NS , Paul Gonin , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password That "Forbidden" error implies that your cluster bootstrap didn't complete successfully. Please submit a bug with a full supportconfig dump. Dex is set up by the bootstrap process. This error means that one of the steps in setting up Dex failed. Thanks, Rob >>> "Ns, Rushi" 10/03/17 11:16 AM >>> Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [168] [cid:image003.png at 01D33C3D.0FA157E0] [cid:image004.png at 01D33C3D.0FA157E0] [cid:image005.png at 01D33C3D.0FA157E0] [cid:image006.png at 01D33C3D.0FA157E0] [cid:image007.png at 01D33C3D.0FA157E0] [cid:image008.png at 01D33C3D.0FA157E0] From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [8] [cid:image010.png at 01D33C3D.0FA157E0] [cid:image011.png at 01D33C3D.0FA157E0] [cid:image012.png at 01D33C3D.0FA157E0] [cid:image013.png at 01D33C3D.0FA157E0] [cid:image014.png at 01D33C3D.0FA157E0] [cid:image015.png at 01D33C3D.0FA157E0] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL -------------- next part -------------- An HTML attachment was scrubbed... URL: From rob.decanha-knight at suse.com Tue Oct 3 14:07:42 2017 From: rob.decanha-knight at suse.com (Rob de Canha-Knight) Date: Tue, 3 Oct 2017 20:07:42 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <9CB51FD7-D00E-455F-A047-F753D3A282AD@sap.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> <15a292e8-5d12-40bc-9287-c34a0c3bceb5@smartodds.co.uk> <305a6eba-6d23-42b0-8e1e-995885077097@smartodds.co.uk> <9CB51FD7-D00E-455F-A047-F753D3A282AD@sap.com> Message-ID: Rushi if you look at the details Robert gave you earlier he recommends you download a supportconfig for the cluster and provide that in the form of a bug report. This would be helpful to our developers so they can see the underlying cause of the issue (and why Dex failed to start) and make sure it?s resolved before 2.0 is released later this month. Otherwise it?s possible that rebuilding the cluster fixes the issue for you but then the logs for the underlying cause are lost and it means you/those with a similar configuration may hit it again in the future. So if you have the time to run supportconfig and provide a bug report it would be very much appreciated. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [005168] [cid:image002.png at 01D33C8B.A5C30AE0] [cid:image003.png at 01D33C8B.A5C30AE0] [cid:image004.png at 01D33C8B.A5C30AE0] [cid:image005.png at 01D33C8B.A5C30AE0] [cid:image006.png at 01D33C8B.A5C30AE0] [cid:image007.png at 01D33C8B.A5C30AE0] From: on behalf of "Ns, Rushi" Date: Tuesday, 3 October 2017 at 20:29 To: Liam McCafferty Cc: Robert Roland , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I searched everynode and nothing found , I?m going to rebuild it to see if anything can make difference. Keep you posted. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Liam McCafferty Date: Tuesday, October 3, 2017 at 12:27 PM To: Rushi NS Cc: "rroland at suse.com" , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Actually I'm mistaken they run under the system namespace so -n kube-system should get you what you need Sent from Blue On 3 Oct 2017, at 8:24 pm, Liam McCafferty > wrote: If I remember correctly dex runs on the cassp admin node. Any luck finding it there? Sent from Blue On 3 Oct 2017, at 7:45 pm, "Ns, Rushi" < rushi.ns at sap.com> wrote: Hi Robert, I don?t think bootstrap failed as the cluster completed without any errors and VELUM shows all active. Also on the master node, I see that dex.yaml and roles.yaml which all exist but not sure if the PODS running .. In a worst case I will try to rebuild the cluster to see if it works. By the way , in which node the DEX was running, I checked all my ndoes and I can?t find DEX running as POD ? lvsusekub5:~ # ls -ltr total 16 drwxr-xr-x 1 root root 0 Jun 27 08:59 bin drwxr-xr-x 1 root root 36 Sep 26 02:13 inst-sys -rw-r--r-- 1 root root 156 Sep 26 04:18 flannel-config.json -rw-r--r-- 1 root root 3034 Sep 26 04:19 dex.yaml -rw-r--r-- 1 root root 1161 Sep 26 04:19 roles.yaml -rw-r--r-- 1 root root 3295 Oct 3 18:37 kubeconfig [cid:image001.png at 01D33C3D.0FA157E0] Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Robert Roland Date: Tuesday, October 3, 2017 at 11:38 AM To: "caasp-beta at lists.suse.com" , "DElder at novacoast.com" , Rushi NS , Paul Gonin , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password That "Forbidden" error implies that your cluster bootstrap didn't complete successfully. Please submit a bug with a full supportconfig dump. Dex is set up by the bootstrap process. This error means that one of the steps in setting up Dex failed. Thanks, Rob >>> "Ns, Rushi" 10/03/17 11:16 AM >>> Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [68] [cid:image003.png at 01D33C3D.0FA157E0] [cid:image004.png at 01D33C3D.0FA157E0] [cid:image005.png at 01D33C3D.0FA157E0] [cid:image006.png at 01D33C3D.0FA157E0] [cid:image007.png at 01D33C3D.0FA157E0] [cid:image008.png at 01D33C3D.0FA157E0] From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [cid:image009.png at 01D33C3D.0FA157E0] [cid:image010.png at 01D33C3D.0FA157E0] [cid:image011.png at 01D33C3D.0FA157E0] [cid:image012.png at 01D33C3D.0FA157E0] [cid:image013.png at 01D33C3D.0FA157E0] [cid:image014.png at 01D33C3D.0FA157E0] [cid:image015.png at 01D33C3D.0FA157E0] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2957 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1200 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 790 bytes Desc: image003.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 764 bytes Desc: image004.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 756 bytes Desc: image005.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 944 bytes Desc: image006.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 802 bytes Desc: image007.png URL: From paul.gonin at suse.com Wed Oct 4 01:01:47 2017 From: paul.gonin at suse.com (Paul Gonin) Date: Wed, 04 Oct 2017 09:01:47 +0200 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <9CB51FD7-D00E-455F-A047-F753D3A282AD@sap.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> <15a292e8-5d12-40bc-9287-c34a0c3bceb5@smartodds.co.uk> <305a6eba-6d23-42b0-8e1e-995885077097@smartodds.co.uk> <9CB51FD7-D00E-455F-A047-F753D3A282AD@sap.com> Message-ID: <1507100507.22040.10.camel@suse.com> Hi Rushi, Most of our tests were single master based, try first with only one master.Also you ardeploying on VMWare, is that correct ? I will try to reproduce your deployment configuration in our lab. thanksPaul Le mardi 03 octobre 2017 ? 19:28 +0000, Ns, Rushi a ?crit : > I searched everynode and nothing found , I?m going to rebuild it to > see if anything can make difference. > > Keep you posted. > > > > > Best Regards, > > Rushi. > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A > DIFFERENCE > > > > > From: Liam McCafferty > > Date: Tuesday, October 3, 2017 at 12:27 PM > > To: Rushi NS > > Cc: "rroland at suse.com" , "caasp-beta at lists.suse.com > " > > Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires > username and password > > > > > > Actually I'm mistaken they run under the system namespace so -n kube- > system should get you what you need > > > Sent from Blue > > > > On 3 Oct 2017, at 8:24 pm, Liam McCafferty .co.uk> wrote: > > > If I remember correctly dex runs on the cassp admin node. Any luck > > finding it there? > > > > > > > > Sent from Blue > > > > > > > > On 3 Oct 2017, at 7:45 pm, "Ns, Rushi" < > > rushi.ns at sap.com> wrote: > > > Hi Robert, > > > > > > I don?t think bootstrap failed as the cluster completed without > > > any errors and VELUM shows all active. > > > > > > > > > > > > Also on the master node, I see that dex.yaml and roles.yaml which > > > all exist but not sure if the PODS running .. > > > > > > In a worst case I will try to rebuild the cluster to see if it > > > works. By the way , in which node the DEX was running, I checked > > > all my ndoes and I > > > can?t find DEX running as POD ? > > > > > > lvsusekub5:~ # ls -ltr > > > total 16 > > > drwxr-xr-x 1 root root 0 Jun 27 08:59 bin > > > drwxr-xr-x 1 root root 36 Sep 26 02:13 inst-sys > > > -rw-r--r-- 1 root root 156 Sep 26 04:18 flannel-config.json > > > -rw-r--r-- 1 root root 3034 Sep 26 04:19 dex.yaml > > > -rw-r--r-- 1 root root 1161 Sep 26 04:19 roles.yaml > > > -rw-r--r-- 1 root root 3295 Oct 3 18:37 kubeconfig > > > > > > > > > > > > > > > > > > > > > Best Regards, > > > > > > > > > > > > Rushi. > > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A > > > DIFFERENCE > > > > > > > > > > > > > > > From: > > > Robert Roland > > > > > > Date: Tuesday, October 3, 2017 at 11:38 AM > > > > > > To: "caasp-beta at lists.suse.com" , "DEl > > > der at novacoast.com" , Rushi NS > > .com>, Paul Gonin , Rob de Canha-Knight > > anha-knight at suse.com> > > > > > > Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires > > > username and password > > > > > > > > > > > > > > > > > > > > > That "Forbidden" error implies that your cluster bootstrap didn't > > > complete successfully. Please submit a bug with a full > > > supportconfig dump. > > > > > > > > > > > > Dex is set up by the bootstrap process. This error means that one > > > of the steps in setting up Dex failed. > > > > > > > > > > > > Thanks, > > > > > > > > > > > > Rob > > > > > > > > > > > > > > > > > > >>> "Ns, Rushi" 10/03/17 11:16 AM >>> > > > > > > Hi Paul, > > > > > > Thank you . I have tried the same one with latest caasp-cli and > > > the result is same. FYI, I setup 3 masters with 6 workers and I > > > tried all 3 masters > > > hostname one by one with the command line caasp-cli but nothing > > > is really working. > > > > > > Do I have to setup any DEX container on the cluster ? or it does > > > embedded part of it and why it is asking me DEX? > > > > > > > > > caasp-cli login -s https://hostname:6443 -u rushi at id.com -p > > > xxxxxx > > > > > > Error: unable to find Dex service in CaaS Platform cluster, error > > > was Get https://hostname:6443/api/v1/namespaces/kube-system/servi > > > ces/dex: > > > Forbidden > > > > > > > > > > > > > > > Best Regards, > > > > > > Rushi. > > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A > > > DIFFERENCE > > > > > > > > > > > > > > > From: > > > Paul Gonin > > > > > > Date: Tuesday, October 3, 2017 at 8:55 AM > > > > > > To: Rob de Canha-Knight , Rushi NS < > > > rushi.ns at sap.com>, "caasp-beta at lists.suse.com" > > suse.com>, Dan Elder > > > > > > Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires > > > username and password > > > > > > > > > > > > > > > > > > Hi, > > > > > > > > > > > > > > > > > > You need to check that between master node and admin node the > > > port 389 is open - for example if you're using OpenStack you need > > > the check that the security group is properly defined > > > to allow this port > > > > > > > > > > > > > > > > > > rgds > > > > > > > > > Paul > > > > > > > > > > > > > > > > > > Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a > > > ?crit : > > > > > > > Rushi. > > > > > > > > > > > > The details I provided below on caasp-cli is how I?ve been > > > > using caasp-cli since day one. > > > > > > > > I?ve just tried again on a new cluster and running > > > > > > > > > > > > caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u > > > > rob.decanha-knight at suse.com -p mypassword > > > > > > > > Where ?u is the email address of the user I created during > > > > velum first startup/login. > > > > > > > > Worked fine for me. > > > > > > > > I don?t have any other documents to hand (other than the > > > > attached) around logging in so all I can personally suggest is > > > > to make sure you?re using https and port 6443 of the kubernetes > > > > master after -s. > > > > > > > > I?ve also attached the main bit of documentation we have around > > > > the caasp-cli client (which will make it?s way into the version > > > > 2 final release). > > > > > > > > > > > > I would suggest trying again from scratch with a new cluster > > > > instance of RC1 (including downloading and installing the > > > > updated caasp-cli client available from > > > > https://github.com/kubic-project/caasp-cli/releases as this one > > > > is working fine for me). > > > > Make a note of every command you are running and the output it > > > > provides and you can send those details to this list as at the > > > > moment the information in the thread is a bit scattered > > > > and I can?t tell accurately what?s going on or what?s being > > > > done by the user. > > > > > > > > Yes there are a lot of changes in this release mainly an > > > > updated k8s version and a feature much requested by customers > > > > (I remember during 1.0 betas you also requested for user > > > > management > > > > and this is how we?ve implemented it). I?ve also attached the > > > > details on how to create/manage additional user accounts > > > > through ldap as well as the caasp-cli guidance that we have. > > > > > > > > As one of our closest partners you also have the option of > > > > reaching out to your partner sales engineer/rep for your region > > > > and discussing it directly with them. They should be able > > > > to go onsite and help you if asked to get things up and > > > > running for your team. > > > > > > > > All the best, > > > > Rob > > > > > > > > > > > > ---- > > > > Rob de Canha-Knight > > > > > > > > EMEA Platform and Management Technical Strategist > > > > > > > > SUSE > > > > > > > > rob.decanha-knight at suse.com > > > > (Fuze/VOIP) +44 (0) 1635 937689 > > > > > > > > (M) +44 (0) 7392 087303 > > > > (TW) > > > > rssfed23 > > > > > > > > ---- > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > From: > > > > "Ns, Rushi" > > > > > > > > Date: Tuesday, 3 October 2017 at 16:07 > > > > > > > > To: "caasp-beta at lists.suse.com" , > > > > Dan Elder , Rob de Canha-Knight > > > nha-knight at suse.com> > > > > > > > > Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl > > > > requires username and password > > > > > > > > > > > > > > > > > > > > Hi Rob, > > > > > > > > Whatever you have mentioned is not really working in reality. > > > > Using CAASP-cli is not at all authenticating and I spent 2 days > > > > to find a way to connect > > > > to cluster. > > > > > > > > > > > > VELUM is fine, I can logon with registed email but nothing can > > > > be done after that such as installing kubernetes dashboard is > > > > not ? first of all need to know how to connect with CAASP-CLI > > > > because there is no users created other than VELUM web login > > > > which was > > > > registered. > > > > > > > > Can you provide some steps how you have doing with caasp-cli..i > > > > see lot of things changed on this new release. > > > > > > > > > > > > > > > > > > > > Best Regards, > > > > > > > > Rushi. > > > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A > > > > DIFFERENCE > > > > > > > > > > > > > > > > > > > > From: > > > > on behalf of Rob de Canha- > > > > Knight > > > > > > > > Date: Tuesday, October 3, 2017 at 6:57 AM > > > > > > > > To: Dan Elder , "caasp-beta at lists.suse.co > > > > m" > > > > > > > > Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl > > > > requires username and password > > > > > > > > > > > > > > > > > > > > Hi Dan. > > > > > > > > In the log you?ve provided you?re using the admin server for > > > > the ?s argument I believe. > > > > > > > > You must use https://:8443 as the address for > > > > the k8s master node (noting correct port and https). > > > > > > > > Please let us know how you get on. > > > > > > > > Rob > > > > > > > > > > > > > > > > > > > > ---- > > > > Rob de Canha-Knight > > > > > > > > EMEA Platform and Management Technical Strategist > > > > > > > > SUSE > > > > > > > > rob.decanha-knight at suse.com > > > > (Fuze/VOIP) +44 (0) 1635 937689 > > > > > > > > (M) +44 (0) 7392 087303 > > > > (TW) > > > > rssfed23 > > > > > > > > ---- > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > From: > > > > on behalf of Dan Elder > > > der at novacoast.com> > > > > > > > > Date: Tuesday, 3 October 2017 at 05:15 > > > > > > > > To: "caasp-beta at lists.suse.com" > > > > > > > > Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl > > > > requires username and password > > > > > > > > > > > > > > > > > > > > > > > > I haven't had any luck authentication with caasp-cli > > > > unfortunately. The credentials I supply work fine for Velum > > > > but caasp-cli says they're invalid (output attached). Is there > > > > some log I can pull from the admin node or somewhere else to > > > > troubleshoot this? I've done 2 installs and gotten the same > > > > result both times. > > > > Thanks, > > > > > > > > Dan > > > > > > > > > > > > On 09/27/2017 08:04 AM, Paul Gonin wrote: > > > > > > > > > Hi, > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > It should be on the media so you can install it on the admin > > > > > node > > > > > > > > > > > > > > > It is installed by default on admin node. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > You can also get (currently) rpms for different openSUSE/SUSE > > > > > flavors > > > > > > > > > > > > > > > https://build.opensuse.org/repositories/devel:CaaSP:Head:Cont > > > > > rollerNode/caasp-cli > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > And there is also a windows Build from Rob > > > > > > > > > > > > > > > https://github.com/rssfed23/caasp-cli-windows/releases > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Tested / works but not supported (yet, but I assume to come) > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Once you have caasp-cli > > > > > > > > > > > > > > > > > > > > export KUBECONFIG= (set > > > > > KUBECONFIG=kubeconfig > > > > > in windows cmd shell) > > > > > > > > > > > > > > > caasp-cli login -u caasp-user -p caasp-password -s > > > > > https://caasp.fqdn:6443 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > and then you can use kubectl as previously > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > For caasp-user and caasp-password you can use caasp admin > > > > > credentials. > > > > > > > > > > > > > > > You can also create users in local ldap > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > rgds > > > > > > > > > > > > > > > Paul > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a > > > > > ?crit : > > > > > > > > > > > Thanks, where can I download . I see from github I can?t > > > > > > download the link . > > > > > > > > > > > > https://github.com/kubic-project/caasp-cli > > > > > > > > > > > > > > > > > > > > > > > > Best Regards, > > > > > > > > > > > > Rushi. > > > > > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES > > > > > > A DIFFERENCE > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > From: > > > > > > Paul Gonin > > > > > > > > > > > > > > > > > > Date: Tuesday, September 26, 2017 at 1:31 PM > > > > > > > > > > > > To: "caasp-beta at lists.suse.com" > > > > > > , Rushi NS > > > > > > > > > > > > > > > > > > Subject: RE : [caasp-beta] kubectl requires username and > > > > > > password > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hi, > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > With RC1, RBAC is available > > > > > > > > > > > > > > > > > > Consequence is that you have to use caasp-ctl to login to > > > > > > CaaSP and modify your kubectl and inject credentials in it. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Rgds > > > > > > > > > > > > > > > > > > Paul > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -------- Message d'origine -------- > > > > > > > > > > > > > > > > > > De : "Ns, Rushi" > > > > > > > > > > > > > > > > > > > > > > > > Date : 26/09/2017 22:04 (GMT+01:00) > > > > > > > > > > > > > > > > > > > > > > > > ? : SUSE Beta Program > > > > > > , > > > > > > caasp-beta at lists.suse.com > > > > > > > > > > > > > > > > > > Objet : [caasp-beta] kubectl requires username and password > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >>> "Ns, Rushi" 09/26/2017 21:04 >>> > > > > > > > > > > > > Hi > > > > > > > > > > > > > > > > > > I setup new cluster with this release and everything > > > > > > worked. I have 3 masters/10 workers ..looks fine VELUM web > > > > > > page as well and I have downloaded > > > > > > kubeconfig and tried to do some workload test but issue > > > > > > with access cluster. > > > > > > > > > > > > > > > > > > I have issue with using KUBECTL command line ..whatever > > > > > > ?kubectl? I run requires permission. I setup velum with my > > > > > > userid email and password, I thought > > > > > > it requires that and I tried but its not ? > > > > > > > > > > > > I have also tried root (linux) master/workers but it > > > > > > doesn?t take that too? > > > > > > > > > > > > > > > > > > Does anyone know what is the issue. > > > > > > > > > > > > > > > > > > kubectl get cluster-info > > > > > > > > > > > > > > > > > > kubectl get nodes > > > > > > Please enter Username: > > > > > > rushi.ns at sap.com > > > > > > Please enter Password: ********* > > > > > > Error from server > > > > > > (Forbidden): User "system:anonymous" cannot list nodes at > > > > > > the cluster scope. (get nodes) > > > > > > > > > > > > kubectl get nodes > > > > > > Please enter Username: admin > > > > > > Please enter Password: ******** > > > > > > Unable to connect to the > > > > > > server: x509: certificate is valid for 172.24.0.1, > > > > > > 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, > > > > > > not 10.48.164.144 > > > > > > > > > > > > kubectl get nodes > > > > > > Please enter Username: root > > > > > > Please enter Password: ******** > > > > > > Unable to connect to the > > > > > > server: x509: certificate is valid for 172.24.0.1, > > > > > > 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, > > > > > > not 10.48.164.144 > > > > > > > > > > > > Best Regards, > > > > > > > > > > > > Rushi. > > > > > > I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES > > > > > > A DIFFERENCE > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > From: > > > > > > on behalf of SUSE Beta > > > > > > Program > > > > > > > > > > > > > > > > > > Reply-To: SUSE Beta Program > > > > > > > > > > > > > > > > > > Date: Friday, September 22, 2017 at 7:48 AM > > > > > > > > > > > > To: "caasp-beta at lists.suse.com" > > > > > > > > > > > > > > > > > > Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a > > > > > > Service Platform 2 RC 1 is available! > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Having trouble viewing this email? Please check the plain > > > > > > text version of it with your mailer. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > We are happy to announce > > > > > > SUSE CaaS Platform 2 > > > > > > Release Candidate 1! > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Download > > > > > > ? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Please check out our dedicated > > > > > > SUSE CaaS Platform Beta web page, where you will find all > > > > > > the information needed around SUSE CaaS Platform Beta. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > What?s New with SUSE CaaS Platform 2 RC 1? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > K8s Multi-Master: Kubernetes Multi Master for building > > > > > > High-Availability clusters. > > > > > > > > > > > > caasp-cli: It's the new command line client for interacting > > > > > > with a CaaS Platform cluster. > > > > > > See for details. > > > > > > > > > > > > Dex: Dex is an identity service that uses OpenID Connect to > > > > > > drive authentication for other > > > > > > apps. See for details. > > > > > > > > > > > > OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Things to consider for this Beta? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > DHCP > > > > > > > > > > > > > > > > > > Your DHCP server should provide resolveable hostnames. If > > > > > > this is not the case like with libvirt/KVM, you should > > > > > > consider providing one yourself by appending this kernel > > > > > > parameter > > > > > > "hostname=HOSTNAME" during installation. > > > > > > > > > > > > However, the kubeconfig file downloaded from the Dashboard > > > > > > could contain an incorrect "server" hostname that should be > > > > > > replaced with the IP address of your Master. For more > > > > > > information > > > > > > read: https://en.opensuse.org/SDB:Linuxrc#Network_Configur > > > > > > ation > > > > > > > > > > > > > > > > > > Autoyast/VMX-Images > > > > > > > > > > > > > > > > > > If you install via autoyast or one of the provided VMX beta > > > > > > images (KVM,Xen,VMware,...) please set a password or SSH > > > > > > key via cloud-init to be able to login. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Release > > > > > > plan ? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Release > > > > > > Notes ? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Documentation > > > > > > ? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Have fun beta testing! > > > > > > > > > > > > Your SUSE Linux Enterprise Team > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Please refer to our dedicated > > > > > > SUSE CaaSP Beta Program webpage for any general > > > > > > information. However, do not hesitate to contact us at > > > > > > beta-programs at lists.suse.com if you have any questions. > > > > > > You received this email because you're signed up to get > > > > > > updates from us. > > > > > > > > > > > > Click here to unsubscribe. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > > caasp-beta mailing list > > > > > > caasp-beta at lists.suse.com > > > > > > http://lists.suse.com/mailman/listinfo/caasp-beta > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > caasp-beta mailing list > > > > > caasp-beta at lists.suse.com > > > > > http://lists.suse.com/mailman/listinfo/caasp-beta > > > > > > > > > > > > -- > > > > Senior Engineer > > > > Linux Services Manager > > > > Novacoast, Inc. > > > > Mobile: (310) 243-6971 > > > > Office: (800) 949-9933 x1337 > > > > http://www.novacoast.com/ > > > > _______________________________________________ > > > > caasp-beta mailing list > > > > caasp-beta at lists.suse.com > > > > http://lists.suse.com/mailman/listinfo/caasp-beta > > > > > > > > > > > > > > > > > > _________________________________________________________________ > > > _____ > > > > > > This email has been scanned by the Symantec Email Security.cloud > > > service. > > > > > > For more information please visit http://www.symanteccloud.com > > > > > > _________________________________________________________________ > > > _____ > > > > > > > > > > > > This e-mail and any files transmitted with it are confidential > > > and may be legally privileged. If you receive it in error or are > > > not the intended recipient you must not copy, distribute or take > > > any action in reliance upon it. Instead, please notify us > > > immediately > > > by telephoning +44 (20) 74820223 and delete the material from > > > your systems. Smartodds is a business carried on by Smartodds > > > Limited, a company registered with the Registrar of Companies for > > > England and Wales with number 05108548. Registered office: Unit > > > 540 > > > Highgate Studios, 53-79 Highgate Road, London NW5 1TL > > > > > > > > ___________________________________________________________________ > > ___ > > > > This email has been scanned by the Symantec Email Security.cloud > > service. > > > > For more information please visit http://www.symanteccloud.com > > > > ___________________________________________________________________ > > ___ > > > > > > > > This e-mail and any files transmitted with it are confidential and > > may be legally privileged. If you receive it in error or are not > > the intended recipient you must not copy, distribute or take any > > action in reliance upon it. Instead, please notify us immediately > > by telephoning +44 (20) 74820223 and delete the material from your > > systems. Smartodds is a business carried on by Smartodds Limited, a > > company registered with the Registrar of Companies for England and > > Wales with number 05108548. Registered office: Unit 531 > > Highgate Studios, 53-79 Highgate Road, London NW5 1TL > > > > > > > > ___________________________________________________________________ > > ___ > > > > This email has been scanned by the Symantec Email Security.cloud > > service. > > > > For more information please visit http://www.symanteccloud.com > > > > ___________________________________________________________________ > > ___ > > > > > > > > This e-mail and any files transmitted with it are confidential and > > may be legally privileged. If you receive it in error or are not > > the intended recipient you must not copy, distribute or take any > > action in reliance upon it. Instead, please notify us immediately > > by telephoning +44 (20) 74820223 and delete the material from your > > systems. Smartodds is a business carried on by Smartodds Limited, a > > company registered with the Registrar of Companies for England and > > Wales with number 05108548. Registered office: Unit 540 > > Highgate Studios, 53-79 Highgate Road, London NW5 1TL > > > > _____________________________________________________________________ > _ > > This email has been scanned by the Symantec Email Security.cloud > service. > > For more information please visit http://www.symanteccloud.com > > _____________________________________________________________________ > _ > > > > This e-mail and any files transmitted with it are confidential and > may be legally privileged. If you receive it in error or are not the > intended recipient you must not copy, distribute or take any action > in reliance upon it. Instead, please notify us immediately > by telephoning +44 (20) 74820223 and delete the material from your > systems. Smartodds is a business carried on by Smartodds Limited, a > company registered with the Registrar of Companies for England and > Wales with number 05108548. Registered office: Unit 531 > Highgate Studios, 53-79 Highgate Road, London NW5 1TL > > > > > > > > > _______________________________________________ > caasp-beta mailing list > caasp-beta at lists.suse.com > http://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- An HTML attachment was scrubbed... URL: From Bruno.Cornec at hpe.com Wed Oct 4 06:17:06 2017 From: Bruno.Cornec at hpe.com (Bruno Cornec) Date: Wed, 4 Oct 2017 14:17:06 +0200 Subject: [caasp-beta] Add package not in repos In-Reply-To: References: Message-ID: <20171004121706.GQ1989@morley.fr.hpecorp.net> Le Bihan St?phane (AMUNDI-ITS) said on Wed, Oct 04, 2017 at 12:13:43PM +0000: >Security team requires inventory software install on all node. >But I can't install it on Suse CAASP OS. Because / is in read-only. If you use autoyast to install your nodes, you can add packages to the list as this is done before turning ro the FS. Bruno. -- HPE EMEA EG FLOSS Technology Strategist http://www.hpe.com/engage/opensource Open Source Profession, WW Linux Community Lead http://github.com/bcornec FLOSS projects: http://mondorescue.org http://project-builder.org Musique ancienne? http://www.musique-ancienne.org http://www.medieval.org From kukuk at suse.com Wed Oct 4 06:17:13 2017 From: kukuk at suse.com (Thorsten Kukuk) Date: Wed, 4 Oct 2017 14:17:13 +0200 Subject: [caasp-beta] Add package not in repos In-Reply-To: References: Message-ID: <20171004121713.GA18738@suse.com> Hi, On Wed, Oct 04, Le Bihan St?phane (AMUNDI-ITS) wrote: > Security team requires inventory software install on all node. > > But I can?t install it on Suse CAASP OS. Because / is in read-only. > > So what is method for install third-party software on CAASP OS ? > > Can I create subvolume in rw on top of / ? Depends on how they deliver the software. https://susecon17.smarteventscloud.com/connect/search.ww#loadSearch-searchPhrase=MicroOS&searchType=session&tc=0&sortBy=abbreviationSort&p= contains on the right side my presentation about SUSE MicroOS. Slide 42 and following are the ones you are looking for. Thorsten -- Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & CaaSP SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany GF: Felix Imendoerffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nuernberg) From stephane.lebihan at amundi.com Thu Oct 5 00:00:10 2017 From: stephane.lebihan at amundi.com (=?utf-8?B?TGUgQmloYW4gU3TDqXBoYW5lIChBTVVOREktSVRTKQ==?=) Date: Thu, 5 Oct 2017 06:00:10 +0000 Subject: [caasp-beta] Add package not in repos In-Reply-To: <20171004121713.GA18738@suse.com> References: <20171004121713.GA18738@suse.com> Message-ID: Hi, Thanks. My faults I don't read all docs. Regards, St?phane?Le Bihan? SDE/DSI/IPR/SSD/UNX 90, Boulevard Pasteur - 75015 Paris Web: http://www.amundi.com T?l: +33 1 76 32 32 08 Equipe Unix : +33 1 76 32 02 30 @: stephane.lebihan at amundi.com @?: sits.unix at amundi.com -----Message d'origine----- De?: caasp-beta-bounces at lists.suse.com [mailto:caasp-beta-bounces at lists.suse.com] De la part de Thorsten Kukuk Envoy??: mercredi 4 octobre 2017 14:17 ??: caasp-beta at lists.suse.com Objet?: Re: [caasp-beta] Add package not in repos Hi, On Wed, Oct 04, Le Bihan St?phane (AMUNDI-ITS) wrote: > Security team requires inventory software install on all node. > > But I can?t install it on Suse CAASP OS. Because / is in read-only. > > So what is method for install third-party software on CAASP OS ? > > Can I create subvolume in rw on top of / ? Depends on how they deliver the software. https://susecon17.smarteventscloud.com/connect/search.ww#loadSearch-searchPhrase=MicroOS&searchType=session&tc=0&sortBy=abbreviationSort&p= contains on the right side my presentation about SUSE MicroOS. Slide 42 and following are the ones you are looking for. Thorsten -- Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & CaaSP SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany GF: Felix Imendoerffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nuernberg) _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta From rroland at suse.com Tue Oct 3 12:37:46 2017 From: rroland at suse.com (Robert Roland) Date: Tue, 03 Oct 2017 12:37:46 -0600 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> Message-ID: <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> That "Forbidden" error implies that your cluster bootstrap didn't complete successfully. Please submit a bug with a full supportconfig dump. Dex is set up by the bootstrap process. This error means that one of the steps in setting up Dex failed. Thanks, Rob >>> "Ns, Rushi" 10/03/17 11:16 AM >>> Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Con -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________caasp-beta mailing listcaasp-beta at lists.suse.comhttp://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________caasp-beta mailing listcaasp-beta at lists.suse.comhttp://lists.suse.com/mailman/listinfo/caasp-beta -- Senior EngineerLinux Services ManagerNovacoast, Inc.Mobile: (310) 243-6971Office: (800) 949-9933 x1337http://www.novacoast.com/_______________________________________________caasp-beta mailing listcaasp-beta at lists.suse.comhttp://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 2960 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 805 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 2958 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 1201 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 945 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 803 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 759 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 947 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 791 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 793 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 1203 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 765 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 767 bytes Desc: Portable Network Graphics Format URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 757 bytes Desc: Portable Network Graphics Format URL: From rroland at suse.com Tue Oct 3 14:23:32 2017 From: rroland at suse.com (Robert Roland) Date: Tue, 03 Oct 2017 14:23:32 -0600 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <15a292e8-5d12-40bc-9287-c34a0c3bceb5@smartodds.co.uk> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> <15a292e8-5d12-40bc-9287-c34a0c3bceb5@smartodds.co.uk> Message-ID: <59D3F1C40200000700015BF2@prv-mh.provo.novell.com> No, Dex does not run on the admin node. It runs as pods distributed across your cluster. OpenLDAP runs on the admin node. >>> Liam McCafferty 10/03/17 12:24 PM >>> If I remember correctly dex runs on the cassp admin node. Any luck finding it there? Sent from Blue On 3 Oct 2017, at 7:45 pm, "Ns, Rushi" wrote: Hi Robert, I don?t think bootstrap failed as the cluster completed without any errors and VELUM shows all active. Also on the master node, I see that dex.yaml and roles.yaml which all exist but not sure if the PODS running .. In a worst case I will try to rebuild the cluster to see if it works. By the way , in which node the DEX was running, I checked all my ndoes and I can?t find DEX running as POD ? lvsusekub5:~ # ls -ltr total 16 drwxr-xr-x 1 root root 0 Jun 27 08:59 bin drwxr-xr-x 1 root root 36 Sep 26 02:13 inst-sys -rw-r--r-- 1 root root 156 Sep 26 04:18 flannel-config.json -rw-r--r-- 1 root root 3034 Sep 26 04:19 dex.yaml -rw-r--r-- 1 root root 1161 Sep 26 04:19 roles.yaml -rw-r--r-- 1 root root 3295 Oct 3 18:37 kubeconfig Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Robert Roland Date: Tuesday, October 3, 2017 at 11:38 AM To: "caasp-beta at lists.suse.com" , "DElder at novacoast.com" , Rushi NS , Paul Gonin , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password That "Forbidden" error implies that your cluster bootstrap didn't complete successfully. Please submit a bug with a full supportconfig dump. Dex is set up by the bootstrap process. This error means that one of the steps in setting up Dex failed. Thanks, Rob >>> "Ns, Rushi" 10/03/17 11:16 AM >>> Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subjec I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16 From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL From rushi.ns at sap.com Tue Oct 10 17:55:56 2017 From: rushi.ns at sap.com (Ns, Rushi) Date: Tue, 10 Oct 2017 23:55:56 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <1507100507.22040.10.camel@suse.com> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> <15a292e8-5d12-40bc-9287-c34a0c3bceb5@smartodds.co.uk> <305a6eba-6d23-42b0-8e1e-995885077097@smartodds.co.uk> <9CB51FD7-D00E-455F-A047-F753D3A282AD@sap.com> <1507100507.22040.10.camel@suse.com> Message-ID: <74D2C543-2D46-4925-825F-0145679225DB@sap.com> Hi paul Here is my tests. I rebuild the cluster with 1 master 4 workers and I try to connect with caasp-cli , I get the same issues as earlier (forbidden) also not sure why it promoting the email address again though it was provided. caasp-cli login -s https://lvsusekub3.pal.sap.corp:6443 - u admin at sap.com -p Sap12345$ Enter your email address: admin at sap.com unable to find Dex service in CaaS Platform cluster, error was Get https://lvsusekub3.pal.sap.corp:6443/api/v1/namespaces/kube-system/services/dex: Forbidden I did some check with DEX and API responding ? https://10.48.164.142:6443/api/v1/namespaces/kube-system/services/dex { "kind": "Service", "apiVersion": "v1", "metadata": { "name": "dex", "namespace": "kube-system", "selfLink": "/api/v1/namespaces/kube-system/services/dex", "uid": "0e2f757e-ae13-11e7-8a17-005056aa0106", "resourceVersion": "355", "creationTimestamp": "2017-10-10T23:30:52Z", "annotations": { "kubectl.kubernetes.io/last-applied-configuration": "{\"apiVersion\":\"v1\",\"kind\":\"Service\",\"metadata\":{\"annotations\":{},\"name\":\"dex\",\"namespace\":\"kube-system\"},\"spec\":{\"ports\":[{\"name\":\"dex\",\"nodePort\":32000,\"port\":5556,\"protocol\":\"TCP\",\"targetPort\":5556}],\"selector\":{\"app\":\"dex\"},\"type\":\"NodePort\"}}\n" } }, "spec": { "ports": [ { "name": "dex", "protocol": "TCP", "port": 5556, "targetPort": 5556, "nodePort": 32000 } ], "selector": { "app": "dex" }, "clusterIP": "172.24.74.169", "type": "NodePort", "sessionAffinity": "None", "externalTrafficPolicy": "Cluster" }, "status": { "loadBalancer": {} } } also DEX PODS running as I logon to master node and ran the kubectl commands to verify, but I see that hostnames are not matching to my hostname as provided during install. kubectl get pods -o wide --all-namespaces |grep dex 2017-10-10 23:49:33.249844 I | proto: duplicate proto type registered: google.protobuf.Any 2017-10-10 23:49:33.249930 I | proto: duplicate proto type registered: google.protobuf.Duration 2017-10-10 23:49:33.249953 I | proto: duplicate proto type registered: google.protobuf.Timestamp kube-system dex-820878179-3bx27 1/1 Running 2 18m 172.16.16.2 c1b61fd0be894e9fb57a8ce950840dcb.infra.caasp.local kube-system dex-820878179-3plh8 1/1 Running 2 18m 172.16.16.4 c1b61fd0be894e9fb57a8ce950840dcb.infra.caasp.local kube-system dex-820878179-692zd 1/1 Running 2 18m 172.16.16.3 c1b61fd0be894e9fb57a8ce950840dcb.infra.caasp.local Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Wednesday, October 4, 2017 at 12:02 AM To: Rushi NS Cc: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rushi, Most of our tests were single master based, try first with only one master. Also you ardeploying on VMWare, is that correct ? I will try to reproduce your deployment configuration in our lab. thanks Paul Le mardi 03 octobre 2017 ? 19:28 +0000, Ns, Rushi a ?crit : I searched everynode and nothing found , I?m going to rebuild it to see if anything can make difference. Keep you posted. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Liam McCafferty Date: Tuesday, October 3, 2017 at 12:27 PM To: Rushi NS Cc: "rroland at suse.com" , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Actually I'm mistaken they run under the system namespace so -n kube-system should get you what you need Sent from Blue On 3 Oct 2017, at 8:24 pm, Liam McCafferty > wrote: If I remember correctly dex runs on the cassp admin node. Any luck finding it there? Sent from Blue On 3 Oct 2017, at 7:45 pm, "Ns, Rushi" < rushi.ns at sap.com> wrote: Hi Robert, I don?t think bootstrap failed as the cluster completed without any errors and VELUM shows all active. Also on the master node, I see that dex.yaml and roles.yaml which all exist but not sure if the PODS running .. In a worst case I will try to rebuild the cluster to see if it works. By the way , in which node the DEX was running, I checked all my ndoes and I can?t find DEX running as POD ? lvsusekub5:~ # ls -ltr total 16 drwxr-xr-x 1 root root 0 Jun 27 08:59 bin drwxr-xr-x 1 root root 36 Sep 26 02:13 inst-sys -rw-r--r-- 1 root root 156 Sep 26 04:18 flannel-config.json -rw-r--r-- 1 root root 3034 Sep 26 04:19 dex.yaml -rw-r--r-- 1 root root 1161 Sep 26 04:19 roles.yaml -rw-r--r-- 1 root root 3295 Oct 3 18:37 kubeconfig [cid:image001.png at 01D33C3D.0FA157E0] Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Robert Roland Date: Tuesday, October 3, 2017 at 11:38 AM To: "caasp-beta at lists.suse.com" , "DElder at novacoast.com" , Rushi NS , Paul Gonin , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password That "Forbidden" error implies that your cluster bootstrap didn't complete successfully. Please submit a bug with a full supportconfig dump. Dex is set up by the bootstrap process. This error means that one of the steps in setting up Dex failed. Thanks, Rob >>> "Ns, Rushi" 10/03/17 11:16 AM >>> Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [68] [cid:image003.png at 01D33C3D.0FA157E0] [cid:image004.png at 01D33C3D.0FA157E0] [cid:image005.png at 01D33C3D.0FA157E0] [cid:image006.png at 01D33C3D.0FA157E0] [cid:image007.png at 01D33C3D.0FA157E0] [cid:image008.png at 01D33C3D.0FA157E0] From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- [cid:image009.png at 01D33C3D.0FA157E0] [cid:image010.png at 01D33C3D.0FA157E0] [cid:image011.png at 01D33C3D.0FA157E0] [cid:image012.png at 01D33C3D.0FA157E0] [cid:image013.png at 01D33C3D.0FA157E0] [cid:image014.png at 01D33C3D.0FA157E0] [cid:image015.png at 01D33C3D.0FA157E0] From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. [http://beta.suse.com/private/SLE12/suse_logo_color-reduced.png] [https://www.suse.com/betaprogram/wp-content/uploads/2017/09/caasp-logo-beta-2-new.png] We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? * K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. * caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. * Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. * OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? * DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation. However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration * Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing! Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions. You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- An HTML attachment was scrubbed... URL: From nikhil at manchanda.me Wed Oct 18 01:26:30 2017 From: nikhil at manchanda.me (Nikhil Manchanda) Date: Wed, 18 Oct 2017 00:26:30 -0700 Subject: [caasp-beta] Portus in CaasP already included? In-Reply-To: References: Message-ID: Hi Andreas: Currently (as of the time-frame of the 2.0 release) Portus is not pre-included with the CaaS Platform, but will need to be installed and configured separately. We are in the process of working on creating a Helm chart that will make it easy to install Portus on CaaS Platform, but this will not be ready until after the 2.0 release. There will be more information (in the form of docs / blog post) once we get there, so I would keep an eye out for that in the future. Hope this helps, Cheers, Nikhil On Tue, Oct 17, 2017 at 3:10 AM, Andreas Knabl wrote: > Hi there, > > I'm a newbie to CaaS Plattform and would like to ask you if somebody can > tell me if Portus is already included in the CaaS Plattform or do you have > to install and configure Portus separatly? > > Thank you for your help. > > Best regards, > Andreas > > _______________________________________________ > caasp-beta mailing list > caasp-beta at lists.suse.com > http://lists.suse.com/mailman/listinfo/caasp-beta > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From rob.decanha-knight at suse.com Tue Oct 24 11:33:57 2017 From: rob.decanha-knight at suse.com (Rob de Canha-Knight) Date: Tue, 24 Oct 2017 17:33:57 +0000 Subject: [caasp-beta] dashboard login does not work with kubconfig Message-ID: <6DF84614-6469-4E8D-8803-B6882369B9C0@suse.com> The newer versions of the dashboards require additional steps to function (namely providing ssl certs to the init container that now runs before the dashboard launches) I strongly recommend you use an older version until we have a published way to use one of the newer ones. This was a breaking upstream change that was done and is the same on any k8s cluster with newer versions of the dashboard. For caasp 1: kubectl create -f https://raw.githubusercontent.com/kubernetes/dashboard/v1.6.3/src/deploy/kubernetes-dashboard-no-rbac.yaml For caasp 2: kubectl create -f https://raw.githubusercontent.com/kubernetes/dashboard/v1.6.3/src/deploy/kubernetes-dashboard.yaml We will have recommendations posted for the 1.7 version of the dashboard once we have finalised something. ----- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (P) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- From: on behalf of "Skibinski, Hubert" Date: Tuesday, 24 October 2017 at 16:58 To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] dashboard login does not work with kubconfig Hi, I get following error when try to login to dashboard with kubeconfig file generated by caasp-cli: ?Not enough data to create auth info structure? kubectl version: Client Version: version.Info{Major:"1", Minor:"7", GitVersion:"v1.7.7", GitCommit:"8e1552342355496b62754e61ad5f802a0f3f1fa7", GitTreeState:"clean", BuildDate:"2017-09-29T00:18:18Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"7", GitVersion:"v1.7.0", GitCommit:"$Format:%H$", GitTreeState:"not a git tree", BuildDate:"2017-09-17T19:00:34Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"} Dashboard version: 1.7.1 It works when I use token to authenticate. Thank you for your help. Hubert Information in this e-mail and any attachments is confidential, and may not be copied or used by anyone other than the addressee, nor disclosed to any third party without our permission. There is no intention to create any legally binding contract or other binding commitment through the use of this electronic communication unless it is issued in accordance with the Experian Limited standard terms and conditions of purchase or other express written agreement between Experian Limited and the recipient. Although Experian has taken reasonable steps to ensure that this communication and any attachments are free from computer viruses, you are advised to take your own steps to ensure that they are actually virus free. Experian Ltd is authorised and regulated by the Financial Conduct Authority. Companies Act information: Registered name: Experian Limited. Registered office: The Sir John Peace Building, Experian Way, NG2 Business Park, Nottingham, NG80 1ZZ, United Kingdom. Place of registration: England and Wales. Registered number: 653331. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2960 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1203 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 793 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 767 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 759 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 947 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 805 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5008 bytes Desc: not available URL: From rob.decanha-knight at suse.com Wed Oct 25 09:37:26 2017 From: rob.decanha-knight at suse.com (Rob de Canha-Knight) Date: Wed, 25 Oct 2017 15:37:26 +0000 Subject: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password In-Reply-To: <1508944674762.29022@smartodds.co.uk> References: <59CAB917020000B90020DBE4@smtp.nue.novell.com> <2D840902-1A48-4698-B71E-DDD40FC7DEF7@sap.com> <1506524690.17636.76.camel@suse.com> <9da31932-20c8-be5e-a814-565492e1a683@novacoast.com> <8A3D53AB-B5CA-48DE-90C2-E2612D66F11A@suse.com> <1507046133.22040.5.camel@suse.com> <579A3044-AD42-4AA6-B33B-67D0B37CBA7A@sap.com> <59D3D8FA0200000700015BAE@prv-mh.provo.novell.com> <7D8472C5-3D70-4023-90A8-058B5D6CF467@sap.com> <15a292e8-5d12-40bc-9287-c34a0c3bceb5@smartodds.co.uk> <305a6eba-6d23-42b0-8e1e-995885077097@smartodds.co.uk> <9CB51FD7-D00E-455F-A047-F753D3A282AD@sap.com> <1507100507.22040.10.camel@suse.com> <74D2C543-2D46-4925-825F-0145679225DB@sap.com> <1508944674762.29022@smartodds.co.uk> Message-ID: <552256A9-9CD0-4A02-B581-486D2963F284@suse.com> Hi Liam. We?ve been aware of this issue (cert generated before dhcp hostname set) for a short while now since RC1 and we?ve already fixed this bug in our builds. By the time 2.0 is released and the next public beta update this issue won?t occur as the script that generates the certificates will only run after the network-online systemd target has been reached (before it could run before then hence why the hostnames did not match). Also when 2 is released you won?t have to use the caasp-cli tool to authenticate (but you can if you still wish of course) as this will be done inside of velum (well redirecting to dex to download the kubeconfig file in the browser). Another workaround for this (that I?m sure Stephen sent a couple weeks back now as I remember sending this workaround to him): remove /etc/pki/velum.crt and /etc/pki/ldap.crt Run /usr/share/caasp-container-manifests/gen-certs.sh Then docker rm -f And another docker rm -f for the container ID of the ldap server. Caasp-cli also supports the ?-k? option to ignore tls errors/validation and is one of the easier ways to use it. Thanks for pointing all of this out I just wanted to assure you that we?re aware of the bug and have already implemented a fix that will go out in the next public beta update (which will be a GMC build) and when you download the final 2.0 release this issue will not be present but yes; the CA will still be self signed (for now) and to ease your automation scripts it would be wise to trust the ca chain in any client machines you?re using as part of your ci/cd cycle. I know you?re planning to do some awesome cool things with caasp-cli and automation in ec2 etc and this is why we?re keen to support caasp-cli and the scripted way to access a cluster so the knowledge you?ve provided here I will add to our internal FAQ as well so it?s not ever forgotten about :) Thanks, Rob ----- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (P) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- From: on behalf of Liam McCafferty Date: Wednesday, 25 October 2017 at 17:18 To: "Ns, Rushi" , Paul Gonin Cc: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password HI All, Firstly its worth mentioning that I don't work for SUSE all details below are my own experiences all changes are not approved by SUSE. I also had the below issue however I managed to get it working and find out what caused it. (at least for me) I have been able to replicate this when I create a new nodes with the get hostname from DHCP option. There are 2 issues here firstly: You don't trust the internal CA of your kubernetes cluster this can lead to a certificate error when you run caasp CLI. and secondly: The caasp node seems to create a certificate BEFORE it updates its hostname from DHCP this leads to a correctly named caasp cluster however the certificate is valid for a machine with the name linux-${string} this causes an issue with dex talking to the openldap container and gives you an invalid password message ( when your password is indeed correct) ( I have not managed to see the certificate creation behaviour but I assume this is why the certificate mismatches the hostname) Firstly regarding the certificate you can ether pass the cert directly to caasp CLI or add the CA for your caasp node as an anchor. This certificate seems to be available on kubernetes master under /etc/pki/ca.crt regarding the invalid password option if you do a kubectl logs $DEX_POD -n kube-system you can see the logs I had the following inside my dex Logs. time="2017-10-18T13:10:14Z" level=info msg="config issuer: https://sotestkubebeta01.smartodds.co.uk:32000" time="2017-10-18T13:10:14Z" level=info msg="third party resource already created auth-code.oidc.coreos.com" time="2017-10-18T13:10:14Z" level=info msg="third party resource already created auth-request.oidc.coreos.com" time="2017-10-18T13:10:14Z" level=info msg="third party resource already created o-auth2-client.oidc.coreos.com" time="2017-10-18T13:10:14Z" level=info msg="third party resource already created signing-key.oidc.coreos.com" time="2017-10-18T13:10:14Z" level=info msg="third party resource already created refresh-token.oidc.coreos.com" time="2017-10-18T13:10:14Z" level=info msg="third party resource already created password.oidc.coreos.com" time="2017-10-18T13:10:14Z" level=info msg="third party resource already created offline-sessions.oidc.coreos.com" time="2017-10-18T13:10:14Z" level=info msg="third party resource already created connector.oidc.coreos.com" time="2017-10-18T13:10:14Z" level=info msg="config storage: kubernetes" time="2017-10-18T13:10:14Z" level=info msg="config static client: caasp-cli" time="2017-10-18T13:10:14Z" level=info msg="config connector: ldap" time="2017-10-18T13:10:14Z" level=info msg="config skipping approval screen" time="2017-10-18T13:10:14Z" level=info msg="listening (https) on 0.0.0.0:5556" time="2017-10-18T15:55:29Z" level=error msg="Failed to login user: start TLS failed: LDAP Result Code 200 \"\": TLS handshake failed (x509: certificate is valid for linux-4tbz, not sotestcaaspbeta01.smartodds.co.uk)" to resolve this I ended up changing SUSE dex.yaml to point the host parameter from sotestcaaspbeta01.smartodds.co.uk:389 to its ipaddress:389 as that is a valid name for my certificate. I then applied the config and deleted dex pods so it would respawn the containers with the new config. and I could successfully auth. time="2017-10-22T13:17:17Z" level=info msg="performing ldap search ou=People,dc=infra,dc=caasp,dc=local sub (&(objectClass=inetOrgPerson)(mail=liam.mccafferty at smartodds.co.uk))" connector=LDAP time="2017-10-22T13:17:17Z" level=info msg="username \"liam.mccafferty at smartodds.co.uk\" mapped to entry uid=mccaffertyl,ou=People,dc=infra,dc=caasp,dc=local" connector=LDAP time="2017-10-22T13:17:17Z" level=info msg="performing ldap search ou=Groups,dc=infra,dc=caasp,dc=local sub (&(objectClass=groupOfUniqueNames)(uniqueMember=uid=mccaffertyl,ou=People,dc=infra,dc=caasp,dc=local))" connector=LDAP time="2017-10-22T13:17:17Z" level=info msg="login successful: connector \"ldap\", username=\"liam \", email=\"liam.mccafferty at smartodds.co.uk\", groups=[\"it-admins\"]" From: caasp-beta-bounces at lists.suse.com on behalf of Ns, Rushi Sent: 11 October 2017 00:55 To: Paul Gonin Cc: caasp-beta at lists.suse.com Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi paul Here is my tests. I rebuild the cluster with 1 master 4 workers and I try to connect with caasp-cli , I get the same issues as earlier (forbidden) also not sure why it promoting the email address again though it was provided. caasp-cli login -s https://lvsusekub3.pal.sap.corp:6443 - u admin at sap.com -p Sap12345$ Enter your email address: admin at sap.com unable to find Dex service in CaaS Platform cluster, error was Get https://lvsusekub3.pal.sap.corp:6443/api/v1/namespaces/kube-system/services/dex: Forbidden I did some check with DEX and API responding ? https://10.48.164.142:6443/api/v1/namespaces/kube-system/services/dex { "kind": "Service", "apiVersion": "v1", "metadata": { "name": "dex", "namespace": "kube-system", "selfLink": "/api/v1/namespaces/kube-system/services/dex", "uid": "0e2f757e-ae13-11e7-8a17-005056aa0106", "resourceVersion": "355", "creationTimestamp": "2017-10-10T23:30:52Z", "annotations": { "kubectl.kubernetes.io/last-applied-configuration": "{\"apiVersion\":\"v1\",\"kind\":\"Service\",\"metadata\":{\"annotations\":{},\"name\":\"dex\",\"namespace\":\"kube-system\"},\"spec\":{\"ports\":[{\"name\":\"dex\",\"nodePort\":32000,\"port\":5556,\"protocol\":\"TCP\",\"targetPort\":5556}],\"selector\":{\"app\":\"dex\"},\"type\":\"NodePort\"}}\n" } }, "spec": { "ports": [ { "name": "dex", "protocol": "TCP", "port": 5556, "targetPort": 5556, "nodePort": 32000 } ], "selector": { "app": "dex" }, "clusterIP": "172.24.74.169", "type": "NodePort", "sessionAffinity": "None", "externalTrafficPolicy": "Cluster" }, "status": { "loadBalancer": {} } } also DEX PODS running as I logon to master node and ran the kubectl commands to verify, but I see that hostnames are not matching to my hostname as provided during install. kubectl get pods -o wide --all-namespaces |grep dex 2017-10-10 23:49:33.249844 I | proto: duplicate proto type registered: google.protobuf.Any 2017-10-10 23:49:33.249930 I | proto: duplicate proto type registered: google.protobuf.Duration 2017-10-10 23:49:33.249953 I | proto: duplicate proto type registered: google.protobuf.Timestamp kube-system dex-820878179-3bx27 1/1 Running 2 18m 172.16.16.2 c1b61fd0be894e9fb57a8ce950840dcb.infra.caasp.local kube-system dex-820878179-3plh8 1/1 Running 2 18m 172.16.16.4 c1b61fd0be894e9fb57a8ce950840dcb.infra.caasp.local kube-system dex-820878179-692zd 1/1 Running 2 18m 172.16.16.3 c1b61fd0be894e9fb57a8ce950840dcb.infra.caasp.local Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Wednesday, October 4, 2017 at 12:02 AM To: Rushi NS Cc: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rushi, Most of our tests were single master based, try first with only one master. Also you ardeploying on VMWare, is that correct ? I will try to reproduce your deployment configuration in our lab. thanks Paul Le mardi 03 octobre 2017 ? 19:28 +0000, Ns, Rushi a ?crit : I searched everynode and nothing found , I?m going to rebuild it to see if anything can make difference. Keep you posted. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Liam McCafferty Date: Tuesday, October 3, 2017 at 12:27 PM To: Rushi NS Cc: "rroland at suse.com" , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Actually I'm mistaken they run under the system namespace so -n kube-system should get you what you need Sent from Blue On 3 Oct 2017, at 8:24 pm, Liam McCafferty wrote: If I remember correctly dex runs on the cassp admin node. Any luck finding it there? Sent from Blue On 3 Oct 2017, at 7:45 pm, "Ns, Rushi" < rushi.ns at sap.com> wrote: Hi Robert, I don?t think bootstrap failed as the cluster completed without any errors and VELUM shows all active. Also on the master node, I see that dex.yaml and roles.yaml which all exist but not sure if the PODS running .. In a worst case I will try to rebuild the cluster to see if it works. By the way , in which node the DEX was running, I checked all my ndoes and I can?t find DEX running as POD ? lvsusekub5:~ # ls -ltr total 16 drwxr-xr-x 1 root root 0 Jun 27 08:59 bin drwxr-xr-x 1 root root 36 Sep 26 02:13 inst-sys -rw-r--r-- 1 root root 156 Sep 26 04:18 flannel-config.json -rw-r--r-- 1 root root 3034 Sep 26 04:19 dex.yaml -rw-r--r-- 1 root root 1161 Sep 26 04:19 roles.yaml -rw-r--r-- 1 root root 3295 Oct 3 18:37 kubeconfig Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Robert Roland Date: Tuesday, October 3, 2017 at 11:38 AM To: "caasp-beta at lists.suse.com" , "DElder at novacoast.com" , Rushi NS , Paul Gonin , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password That "Forbidden" error implies that your cluster bootstrap didn't complete successfully. Please submit a bug with a full supportconfig dump. Dex is set up by the bootstrap process. This error means that one of the steps in setting up Dex failed. Thanks, Rob >>> "Ns, Rushi" 10/03/17 11:16 AM >>> Hi Paul, Thank you . I have tried the same one with latest caasp-cli and the result is same. FYI, I setup 3 masters with 6 workers and I tried all 3 masters hostname one by one with the command line caasp-cli but nothing is really working. Do I have to setup any DEX container on the cluster ? or it does embedded part of it and why it is asking me DEX? caasp-cli login -s https://hostname:6443 -u rushi at id.com -p xxxxxx Error: unable to find Dex service in CaaS Platform cluster, error was Get https://hostname:6443/api/v1/namespaces/kube-system/services/dex: Forbidden Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, October 3, 2017 at 8:55 AM To: Rob de Canha-Knight , Rushi NS , "caasp-beta at lists.suse.com" , Dan Elder Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi, You need to check that between master node and admin node the port 389 is open - for example if you're using OpenStack you need the check that the security group is properly defined to allow this port rgds Paul Le mardi 03 octobre 2017 ? 15:17 +0000, Rob de Canha-Knight a ?crit : Rushi. The details I provided below on caasp-cli is how I?ve been using caasp-cli since day one. I?ve just tried again on a new cluster and running caasp-cli login -s https://master.caaspdemo.geeko.ninja:6443 -u rob.decanha-knight at suse.com -p mypassword Where ?u is the email address of the user I created during velum first startup/login. Worked fine for me. I don?t have any other documents to hand (other than the attached) around logging in so all I can personally suggest is to make sure you?re using https and port 6443 of the kubernetes master after -s. I?ve also attached the main bit of documentation we have around the caasp-cli client (which will make it?s way into the version 2 final release). I would suggest trying again from scratch with a new cluster instance of RC1 (including downloading and installing the updated caasp-cli client available from https://github.com/kubic-project/caasp-cli/releases as this one is working fine for me). Make a note of every command you are running and the output it provides and you can send those details to this list as at the moment the information in the thread is a bit scattered and I can?t tell accurately what?s going on or what?s being done by the user. Yes there are a lot of changes in this release mainly an updated k8s version and a feature much requested by customers (I remember during 1.0 betas you also requested for user management and this is how we?ve implemented it). I?ve also attached the details on how to create/manage additional user accounts through ldap as well as the caasp-cli guidance that we have. As one of our closest partners you also have the option of reaching out to your partner sales engineer/rep for your region and discussing it directly with them. They should be able to go onsite and help you if asked to get things up and running for your team. All the best, Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- From: "Ns, Rushi" Date: Tuesday, 3 October 2017 at 16:07 To: "caasp-beta at lists.suse.com" , Dan Elder , Rob de Canha-Knight Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Rob, Whatever you have mentioned is not really working in reality. Using CAASP-cli is not at all authenticating and I spent 2 days to find a way to connect to cluster. VELUM is fine, I can logon with registed email but nothing can be done after that such as installing kubernetes dashboard is not ? first of all need to know how to connect with CAASP-CLI because there is no users created other than VELUM web login which was registered. Can you provide some steps how you have doing with caasp-cli..i see lot of things changed on this new release. Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of Rob de Canha-Knight Date: Tuesday, October 3, 2017 at 6:57 AM To: Dan Elder , "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password Hi Dan. In the log you?ve provided you?re using the admin server for the ?s argument I believe. You must use https://:8443 as the address for the k8s master node (noting correct port and https). Please let us know how you get on. Rob ---- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (Fuze/VOIP) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- From: on behalf of Dan Elder Date: Tuesday, 3 October 2017 at 05:15 To: "caasp-beta at lists.suse.com" Subject: Re: [caasp-beta] [Newsletter] Re: RE : kubectl requires username and password I haven't had any luck authentication with caasp-cli unfortunately. The credentials I supply work fine for Velum but caasp-cli says they're invalid (output attached). Is there some log I can pull from the admin node or somewhere else to troubleshoot this? I've done 2 installs and gotten the same result both times. Thanks, Dan On 09/27/2017 08:04 AM, Paul Gonin wrote: Hi, It should be on the media so you can install it on the admin node It is installed by default on admin node. You can also get (currently) rpms for different openSUSE/SUSE flavors https://build.opensuse.org/repositories/devel:CaaSP:Head:ControllerNode/caasp-cli And there is also a windows Build from Rob https://github.com/rssfed23/caasp-cli-windows/releases Tested / works but not supported (yet, but I assume to come) Once you have caasp-cli export KUBECONFIG= (set KUBECONFIG=kubeconfig in windows cmd shell) caasp-cli login -u caasp-user -p caasp-password -s https://caasp.fqdn:6443 and then you can use kubectl as previously For caasp-user and caasp-password you can use caasp admin credentials. You can also create users in local ldap rgds Paul Le mercredi 27 septembre 2017 ? 14:52 +0000, Ns, Rushi a ?crit : Thanks, where can I download . I see from github I can?t download the link . https://github.com/kubic-project/caasp-cli Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: Paul Gonin Date: Tuesday, September 26, 2017 at 1:31 PM To: "caasp-beta at lists.suse.com" , Rushi NS Subject: RE : [caasp-beta] kubectl requires username and password Hi, With RC1, RBAC is available Consequence is that you have to use caasp-ctl to login to CaaSP and modify your kubectl and inject credentials in it. Rgds Paul -------- Message d'origine -------- De : "Ns, Rushi" Date : 26/09/2017 22:04 (GMT+01:00) ? : SUSE Beta Program , caasp-beta at lists.suse.com Objet : [caasp-beta] kubectl requires username and password >>> "Ns, Rushi" 09/26/2017 21:04 >>> Hi I setup new cluster with this release and everything worked. I have 3 masters/10 workers ..looks fine VELUM web page as well and I have downloaded kubeconfig and tried to do some workload test but issue with access cluster. I have issue with using KUBECTL command line ..whatever ?kubectl? I run requires permission. I setup velum with my userid email and password, I thought it requires that and I tried but its not ? I have also tried root (linux) master/workers but it doesn?t take that too? Does anyone know what is the issue. kubectl get cluster-info kubectl get nodes Please enter Username: rushi.ns at sap.com Please enter Password: ********* Error from server (Forbidden): User "system:anonymous" cannot list nodes at the cluster scope. (get nodes) kubectl get nodes Please enter Username: admin Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.18.0, 127.0.0.1, 172.16.18.1, 10.48.164.142, not 10.48.164.144 kubectl get nodes Please enter Username: root Please enter Password: ******** Unable to connect to the server: x509: certificate is valid for 172.24.0.1, 172.16.22.0, 127.0.0.1, 172.16.22.1, 10.48.164.141, not 10.48.164.144 Best Regards, Rushi. I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE From: on behalf of SUSE Beta Program Reply-To: SUSE Beta Program Date: Friday, September 22, 2017 at 7:48 AM To: "caasp-beta at lists.suse.com" Subject: [caasp-beta] [ANNOUNCE] SUSE Container as a Service Platform 2 RC 1 is available! Having trouble viewing this email? Please check the plain text version of it with your mailer. We are happy to announce SUSE CaaS Platform 2 Release Candidate 1! Download ? Please check out our dedicated SUSE CaaS Platform Beta web page, where you will find all the information needed around SUSE CaaS Platform Beta. What?s New with SUSE CaaS Platform 2 RC 1? K8s Multi-Master: Kubernetes Multi Master for building High-Availability clusters. caasp-cli: It's the new command line client for interacting with a CaaS Platform cluster. See for details. Dex: Dex is an identity service that uses OpenID Connect to drive authentication for other apps. See for details. OpenLDAP2: OpenLDAP2 running on an SLE12 container guest. Things to consider for this Beta? DHCP Your DHCP server should provide resolveable hostnames. If this is not the case like with libvirt/KVM, you should consider providing one yourself by appending this kernel parameter "hostname=HOSTNAME" during installation.However, the kubeconfig file downloaded from the Dashboard could contain an incorrect "server" hostname that should be replaced with the IP address of your Master. For more information read: https://en.opensuse.org/SDB:Linuxrc#Network_Configuration Autoyast/VMX-Images If you install via autoyast or one of the provided VMX beta images (KVM,Xen,VMware,...) please set a password or SSH key via cloud-init to be able to login. Release plan ? Release Notes ? Documentation ? Have fun beta testing!Your SUSE Linux Enterprise Team Please refer to our dedicated SUSE CaaSP Beta Program webpage for any general information. However, do not hesitate to contact us at beta-programs at lists.suse.com if you have any questions.You received this email because you're signed up to get updates from us. Click here to unsubscribe. _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -- Senior Engineer Linux Services Manager Novacoast, Inc. Mobile: (310) 243-6971 Office: (800) 949-9933 x1337 http://www.novacoast.com/ _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 540 Highgate Studios, 53-79 Highgate Road, London NW5 1TL ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 2960 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 1203 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image003.png Type: image/png Size: 793 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.png Type: image/png Size: 767 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image005.png Type: image/png Size: 759 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image006.png Type: image/png Size: 947 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image007.png Type: image/png Size: 805 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.png Type: image/png Size: 690 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5008 bytes Desc: not available URL: From David.Mace at smartodds.co.uk Thu Oct 26 04:16:44 2017 From: David.Mace at smartodds.co.uk (David Mace) Date: Thu, 26 Oct 2017 10:16:44 +0000 Subject: [caasp-beta] Micro OS NIC bonding Message-ID: <59b8f2afa39f42f6b4903bb803af3e91@soprodmail01.smartodds.co.uk> Hi, Is it supported to edit the autoyast.xml provided by the CaaSP admin node with NIC bonding settings. For example; EXAMPLE.COM false true yes mode=balance-alb miimon=100 nic1 nic2 bond0 dhcp auto yes none nic1 hotplug none nic2 hotplug And does the MicroOS support Autoyast pre-scripts? For example, we replace the "nic1" and "nic2" values above with a pre-script which detects the first two valid devices Cheers ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL From kukuk at suse.com Thu Oct 26 23:24:55 2017 From: kukuk at suse.com (Thorsten Kukuk) Date: Fri, 27 Oct 2017 07:24:55 +0200 Subject: [caasp-beta] Micro OS NIC bonding In-Reply-To: <59b8f2afa39f42f6b4903bb803af3e91@soprodmail01.smartodds.co.uk> References: <59b8f2afa39f42f6b4903bb803af3e91@soprodmail01.smartodds.co.uk> Message-ID: <20171027052455.GA26671@suse.com> Hi, On Thu, Oct 26, David Mace wrote: > Hi, > > Is it supported to edit the autoyast.xml provided by the CaaSP admin > node with NIC bonding settings. For example; Editing the autoyast.xml profile is allowed. If we support that depends on what the problem is, like with SLES. If an autoyast bug itself, we will support. If a problem with the customers autoyast profile, we will not support this. Bonding of NICs: if all needed tools are there, it is fine with us. If not, then this needs a feature request. > And does the MicroOS support Autoyast pre-scripts? For example, we > replace the "nic1" and "nic2" values above with a pre-script which > detects the first two valid devices We use already script sections in the default autoyast profile. If it is a first stage functionality, the script should be executed correctly. If not and it is a autoyast bug, we will fix it. If it is a problem with the script itself, we can of course not support that. If you choose an autoyast option, which exist or is executed only in the second stage of autoyast: since we don't have this, this is not supported. Thorsten -- Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & CaaSP SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany GF: Felix Imendoerffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nuernberg) From David.Mace at smartodds.co.uk Fri Oct 27 10:38:31 2017 From: David.Mace at smartodds.co.uk (David Mace) Date: Fri, 27 Oct 2017 16:38:31 +0000 Subject: [caasp-beta] Micro OS NIC bonding References: <59b8f2afa39f42f6b4903bb803af3e91@soprodmail01.smartodds.co.uk> <20171027052455.GA26671@suse.com> Message-ID: <5ade9beba54540e1ae5f6e6b21b31b37@soprodmail01.smartodds.co.uk> Hi Thorsten Having some issues; I provisioned a physical server using the autoyast.xml from the CaaS admin server and I also put those network bonding changes I detailed in the previous email. The CaaS worker node completed the installation OK and I was able to SSH from the admin server. I could see that the network bonding worked. The devices "em1" and "em2" were bonded to "bond0" I could ping the server from any host on the network The CaaS worker node appeared in the Velum UI and I was able to accept the host. However when I then tried to add it to the Kubernetes cluster this failed and showed the worker with a red cross in the Velum UI. I put the log "/var/log/messages" for the CaaS worker node in a gist here: https://gist.github.com/megamaced/4adaaeb42f4ca4f5bd937851b8d9ad5b I noticed this error in the log: salt-minion[2785]: [ERROR ] Interface eth0 not found. This suggests to me maybe eth0 is hard-coded somewhere in a Salt state? Obviously eth0 is very likely to be valid for a virtual machine, but in my experience physical machine network devices are more varied like "em1" or "p6p1" or in my case "bond0" Cheers David On 27/10/17 06:25, Thorsten Kukuk wrote: > Hi, > > On Thu, Oct 26, David Mace wrote: > >> Hi, >> >> Is it supported to edit the autoyast.xml provided by the CaaSP admin >> node with NIC bonding settings. For example; > Editing the autoyast.xml profile is allowed. If we support that depends > on what the problem is, like with SLES. If an autoyast bug itself, we > will support. If a problem with the customers autoyast profile, we will > not support this. > Bonding of NICs: if all needed tools are there, it is fine with us. > If not, then this needs a feature request. > >> And does the MicroOS support Autoyast pre-scripts? For example, we >> replace the "nic1" and "nic2" values above with a pre-script which >> detects the first two valid devices > We use already script sections in the default autoyast profile. > If it is a first stage functionality, the script should be executed > correctly. If not and it is a autoyast bug, we will fix it. If it > is a problem with the script itself, we can of course not support that. > If you choose an autoyast option, which exist or is executed only in > the second stage of autoyast: since we don't have this, this is not > supported. > > Thorsten > -- David Mace Senior Systems Architect Smartodds Limited. Unit 531 Highgate Studios 53-79 Highgate Road London NW5 1TL email: david.mace at smartodds.co.uk +44 (0)20 7482 9300 (tel) +44 (0)20 7482 3682 (fax) +44 (0)77 4339 7664 (mobile) ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL From kukuk at suse.com Fri Oct 27 10:54:25 2017 From: kukuk at suse.com (Thorsten Kukuk) Date: Fri, 27 Oct 2017 18:54:25 +0200 Subject: [caasp-beta] Micro OS NIC bonding In-Reply-To: <5ade9beba54540e1ae5f6e6b21b31b37@soprodmail01.smartodds.co.uk> References: <59b8f2afa39f42f6b4903bb803af3e91@soprodmail01.smartodds.co.uk> <20171027052455.GA26671@suse.com> <5ade9beba54540e1ae5f6e6b21b31b37@soprodmail01.smartodds.co.uk> Message-ID: <20171027165425.GA20356@suse.com> Hi David, On Fri, Oct 27, David Mace wrote: > This suggests to me maybe eth0 is hard-coded somewhere in a Salt state? Yes, it is. There is a bug for this and I think a fix. But I don't know if the fix made it into CaaSP v2.0. Thorsten -- Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & CaaSP SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany GF: Felix Imendoerffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nuernberg) From David.Mace at smartodds.co.uk Fri Oct 27 10:56:38 2017 From: David.Mace at smartodds.co.uk (David Mace) Date: Fri, 27 Oct 2017 16:56:38 +0000 Subject: [caasp-beta] Micro OS NIC bonding References: <59b8f2afa39f42f6b4903bb803af3e91@soprodmail01.smartodds.co.uk> <20171027052455.GA26671@suse.com> <5ade9beba54540e1ae5f6e6b21b31b37@soprodmail01.smartodds.co.uk> <20171027165425.GA20356@suse.com> Message-ID: Hi Thorsten Does this mean that CaaS will essentially not work on physical hardware currently (assuming network device is not eth0)? Is there any work around? Thanks David On 27/10/17 17:54, Thorsten Kukuk wrote: > Hi David, > > On Fri, Oct 27, David Mace wrote: > >> This suggests to me maybe eth0 is hard-coded somewhere in a Salt state? > Yes, it is. There is a bug for this and I think a fix. But I don't know > if the fix made it into CaaSP v2.0. > > Thorsten > -- David Mace Senior Systems Architect Smartodds Limited. Unit 531 Highgate Studios 53-79 Highgate Road London NW5 1TL email: david.mace at smartodds.co.uk +44 (0)20 7482 9300 (tel) +44 (0)20 7482 3682 (fax) +44 (0)77 4339 7664 (mobile) ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL From rob.decanha-knight at suse.com Fri Oct 27 11:13:50 2017 From: rob.decanha-knight at suse.com (Rob de Canha-Knight) Date: Fri, 27 Oct 2017 17:13:50 +0000 Subject: [caasp-beta] Micro OS NIC bonding In-Reply-To: References: <59b8f2afa39f42f6b4903bb803af3e91@soprodmail01.smartodds.co.uk> <20171027052455.GA26671@suse.com> <5ade9beba54540e1ae5f6e6b21b31b37@soprodmail01.smartodds.co.uk> <20171027165425.GA20356@suse.com> Message-ID: <89BC6190-7FFE-4326-9AF4-3079ED8B9849@suse.com> Hi David. We've got an internal bug for this already and it's been merged into our upstream code (https://github.com/kubic-project/salt/pull/250) So although this will not work on the public beta build you are using it will work okay with the 2.0 final release in November. Rob ----- Rob de Canha-Knight EMEA Platform and Management Technical Strategist SUSE rob.decanha-knight at suse.com (P) +44 (0) 1635 937689 (M) +44 (0) 7392 087303 (TW) rssfed23 ---- ? ? ?On 27/10/2017, 17:56, "caasp-beta-bounces at lists.suse.com on behalf of David Mace" wrote: Hi Thorsten Does this mean that CaaS will essentially not work on physical hardware currently (assuming network device is not eth0)? Is there any work around? Thanks David On 27/10/17 17:54, Thorsten Kukuk wrote: > Hi David, > > On Fri, Oct 27, David Mace wrote: > >> This suggests to me maybe eth0 is hard-coded somewhere in a Salt state? > Yes, it is. There is a bug for this and I think a fix. But I don't know > if the fix made it into CaaSP v2.0. > > Thorsten > -- David Mace Senior Systems Architect Smartodds Limited. Unit 531 Highgate Studios 53-79 Highgate Road London NW5 1TL email: david.mace at smartodds.co.uk +44 (0)20 7482 9300 (tel) +44 (0)20 7482 3682 (fax) +44 (0)77 4339 7664 (mobile) ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ This e-mail and any files transmitted with it are confidential and may be legally privileged. If you receive it in error or are not the intended recipient you must not copy, distribute or take any action in reliance upon it. Instead, please notify us immediately by telephoning +44 (20) 74820223 and delete the material from your systems. Smartodds is a business carried on by Smartodds Limited, a company registered with the Registrar of Companies for England and Wales with number 05108548. Registered office: Unit 531 Highgate Studios, 53-79 Highgate Road, London NW5 1TL _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5008 bytes Desc: not available URL: From paul.gonin at suse.com Tue Oct 31 07:33:33 2017 From: paul.gonin at suse.com (Paul Gonin) Date: Tue, 31 Oct 2017 14:33:33 +0100 Subject: [caasp-beta] BTRFS space and quota In-Reply-To: References: Message-ID: <1509456813.6297.45.camel@suse.com> Hi St?phane, Not that it should make a difference for the issue described, what version of CaaSP the cluster is running ?Is it CaaSP2 ? RC1 ? thanksPaul Le mardi 31 octobre 2017 ? 08:35 +0000, Le Bihan St?phane (AMUNDI-ITS) a ?crit : > Hello, > > We have a strange case on CAASP plateform with btrfs quota. > > For history, I was out of office since 3 weeks, but others colleague > test kubernetes plateform. > When I return, we ask me because FS is full on master and worker > nodes. > I don?t have cause, but I think with a bad config, subvolume > /var/lib/etcd grown and after correction reduce, though quota > reserved all space. > > When I check, I see btrfs usage and it?s really full, but balance as > no effect. > After search I see quota is activate, and subvolumes /var/lib/etcd > reserved 90% of space. But I don?t succeed to release this space. > > Can you help me for release space disk ? > > ? > On master : > > # btrfs filesystem usage / > Overall: > Device size: 30.00GiB > Device allocated: 29.99GiB > Device unallocated: 17.00MiB > Device missing: 0.00B > Used: 27.56GiB > Free (estimated): 504.93MiB (min: 496.43MiB) > Data ratio: 1.00 > Metadata ratio: 2.00 > Global reserve: 16.00MiB (used: 0.00B) > > Data,single: Size:27.97GiB, Used:27.49GiB > /dev/vda6 27.97GiB > > Metadata,DUP: Size:1.00GiB, Used:32.64MiB > /dev/vda6 2.00GiB > > System,DUP: Size:9.50MiB, Used:16.00KiB > /dev/vda6 19.00MiB > > Unallocated: > /dev/vda6 17.00MiB > > # btrfs fi df / > Data, single: total=27.97GiB, used=27.50GiB > System, DUP: total=9.50MiB, used=16.00KiB > Metadata, DUP: total=1.00GiB, used=32.66MiB > GlobalReserve, single: total=16.00MiB, used=0.00B > > # btrfs fi show / > Label: none uuid: 1b0614eb-fc59-4841-bbc5-5318087f6432 > Total devices 1 FS bytes used 27.53GiB > devid 1 size 30.00GiB used 29.99GiB path /dev/vda6 > > # btrfs subvolume list / > ID 257 gen 40 top level 5 path @ > ID 258 gen 194820 top level 257 path @/.snapshots > ID 259 gen 197128 top level 258 path @/.snapshots/1/snapshot > ID 260 gen 194810 top level 257 path @/boot/grub2/i386-pc > ID 261 gen 194810 top level 257 path @/boot/grub2/x86_64-efi > ID 262 gen 194810 top level 257 path @/cloud-init-config > ID 263 gen 194810 top level 257 path @/home > ID 264 gen 197081 top level 257 path @/root > ID 265 gen 197111 top level 257 path @/tmp > ID 266 gen 194809 top level 257 path @/var/cache > ID 267 gen 194809 top level 257 path @/var/crash > ID 268 gen 195783 top level 257 path @/var/lib/ca-certificates > ID 269 gen 195783 top level 257 path @/var/lib/cloud > ID 270 gen 24 top level 257 path @/var/lib/docker > ID 271 gen 194810 top level 257 path @/var/lib/dockershim > ID 272 gen 195719 top level 257 path @/var/lib/etcd > ID 273 gen 194810 top level 257 path @/var/lib/kubelet > ID 274 gen 194810 top level 257 path @/var/lib/machines > ID 275 gen 196430 top level 257 path @/var/lib/misc > ID 276 gen 194810 top level 257 path @/var/lib/mysql > ID 277 gen 194810 top level 257 path @/var/lib/nfs > ID 278 gen 194810 top level 257 path @/var/lib/ntp > ID 279 gen 196428 top level 257 path @/var/lib/overlay > ID 280 gen 194810 top level 257 path @/var/lib/rollback > ID 281 gen 196427 top level 257 path @/var/lib/systemd > ID 282 gen 194810 top level 257 path @/var/lib/vmware > ID 283 gen 194810 top level 257 path @/var/lib/wicked > ID 284 gen 197128 top level 257 path @/var/log > ID 285 gen 197111 top level 257 path @/var/spool > ID 286 gen 196428 top level 257 path @/var/tmp > > # btrfs qgroup show -pcreFf /var/lib/etcd > qgroupid rfer excl max_rfer max_excl parent > child > -------- ---- ---- -------- -------- ------ > ----- > 0/272 25.14GiB 25.14GiB none none --- > --- > > # du -sh /var/lib/etcd/ > 417M /var/lib/etcd/ > > ? > On one worker > > # btrfs fi usage / > Overall: > Device size: 30.00GiB > Device allocated: 30.00GiB > Device unallocated: 1.00MiB > Device missing: 0.00B > Used: 27.94GiB > Free (estimated): 135.28MiB (min: 135.28MiB) > Data ratio: 1.00 > Metadata ratio: 2.00 > Global reserve: 16.00MiB (used: 0.00B) > > Data,single: Size:27.99GiB, Used:27.86GiB > /dev/vda6 27.99GiB > > Metadata,DUP: Size:1.00GiB, Used:43.44MiB > /dev/vda6 2.00GiB > > System,DUP: Size:8.00MiB, Used:16.00KiB > /dev/vda6 16.00MiB > > Unallocated: > /dev/vda6 1.00MiB > > # btrfs fi df / > Data, single: total=27.99GiB, used=27.86GiB > System, DUP: total=8.00MiB, used=16.00KiB > Metadata, DUP: total=1.00GiB, used=43.44MiB > GlobalReserve, single: total=16.00MiB, used=0.00B > > # btrfs fi show / > Label: none uuid: 1d7b76f8-f91c-47e0-8be2-a3f02f90ac96 > Total devices 1 FS bytes used 27.90GiB > devid 1 size 30.00GiB used 30.00GiB path /dev/vda6 > > # btrfs qgroup show -pcreFf /var/lib/etcd > qgroupid rfer excl max_rfer max_excl parent > child > -------- ---- ---- -------- -------- ------ > ----- > 0/272 20.99GiB 20.99GiB none none --- > --- > > # du -sh /var/lib/etcd/ > 452M /var/lib/etcd/ > > Regards, > > > > > > > > > > > St?phane Le Bihan > > > > > SDE/DSI/IPR/SSD/UNX > > > > > 90, Boulevard Pasteur - 75015 Paris > > > > > Web: > http://www.amundi.com > > > > > T?l: +33 1 76 32 32 08 > Equipe Unix : +33 1 76 32 02 30 > > > > > @: > stephane.lebihan at amundi.com > @ : > sits.unix at amundi.com > > > > > > > > > > > _______________________________________________ > caasp-beta mailing list > caasp-beta at lists.suse.com > http://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.gif Type: image/gif Size: 2430 bytes Desc: not available URL: From stephane.lebihan at amundi.com Tue Oct 31 07:38:10 2017 From: stephane.lebihan at amundi.com (=?utf-8?B?TGUgQmloYW4gU3TDqXBoYW5lIChBTVVOREktSVRTKQ==?=) Date: Tue, 31 Oct 2017 13:38:10 +0000 Subject: [caasp-beta] BTRFS space and quota In-Reply-To: <1509456813.6297.45.camel@suse.com> References: <1509456813.6297.45.camel@suse.com> Message-ID: Hi Paul, We work with CaaSP2. Regards, [cid:image001.gif at 01D35255.DF7F3530] St?phane Le Bihan SDE/DSI/IPR/SSD/UNX 90, Boulevard Pasteur - 75015 Paris Web: http://www.amundi.com T?l: +33 1 76 32 32 08 Equipe Unix : +33 1 76 32 02 30 @: stephane.lebihan at amundi.com @ : sits.unix at amundi.com De : Paul Gonin [mailto:paul.gonin at suse.com] Envoy? : mardi 31 octobre 2017 14:34 ? : Le Bihan St?phane (AMUNDI-ITS); caasp-beta at lists.suse.com Objet : Re: [caasp-beta] BTRFS space and quota Hi St?phane, Not that it should make a difference for the issue described, what version of CaaSP the cluster is running ? Is it CaaSP2 ? RC1 ? thanks Paul Le mardi 31 octobre 2017 ? 08:35 +0000, Le Bihan St?phane (AMUNDI-ITS) a ?crit : Hello, We have a strange case on CAASP plateform with btrfs quota. For history, I was out of office since 3 weeks, but others colleague test kubernetes plateform. When I return, we ask me because FS is full on master and worker nodes. I don?t have cause, but I think with a bad config, subvolume /var/lib/etcd grown and after correction reduce, though quota reserved all space. When I check, I see btrfs usage and it?s really full, but balance as no effect. After search I see quota is activate, and subvolumes /var/lib/etcd reserved 90% of space. But I don?t succeed to release this space. Can you help me for release space disk ? ? On master : # btrfs filesystem usage / Overall: Device size: 30.00GiB Device allocated: 29.99GiB Device unallocated: 17.00MiB Device missing: 0.00B Used: 27.56GiB Free (estimated): 504.93MiB (min: 496.43MiB) Data ratio: 1.00 Metadata ratio: 2.00 Global reserve: 16.00MiB (used: 0.00B) Data,single: Size:27.97GiB, Used:27.49GiB /dev/vda6 27.97GiB Metadata,DUP: Size:1.00GiB, Used:32.64MiB /dev/vda6 2.00GiB System,DUP: Size:9.50MiB, Used:16.00KiB /dev/vda6 19.00MiB Unallocated: /dev/vda6 17.00MiB # btrfs fi df / Data, single: total=27.97GiB, used=27.50GiB System, DUP: total=9.50MiB, used=16.00KiB Metadata, DUP: total=1.00GiB, used=32.66MiB GlobalReserve, single: total=16.00MiB, used=0.00B # btrfs fi show / Label: none uuid: 1b0614eb-fc59-4841-bbc5-5318087f6432 Total devices 1 FS bytes used 27.53GiB devid 1 size 30.00GiB used 29.99GiB path /dev/vda6 # btrfs subvolume list / ID 257 gen 40 top level 5 path @ ID 258 gen 194820 top level 257 path @/.snapshots ID 259 gen 197128 top level 258 path @/.snapshots/1/snapshot ID 260 gen 194810 top level 257 path @/boot/grub2/i386-pc ID 261 gen 194810 top level 257 path @/boot/grub2/x86_64-efi ID 262 gen 194810 top level 257 path @/cloud-init-config ID 263 gen 194810 top level 257 path @/home ID 264 gen 197081 top level 257 path @/root ID 265 gen 197111 top level 257 path @/tmp ID 266 gen 194809 top level 257 path @/var/cache ID 267 gen 194809 top level 257 path @/var/crash ID 268 gen 195783 top level 257 path @/var/lib/ca-certificates ID 269 gen 195783 top level 257 path @/var/lib/cloud ID 270 gen 24 top level 257 path @/var/lib/docker ID 271 gen 194810 top level 257 path @/var/lib/dockershim ID 272 gen 195719 top level 257 path @/var/lib/etcd ID 273 gen 194810 top level 257 path @/var/lib/kubelet ID 274 gen 194810 top level 257 path @/var/lib/machines ID 275 gen 196430 top level 257 path @/var/lib/misc ID 276 gen 194810 top level 257 path @/var/lib/mysql ID 277 gen 194810 top level 257 path @/var/lib/nfs ID 278 gen 194810 top level 257 path @/var/lib/ntp ID 279 gen 196428 top level 257 path @/var/lib/overlay ID 280 gen 194810 top level 257 path @/var/lib/rollback ID 281 gen 196427 top level 257 path @/var/lib/systemd ID 282 gen 194810 top level 257 path @/var/lib/vmware ID 283 gen 194810 top level 257 path @/var/lib/wicked ID 284 gen 197128 top level 257 path @/var/log ID 285 gen 197111 top level 257 path @/var/spool ID 286 gen 196428 top level 257 path @/var/tmp # btrfs qgroup show -pcreFf /var/lib/etcd qgroupid rfer excl max_rfer max_excl parent child -------- ---- ---- -------- -------- ------ ----- 0/272 25.14GiB 25.14GiB none none --- --- # du -sh /var/lib/etcd/ 417M /var/lib/etcd/ ? On one worker # btrfs fi usage / Overall: Device size: 30.00GiB Device allocated: 30.00GiB Device unallocated: 1.00MiB Device missing: 0.00B Used: 27.94GiB Free (estimated): 135.28MiB (min: 135.28MiB) Data ratio: 1.00 Metadata ratio: 2.00 Global reserve: 16.00MiB (used: 0.00B) Data,single: Size:27.99GiB, Used:27.86GiB /dev/vda6 27.99GiB Metadata,DUP: Size:1.00GiB, Used:43.44MiB /dev/vda6 2.00GiB System,DUP: Size:8.00MiB, Used:16.00KiB /dev/vda6 16.00MiB Unallocated: /dev/vda6 1.00MiB # btrfs fi df / Data, single: total=27.99GiB, used=27.86GiB System, DUP: total=8.00MiB, used=16.00KiB Metadata, DUP: total=1.00GiB, used=43.44MiB GlobalReserve, single: total=16.00MiB, used=0.00B # btrfs fi show / Label: none uuid: 1d7b76f8-f91c-47e0-8be2-a3f02f90ac96 Total devices 1 FS bytes used 27.90GiB devid 1 size 30.00GiB used 30.00GiB path /dev/vda6 # btrfs qgroup show -pcreFf /var/lib/etcd qgroupid rfer excl max_rfer max_excl parent child -------- ---- ---- -------- -------- ------ ----- 0/272 20.99GiB 20.99GiB none none --- --- # du -sh /var/lib/etcd/ 452M /var/lib/etcd/ Regards, [cid:image001.gif at 01D35255.DF7F3530] St?phane Le Bihan SDE/DSI/IPR/SSD/UNX 90, Boulevard Pasteur - 75015 Paris Web: http://www.amundi.com T?l: +33 1 76 32 32 08 Equipe Unix : +33 1 76 32 02 30 @: stephane.lebihan at amundi.com @ : sits.unix at amundi.com _______________________________________________ caasp-beta mailing list caasp-beta at lists.suse.com http://lists.suse.com/mailman/listinfo/caasp-beta -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.gif Type: image/gif Size: 2430 bytes Desc: image001.gif URL: