<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns:mv="http://macVmlSchemaUri" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Title" content="">
<meta name="Keywords" content="">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Arial;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman";}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:Calibri;
color:windowtext;}
span.msoIns
{mso-style-type:export-only;
mso-style-name:"";
text-decoration:underline;
color:teal;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body bgcolor="white" lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri">Hi Alejandro,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri">Good but more issues (kubernetes dashboard issue “unauthorized”) . Did you encounter any issues with kubernetes dashboard ? I get unauthorized when I browse
<a href="https://lvcaasmaster:6443/ui">https://lvcaasmaster:6443/ui</a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri">I was looking seems the certificates seems either missing ?
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri">Aslo were you able to deploy any applications. I tried a simple one and its not getting deployed ?? keep looking more, but let me know if you have done and how you did , so that I can
check.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri">For that particular issue as you asked it was the file “kubelet” on every minion to add the FQDN or IP address of the minion host.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri;background:yellow;mso-highlight:yellow">KUBELET_HOSTNAME="lvcaasnode1"</span><span style="font-size:16.0pt;font-family:Calibri"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:14.0pt;font-family:Verdana;color:#00006C">Best Regards,</span><span style="font-size:16.0pt"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:14.0pt;font-family:Calibri"> </span><span style="font-size:16.0pt"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:14.0pt;font-family:Verdana;color:#00006C">Rushi.</span><span style="font-size:16.0pt"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:Verdana;color:#FC4F08">I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE</span><o:p></o:p></p>
</div>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:16.0pt;font-family:Calibri"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-family:Calibri;color:black">From: </span>
</b><span style="font-family:Calibri;color:black">Alejandro Bonilla <abonilla@suse.com><br>
<b>Date: </b>Saturday, April 1, 2017 at 8:29 PM<br>
<b>To: </b>"Ns, Rushi" <rushi.ns@sap.com><br>
<b>Cc: </b>"caasp-beta@lists.suse.com" <caasp-beta@lists.suse.com><br>
<b>Subject: </b>Re: [caasp-beta] caasp-beta<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Hi Rushi, <o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Great news.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">So the certificate problem perhaps was a time mismatch of the validity due to a NTP time that is now acceptable. Then I wonder what names were in the kubelet file vs the correct hostname? Is it 'linux' or where does the mismatch come from?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Thanks for the updates...<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Apr 1, 2017 11:15 PM, " Ns, Rushi " <rushi.ns@sap.com> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p style="background:white"><span style="font-size:16.0pt;font-family:Calibri">Ok “kubectl get nodes” empty issue too fixed.
</span><o:p></o:p></p>
<p style="background:white"><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p style="background:white"><span style="font-size:16.0pt;font-family:Calibri">Basically every minion host in file </span><span style="font-size:18.0pt;font-family:Consolas;color:#242729;border:none windowtext 1.0pt;padding:0in;background:#EFF0F1">/etc/kubernetes/kubelet
value</span><span style="font-size:18.0pt;font-family:Arial;color:#242729"> </span><span style="font-size:11.5pt;font-family:Arial;color:#242729;background:yellow">didn't match the hostname , so I had to add the hostname of the minion FQDN and restar the
services.</span><o:p></o:p></p>
<p style="background:white"><span style="font-size:11.5pt;font-family:Arial;color:#242729"> </span><o:p></o:p></p>
<p style="background:white"><span style="font-size:11.5pt;font-family:Arial;color:#242729"> </span><o:p></o:p></p>
<p style="background:white"><span style="font-size:11.5pt;font-family:Arial;color:#242729;background:yellow">Now I get all my minions.</span><o:p></o:p></p>
<p style="background:white"><span style="font-size:11.5pt;font-family:Arial;color:#242729;background:yellow"> </span><o:p></o:p></p>
<p style="background:white"><span style="font-size:11.5pt;font-family:Arial;color:#242729;background:yellow">PALM00635056A:.kube i811144$ kubectl get nodes</span><o:p></o:p></p>
<p style="background:white"><span style="font-size:11.5pt;font-family:Arial;color:#242729;background:yellow">NAME STATUS AGE</span><o:p></o:p></p>
<p style="background:white"><span style="font-size:11.5pt;font-family:Arial;color:#242729;background:yellow">lvcaasnode1 Ready 13m</span><o:p></o:p></p>
<p style="background:white"><span style="font-size:11.5pt;font-family:Arial;color:#242729;background:yellow">lvcaasnode2 Ready 5m</span><o:p></o:p></p>
<p style="background:white"><span style="font-size:11.5pt;font-family:Arial;color:#242729;background:yellow">lvcaasnode3 Ready 2m</span><o:p></o:p></p>
<p style="background:white"><span style="font-size:11.5pt;font-family:Arial;color:#242729;background:yellow">lvcaasnode4 Ready 1m</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#00006C">Best Regards,</span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#00006C">Rushi.</span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#FC4F08">I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p><b><span style="font-family:Calibri;color:black">From: </span></b><span style="font-family:Calibri;color:black">"Ns, Rushi" <rushi.ns@sap.com><br>
<b>Date: </b>Saturday, April 1, 2017 at 6:13 PM<br>
<b>To: </b>Alejandro Bonilla <abonilla@suse.com><br>
<b>Cc: </b>"caasp-beta@lists.suse.com" <caasp-beta@lists.suse.com><br>
<b>Subject: </b>Re: [caasp-beta] caasp-beta</span><o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<div>
<p><span style="font-size:16.0pt;font-family:Calibri">Hi Alejandro,</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri">Ok this one too fixed. </span>
<o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri">Now Kubectl works with cluster-info but I don’t see any nodes , however in my setup we had 4 minions , so I expected to have the output with 4 nodes but its empty?</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri">PALM00635056A:.kube i811144$ kubectl cluster-info</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri;background:yellow">Kubernetes master is running at https://lvcaasmaster:6443</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri">To further debug and diagnose cluster problems, use 'kubectl cluster-info dump'.</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri;color:red">PALM00635056A:.kube i811144$ kubectl get nodes</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri;color:red">Nothing</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<div>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#00006C">Best Regards,</span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#00006C">Rushi.</span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#FC4F08">I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE</span><o:p></o:p></p>
</div>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p><b><span style="font-family:Calibri;color:black">From: </span></b><span style="font-family:Calibri;color:black">"Ns, Rushi" <rushi.ns@sap.com><br>
<b>Date: </b>Saturday, April 1, 2017 at 6:05 PM<br>
<b>To: </b>Alejandro Bonilla <abonilla@suse.com><br>
<b>Cc: </b>"caasp-beta@lists.suse.com" <caasp-beta@lists.suse.com><br>
<b>Subject: </b>Re: [caasp-beta] caasp-beta</span><o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<div>
<p><span style="font-size:16.0pt;font-family:Calibri">Hi Alejandro,</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri">Ok I have fixed it, I think it was due NTP issue. Ok its created.</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri">Now I get the certificates error after downloading the kubectl config.</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri">$ kubectl get nodes</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri">Unable to connect to the server: x509: certificate is valid for lvcaasmaster.pal.sap.corp, kubernetes.default.svc.cluster.local, not lvcaasmaster</span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"><img border="0" width="1737" height="778" id="_x0000_i1025" src="cid:image001.png@01D2AB24.9C6542E0"></span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<div>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#00006C">Best Regards,</span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#00006C">Rushi.</span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#FC4F08">I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE</span><o:p></o:p></p>
</div>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt;font-family:Calibri"> </span><o:p></o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p><b><span style="font-family:Calibri;color:black">From: </span></b><span style="font-family:Calibri;color:black">"Ns, Rushi" <rushi.ns@sap.com><br>
<b>Date: </b>Saturday, April 1, 2017 at 11:40 AM<br>
<b>To: </b>Alejandro Bonilla <abonilla@suse.com><br>
<b>Cc: </b>"caasp-beta@lists.suse.com" <caasp-beta@lists.suse.com><br>
<b>Subject: </b>Re: [caasp-beta] caasp-beta</span><o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<div>
<div>
<p>Hi Alejandro,<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p style="margin-bottom:12.0pt">Thank you. For my setup I have proper DNS of hostname and I pretty much did as you did and I didnt hit any issues until the bootstrap cluster , the bootstrap cluster is running errors what I sent you in my first response ,,<br>
Do you have time to go over on share screen I can show and see if we can fix this together <br>
<br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p>Best Regards,<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>Rushi.<o:p></o:p></p>
</div>
</blockquote>
<p>Success is not a matter of being the best & winning the race. Success is a matter of handling the worst & finishing the race
<o:p></o:p></p>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<div>
<p>Sent from my iPhone <o:p></o:p></p>
<div>
<p>please excuse typos and brevity<o:p></o:p></p>
</div>
</div>
</div>
</div>
<div>
<p style="margin-bottom:12.0pt"><br>
On Apr 1, 2017, at 10:59, Alejandro Bonilla <<a href="mailto:abonilla@suse.com">abonilla@suse.com</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p>Hi Rushi, <o:p></o:p></p>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>I think the autoyast expects all nodes IP/DNS proper resolution. I did not use that in my first install because I don't have a setup with proper DNS...<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>I deployed successfully and quite quickly by<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>- Created 4 VMs<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>- Each booted by DVD1<o:p></o:p></p>
</div>
<div>
<p>- - One was named admin for the Dashboard installer. I changed the 'linux' hostname at the 'Network' section as one would with yast lan under Hostname while on the installer. Used the Dashboard role, if I recall correctly the name of that role.<o:p></o:p></p>
</div>
<div>
<p>- - Did the same with master, worker1, worker2 and set them all as the worker role. Specified the admin IP as the controller.<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>- before installing the master and worker nodes, I finished the admin install and waited for it to boot up, it takes 10 seconds after the login prompt for the web Interface to be available.<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>- Finished the master, workers install, they quickly showed up in the Dashboard, selected master as the, well... master.<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>Deployment finished in less than 5 minutes.<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>On my laptop:<o:p></o:p></p>
</div>
<div>
<p>Downloaded kubeconfig, then installed<o:p></o:p></p>
</div>
<div>
<p>kubernetes-client and kubernetes-common (I used them from <a href="http://software.opensuse.org">
software.opensuse.org</a>, but there may be a more official installer.)<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>Edit kubeconfig to ensure the master address is correct, vs a non-resolvable DN entry.<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>mkdir ~/.kube<o:p></o:p></p>
</div>
<div>
<p>cp kubeconfig ~/.kube/config<o:p></o:p></p>
</div>
<div>
<p> <o:p></o:p></p>
</div>
<div>
<p>Use kubectl :-)<o:p></o:p></p>
</div>
</div>
<div>
<p> <o:p></o:p></p>
<div>
<p>On Mar 31, 2017 11:22 PM, "Ns, Rushi" <<a href="mailto:rushi.ns@sap.com">rushi.ns@sap.com</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p><span style="font-size:16.0pt">Here is my beta test results.</span><o:p></o:p></p>
<p><span style="font-size:16.0pt"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I setup total 5 systems (1 controller, 1 master, 3 workers)
</span><o:p></o:p></p>
<p><span style="font-size:16.0pt"> </span><o:p></o:p></p>
<p style="text-indent:-.25in"><span style="font-size:16.0pt">1)</span><span style="font-size:7.0pt">
</span><span style="font-size:16.0pt">Setup controller works fast and very quick too.</span><o:p></o:p></p>
<p style="text-indent:-.25in"><span style="font-size:16.0pt">2)</span><span style="font-size:7.0pt">
</span><span style="font-size:16.0pt">Bootstrap nodes with autoyast worked and as well manual install by selecting nodes by specifying the controller IP worked.</span><o:p></o:p></p>
<p style="text-indent:-.25in"><span style="font-size:16.0pt">3)</span><span style="font-size:7.0pt">
</span><span style="font-size:16.0pt">Install cluster with selection ran several hours and I see the following
</span><o:p></o:p></p>
<p><span style="font-size:16.0pt"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt">Any other tools to see whats happening other than kubelet commands I used here.
</span><o:p></o:p></p>
<p><span style="font-size:16.0pt"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt">lvcaasadmin:/var/lib # kubelet list</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.465609 8571 feature_gate.go:189] feature gates: map[]</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">W0401 03:58:17.465761 8571 server.go:400] No API client: no api servers specified</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.465852 8571 docker.go:356] Connecting to docker on unix:///var/run/docker.sock</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.465893 8571 docker.go:376] Start docker client with request timeout=2m0s</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">E0401 03:58:17.467067 8571 cni.go:163] error updating cni config: No networks found in /etc/cni/net.d</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.475120 8571 manager.go:143] cAdvisor running in container: "/user.slice"</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">W0401 03:58:17.481167 8571 manager.go:151] unable to connect to Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp [::1]:15441: getsockopt: connection refused</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.487164 8571 fs.go:117] Filesystem partitions: map[/dev/sda2:{mountpoint:/var/lib/docker/btrfs major:0 minor:34 fsType:btrfs blockSize:0}]</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.489428 8571 manager.go:198] Machine: {NumCores:4 CpuFrequency:2297339 MemoryCapacity:33553862656 MachineID:026dbed750d34678baa318a927beb43c SystemUUID:4212E894-D404-BC7E-12C1-104406FAC1AF BootID:4fca4f86-b8df-40aa-9a52-9f32d82a65c6
Filesystems:[{Device:/dev/sda2 Capacity:105219358720 Type:vfs Inodes:0 HasInodes:true}] DiskMap:map[2:0:{Name:fd0 Major:2 Minor:0 Size:4096 Scheduler:cfq} 8:0:{Name:sda Major:8 Minor:0 Size:107374182400 Scheduler:cfq}] NetworkDevices:[{Name:eth0 MacAddress:00:50:56:92:78:da
Speed:10000 Mtu:1500}] Topology:[{Id:0 Memory:33553862656 Cores:[{Id:0 Threads:[0] Caches:[]} {Id:1 Threads:[1] Caches:[]}] Caches:[{Size:41943040 Type:Unified Level:3}]} {Id:1 Memory:0 Cores:[{Id:0 Threads:[2] Caches:[]} {Id:1 Threads:[3] Caches:[]}] Caches:[{Size:41943040
Type:Unified Level:3}]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.490209 8571 manager.go:204] Version: {KernelVersion:4.4.52-1-default ContainerOsVersion:SUSE Container as a Service Platform 1.0 DockerVersion:1.12.6 CadvisorVersion: CadvisorRevision:}</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.491582 8571 cadvisor_linux.go:152] Failed to register cAdvisor on port 4194, retrying. Error: listen tcp :4194: bind: address already in use</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">W0401 03:58:17.494066 8571 container_manager_linux.go:205] Running with swap on is not supported, please disable swap! This will be a fatal error by default starting in K8s v1.6! In the meantime, you can opt-in to making
this a fatal error by enabling --experimental-fail-swap-on.</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">W0401 03:58:17.494326 8571 server.go:669] No api server defined - no events will be sent to API server.</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">W0401 03:58:17.497638 8571 kubelet_network.go:69] Hairpin mode set to "promiscuous-bridge" but kubenet is not enabled, falling back to "hairpin-veth"</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.497694 8571 kubelet.go:477] Hairpin mode set to "hairpin-veth"</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.504274 8571 docker_manager.go:256] Setting dockerRoot to /var/lib/docker</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.504311 8571 docker_manager.go:259] Setting cgroupDriver to cgroupfs</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.506297 8571 server.go:770] Started kubelet v1.5.3</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">W0401 03:58:17.506331 8571 kubelet.go:1224] No api server defined - no node status update will be sent.</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">E0401 03:58:17.506400 8571 server.go:481] Starting health server failed: listen tcp 127.0.0.1:10248: bind: address already in use</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">E0401 03:58:17.506382 8571 kubelet.go:1145] Image garbage collection failed: unable to find data for container /</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.506527 8571 server.go:123] Starting to listen on 0.0.0.0:10250</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">I0401 03:58:17.506647 8571 kubelet_node_status.go:204] Setting node annotation to enable volume controller attach/detach</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">F0401 03:58:17.509424 8571 server.go:148] listen tcp 0.0.0.0:10255: bind: address already in use</span><o:p></o:p></p>
<p><span style="font-size:16.0pt"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt"><img border="0" width="1777" height="770" id="_x0000_i1026" src="cid:image002.png@01D2AB24.9C6542E0"></span><o:p></o:p></p>
<p><span style="font-size:16.0pt"><img border="0" width="1608" height="627" id="_x0000_i1027" src="cid:image003.png@01D2AB24.9C6542E0"></span><o:p></o:p></p>
<p><span style="font-size:16.0pt"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt">from messages I see the following.</span><o:p></o:p></p>
<p><span style="font-size:16.0pt"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt"> </span><o:p></o:p></p>
<p><span style="font-size:16.0pt">event.go:208] Unable to write event: 'Post <a href="http://127.0.0.1:8080/api/v1/namespaces/default/events:">
http://127.0.0.1:8080/api/v1/namespaces/default/events:</a> dial tcp 127.0.0.1:8080: getsockopt: connection refused' (may retry after sleeping)</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">2017-04-01T04:01:57.375925+00:00 lvcaasadmin hyperkube[2651]: E0401 04:01:57.375830 2651 reflector.go:188] pkg/kubelet/kubelet.go:378: Failed to list *api.Service: Get
<a href="http://127.0.0.1:8080/api/v1/services?resourceVersion=0:">http://127.0.0.1:8080/api/v1/services?resourceVersion=0:</a> dial tcp 127.0.0.1:8080: getsockopt: connection refused</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">2017-04-01T04:01:57.443964+00:00 lvcaasadmin hyperkube[2651]: E0401 04:01:57.443871 2651 reflector.go:188] pkg/kubelet/config/apiserver.go:44: Failed to list *api.Pod: Get
<a href="http://127.0.0.1:8080/api/v1/pods?fieldSelector=spec.nodeName%3D127.0.0.1&resourceVersion=0:">
http://127.0.0.1:8080/api/v1/pods?fieldSelector=spec.nodeName%3D127.0.0.1&resourceVersion=0:</a> dial tcp 127.0.0.1:8080: getsockopt: connection refused</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">2017-04-01T04:01:57.444895+00:00 lvcaasadmin hyperkube[2651]: E0401 04:01:57.444801 2651 reflector.go:188] pkg/kubelet/kubelet.go:386: Failed to list *api.Node: Get
<a href="http://127.0.0.1:8080/api/v1/nodes?fieldSelector=metadata.name%3D127.0.0.1&resourceVersion=0:">
http://127.0.0.1:8080/api/v1/nodes?fieldSelector=metadata.name%3D127.0.0.1&resourceVersion=0:</a> dial tcp 127.0.0.1:8080: getsockopt: connection refused</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">2017-04-01T04:01:58.376648+00:00 lvcaasadmin hyperkube[2651]: E0401 04:01:58.376550 2651 reflector.go:188] pkg/kubelet/kubelet.go:378: Failed to list *api.Service: Get
<a href="http://127.0.0.1:8080/api/v1/services?resourceVersion=0:">http://127.0.0.1:8080/api/v1/services?resourceVersion=0:</a> dial tcp 127.0.0.1:8080: getsockopt: connection refused</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">2017-04-01T04:01:58.444697+00:00 lvcaasadmin hyperkube[2651]: E0401 04:01:58.444601 2651 reflector.go:188] pkg/kubelet/config/apiserver.go:44: Failed to list *api.Pod: Get
<a href="http://127.0.0.1:8080/api/v1/pods?fieldSelector=spec.nodeName%3D127.0.0.1&resourceVersion=0:">
http://127.0.0.1:8080/api/v1/pods?fieldSelector=spec.nodeName%3D127.0.0.1&resourceVersion=0:</a> dial tcp 127.0.0.1:8080: getsockopt: connection refused</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">2017-04-01T04:01:58.446107+00:00 lvcaasadmin hyperkube[2651]: E0401 04:01:58.446008 2651 reflector.go:188] pkg/kubelet/kubelet.go:386: Failed to list *api.Node: Get
<a href="http://127.0.0.1:8080/api/v1/nodes?fieldSelector=metadata.name%3D127.0.0.1&resourceVersion=0:">
http://127.0.0.1:8080/api/v1/nodes?fieldSelector=metadata.name%3D127.0.0.1&resourceVersion=0:</a> dial tcp 127.0.0.1:8080: getsockopt: connection refused</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">2017-04-01T04:01:59.377433+00:00 lvcaasadmin hyperkube[2651]: E0401 04:01:59.377325 2651 reflector.go:188] pkg/kubelet/kubelet.go:378: Failed to list *api.Service: Get
<a href="http://127.0.0.1:8080/api/v1/services?resourceVersion=0:">http://127.0.0.1:8080/api/v1/services?resourceVersion=0:</a> dial tcp 127.0.0.1:8080: getsockopt: connection refused</span><o:p></o:p></p>
<p><span style="font-size:16.0pt">2017-04-01T04:01:59.445470+00:00 lvcaasadmin hyperkube[2651]: E0401 04:01:59.445336 2651 reflector.go:188] pkg/kubelet/config/apiserver.go:44: F</span><o:p></o:p></p>
<p><span style="font-size:16.0pt"> </span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#00006C">Best Regards,</span><o:p></o:p></p>
<p><span style="font-size:14.0pt"> </span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#00006C">Rushi.</span><o:p></o:p></p>
<p><span style="font-size:14.0pt;font-family:Verdana;color:#FC4F08">I MAY BE ONLY ONE PERSON, BUT I CAN BE ONE PERSON WHO MAKES A DIFFERENCE</span><o:p></o:p></p>
<p> <o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<p> <o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>