<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:DengXian;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Monaco;
panose-1:0 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"\@DengXian";
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:"\@SimSun";
panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Calibri",sans-serif;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
p.p1, li.p1, div.p1
{mso-style-name:p1;
margin:0cm;
margin-bottom:.0001pt;
background:#0C0503;
font-size:9.0pt;
font-family:Monaco;
color:#F4F4F4;}
p.p2, li.p2, div.p2
{mso-style-name:p2;
margin:0cm;
margin-bottom:.0001pt;
background:#0C0503;
font-size:9.0pt;
font-family:Monaco;
color:#FF3E1F;}
p.p3, li.p3, div.p3
{mso-style-name:p3;
margin:0cm;
margin-bottom:.0001pt;
background:#0C0503;
font-size:9.0pt;
font-family:Monaco;
color:#C63A22;}
p.p4, li.p4, div.p4
{mso-style-name:p4;
margin:0cm;
margin-bottom:.0001pt;
background:#0C0503;
font-size:9.0pt;
font-family:Monaco;
color:#F4F4F4;}
p.p5, li.p5, div.p5
{mso-style-name:p5;
margin:0cm;
margin-bottom:.0001pt;
background:#0C0503;
font-size:9.0pt;
font-family:Monaco;
color:#8EFB29;}
p.p6, li.p6, div.p6
{mso-style-name:p6;
margin:0cm;
margin-bottom:.0001pt;
background:#0C0503;
font-size:9.0pt;
font-family:Monaco;
color:#36BE28;}
span.EmailStyle24
{mso-style-type:personal;
font-family:"Courier New";
color:windowtext;
font-weight:normal;
font-style:normal;}
span.s1
{mso-style-name:s1;
color:#C63A22;}
span.s3
{mso-style-name:s3;
color:#F4F4F4;}
span.s4
{mso-style-name:s4;
color:#2FE822;}
span.s2
{mso-style-name:s2;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle30
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">Hi Kevin,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">My short answer is, <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Step 1, before stage 0, check your salt-api service on salt-master node first.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">```bash<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">zypper install -y salt-api<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">systemctl enable salt-api.service<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">systemctl start salt-api.service<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">```<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Step 2, make sure NTP service works correctly on all nodes, which means time synchronized correctly on all nodes.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Step 3, reboot all your nodes, if acceptable. In case of kernel updated somehow.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Step 4, then you have to start over again from stage 0 to 5.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Basically, deepsea is a bunch of salt scripts, and salt based on python2 and/or python3.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I have no clues about your whole running stack, so assume SLES 12 sp3 + SES 5, which works fine and supported.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">More info would be helpful, and also your purpose, such as for practice on your own, or for PoC/testing to meet customer’s demands.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt">Regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">-- <o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt">Joel Zhou </span><span lang="ZH-CN" style="font-size:11.0pt;font-family:SimSun">周维伟</span><span style="font-size:11.0pt;font-family:SimSun"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:SimSun">Senior Storage Technologist, APJ<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:SimSun"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:SimSun">Mobile: +86 18514577601<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:SimSun">Email: joel.zhou@suse.com</span><span style="font-size:11.0pt"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="color:black">From: </span></b><span style="color:black"><deepsea-users-bounces@lists.suse.com> on behalf of Kevin Ayres <kevin.ayres@suse.com><br>
<b>Reply-To: </b>Discussions about the DeepSea management framework for Ceph <deepsea-users@lists.suse.com><br>
<b>Date: </b>Tuesday, September 18, 2018 at 4:49 PM<br>
<b>To: </b>"deepsea-users@lists.suse.com" <deepsea-users@lists.suse.com><br>
<b>Subject: </b>[Deepsea-users] stage 1 errors on Azure<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">Hey guys, I can’t seem to get past stage 1. Stage 0 complete successfully. Same output with deepsea command. The master and minion service are running and bidirectional host resolution
are good. Keys are all accepted. From what I can determine, the default files are not created by stage 0 for some reason. Thoughts? What I’m seeing is that it fails to create the /srv/pillar/ceph/proposals
</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New""> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">I’m running through this doc line by line:
<a href="https://www.suse.com/documentation/suse-enterprise-storage-5/singlehtml/book_storage_deployment/book_storage_deployment.html#deepsea.cli">
https://www.suse.com/documentation/suse-enterprise-storage-5/singlehtml/book_storage_deployment/book_storage_deployment.html#deepsea.cli</a>
</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New""> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:black">~ Kevin</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:black"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">salt:~ #</span><span class="s2"> salt-run state.orch ceph.stage.discovery</span><o:p></o:p></p>
<p class="p2"><span class="s3">salt-api </span><span class="apple-converted-space"><span style="color:#F4F4F4">
</span></span><span class="s3">: </span><span class="s2">["Salt API is failing to authenticate - try 'systemctl restart salt-master': list index out of range"]</span><o:p></o:p></p>
<p class="p1"><span class="s2">deepsea_minions</span><span class="apple-converted-space">
</span><span class="s2">: </span><span class="s4">valid</span><o:p></o:p></p>
<p class="p1"><span class="s2">master_minion</span><span class="apple-converted-space">
</span><span class="s2">: </span><span class="s4">valid</span><o:p></o:p></p>
<p class="p1"><span class="s2">ceph_version </span><span class="apple-converted-space">
</span><span class="s2">: </span><span class="s4">valid</span><o:p></o:p></p>
<p class="p1"><span class="s2">[ERROR </span><span class="apple-converted-space">
</span><span class="s2">] No highstate or sls specified, no execution made</span><o:p></o:p></p>
<p class="p3"><span class="s2">salt_master:</span><o:p></o:p></p>
<p class="p3"><span class="s2">----------</span><o:p></o:p></p>
<p class="p3"><span class="apple-converted-space"><span style="color:#F4F4F4">
</span> </span><span class="s2">ID: salt-api failed</span><o:p></o:p></p>
<p class="p3"><span class="apple-converted-space"><span style="color:#F4F4F4">
</span></span><span class="s2">Function: salt.state</span><o:p></o:p></p>
<p class="p3"><span class="apple-converted-space"><span style="color:#F4F4F4">
</span> </span><span class="s2">Name: just.exit</span><o:p></o:p></p>
<p class="p3"><span class="apple-converted-space"><span style="color:#F4F4F4">
</span> </span><span class="s2">Result: False</span><o:p></o:p></p>
<p class="p3"><span class="apple-converted-space"><span style="color:#F4F4F4"> </span></span><span class="s2"> Comment: No highstate or sls specified, no execution made</span><o:p></o:p></p>
<p class="p3"><span class="apple-converted-space"><span style="color:#F4F4F4"> </span></span><span class="s2"> Started: 22:30:53.628882</span><o:p></o:p></p>
<p class="p3"><span class="apple-converted-space"><span style="color:#F4F4F4">
</span></span><span class="s2">Duration: 0.647 ms</span><o:p></o:p></p>
<p class="p3"><span class="apple-converted-space"> </span><span class="s2">Changes:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p4"> <o:p></o:p></p>
<p class="p5"><span class="s2">Summary for salt_master</span><o:p></o:p></p>
<p class="p5"><span class="s2">------------</span><o:p></o:p></p>
<p class="p6"><span class="s2">Succeeded: 0</span><o:p></o:p></p>
<p class="p3"><span class="s2">Failed:</span><span class="apple-converted-space">
</span><span class="s2">1</span><o:p></o:p></p>
<p class="p5"><span class="s2">------------</span><o:p></o:p></p>
<p class="p5"><span class="s2">Total states run: </span><span class="apple-converted-space">
</span><span class="s2">1</span><o:p></o:p></p>
<p class="p5"><span class="s2">Total run time: </span><span class="apple-converted-space">
</span><span class="s2">0.647 ms</span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#C63A22">salt:~ #</span><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4"> !tail</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">tail -f /var/log/salt/master</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">2018-09-18 22:29:08,797 [salt.loaded.ext.runners.validate][WARNING ][8499] role-igw/cluster/igw*.sls matched no files</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">2018-09-18 22:29:08,797 [salt.loaded.ext.runners.validate][WARNING ][8499] role-openattic/cluster/salt.sls matched no files</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">2018-09-18 22:29:08,797 [salt.loaded.ext.runners.validate][WARNING ][8499] config/stack/default/global.yml matched no files</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">2018-09-18 22:29:08,798 [salt.loaded.ext.runners.validate][WARNING ][8499] config/stack/default/ceph/cluster.yml matched no files</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">2018-09-18 22:29:08,798 [salt.loaded.ext.runners.validate][WARNING ][8499] cluster/*.sls matched no files</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">2018-09-18 22:29:08,798 [salt.loaded.ext.runners.validate][WARNING ][8499] stack/default/ceph/minions/*.yml matched no files</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">2018-09-18 22:29:08,822 [salt.state ][ERROR ][8499] No highstate or sls specified, no execution made</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">2018-09-18 22:29:52,472 [salt.transport.ipc][ERROR ][5672] Exception occurred while handling stream: [Errno 0] Success</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">2018-09-18 22:29:56,797 [salt.state ][ERROR ][8759] No highstate or sls specified, no execution made</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">2018-09-18 22:30:53,629 [salt.state ][ERROR ][9272] No highstate or sls specified, no execution made</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4"> </span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">There’s also some issue with the salt-minion.service:
</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:"Times New Roman",serif;color:#36BE28">●</span><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4"> salt-minion.service - The Salt Minion</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4"> Loaded: loaded (/usr/lib/systemd/system/salt-minion.service; enabled; vendor preset: disabled)</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4"> Active:
</span><span style="font-size:9.0pt;font-family:Monaco;color:#36BE28">active (running)</span><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4"> since Tue 2018-09-18 22:46:54 UTC; 12s ago</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4"> Main PID: 11082 (salt-minion)</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">…</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">.....</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">Sep 18 22:46:54 salt systemd[1]: Started The Salt Minion.</span><o:p></o:p></p>
<p class="MsoNormal" style="background:#0C0503"><span style="font-size:9.0pt;font-family:Monaco;color:#F4F4F4">Sep 18 22:47:00 salt salt-minion[11082]: [ERROR ] Function cephimages.list in mine_functions failed to execute</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New""> </span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</body>
</html>