[Deepsea-users] Rolling Updates
Robert Grosschopff
Robert.Grosschopff at suse.com
Wed Jul 11 07:38:01 MDT 2018
Hi Nathan,
partner installed jq because it was missing. I wonder wyh jq was not installed. Should the partner open a bug report ?
It seems that deepsea still has some problems but salt-run seems to work although the dmidecode warnings are still there.
Robert
deepsea
--------------
sesadmin:~ # deepsea stage run ceph.stage.0
Starting stage: ceph.stage.0
Parsing ceph.stage.0 steps... ⏳
[parsing] on master
|_ ceph.stage.0
Traceback (most recent call last):
File "/usr/bin/deepsea", line 9, in <module>
load_entry_point('deepsea==0.8.5', 'console_scripts',
'deepsea')()
File "/usr/lib/python2.7/site-packages/deepsea/deepsea.py",
line 371, in main
cli(prog_name='deepsea')
File "/usr/lib/python2.7/site-packages/click/core.py", line
722, in __call__
return self.main(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/click/core.py", line
697, in main
rv = self.invoke(ctx)
File "/usr/lib/python2.7/site-packages/click/core.py", line
1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python2.7/site-packages/click/core.py", line
1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python2.7/site-packages/click/core.py", line
895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/lib/python2.7/site-packages/click/core.py", line
535, in invoke
return callback(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/deepsea/common.py",
line 66, in func_wraper
return func(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/deepsea/deepsea.py",
line 326, in stage_run
ret = run_stage(stage_name, hide_state_steps,
hide_dynamic_steps, simple_output)
File
"/usr/lib/python2.7/site-packages/deepsea/stage_executor.py",
line 79, in run_stage
mon.parse_stage(stage_name)
File "/usr/lib/python2.7/site-packages/deepsea/monitor.py",
line 533, in parse_stage
self._monitor_listeners)
File
"/usr/lib/python2.7/site-packages/deepsea/stage_parser.py",
line 288, in parse_stage
states_to_render[step.target[0]].add(step.sls)
TypeError: unhashable type: 'list'
salt-run
--------------
sesadmin:~ # salt-run state.orch ceph.stage.0
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
deepsea_minions : valid
master_minion : valid
ceph_version : valid
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Could not write out jid file for job
20180711145414360489. Retrying.
[WARNING ] Could not write out jid file for job
20180711145414360489. Retrying.
[WARNING ] Could not write out jid file for job
20180711145414360489. Retrying.
[WARNING ] Could not write out jid file for job
20180711145414360489. Retrying.
[WARNING ] Could not write out jid file for job
20180711145414360489. Retrying.
[ERROR ] prep_jid could not store a jid after 5 tries.
[ERROR ] Could not store job cache info. Job details for this
run may be unavailable.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Could not write out jid file for job
20180711145427401204. Retrying.
[WARNING ] Could not write out jid file for job
20180711145427401204. Retrying.
[WARNING ] Could not write out jid file for job
20180711145427401204. Retrying.
[WARNING ] Could not write out jid file for job
20180711145427401204. Retrying.
[WARNING ] Could not write out jid file for job
20180711145427401204. Retrying.
[ERROR ] prep_jid could not store a jid after 5 tries.
[ERROR ] Could not store job cache info. Job details for this
run may be unavailable.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] All minions are ready
No minions matched the target. No command was sent, no jid was
assigned.
[WARNING ] Although 'dmidecode' was found in path, the current
user cannot execute it. Grains output might not be accurate.
[WARNING ] Processing host ses1
-----Original Message-----
From: <deepsea-users-bounces at lists.suse.com> on behalf of Nathan Cutler <ncutler at suse.cz>
Reply-To: Discussions about the DeepSea management framework for Ceph <deepsea-users at lists.suse.com>
Date: Wednesday, 11. July 2018 at 14:07
To: "deepsea-users at lists.suse.com" <deepsea-users at lists.suse.com>
Subject: Re: [Deepsea-users] Rolling Updates
In my initial response below, I neglected to specify which machine to
run the zypper command on. It should be run on the Salt Master.
Nathan
On 07/11/2018 12:45 PM, Nathan Cutler wrote:
> Looks like jq is not installed. Can the partner try installing it (as
> root)?
>
> # zypper ref ; zypper in jq
>
> Does that help?
>
> On 07/11/2018 12:21 PM, Robert Grosschopff wrote:
>> Hi *,
>>
>> partner has set up SES5 a little while ago. Meanwhile new patches
>> arrived and he wanted to do a rolling upgrade as described in the
>> admin guide by executin 'salt-run state.orch ceph.stage.0'
>>
>> He now keeps getting dmidecode warnings but also jinja errors flagged
>> as CRITICAL.
>>
>> Any hints what to look for in order to resolve this issue ?
>> Robert
>>
>>
>> sesadmin:~ # salt-run state.orch ceph.stage.0
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> deepsea_minions : valid
>> master_minion : valid
>> ceph_version : valid
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [ERROR ] Rendering exception occurred: Jinja error: Unable to
>> load json from /bin/sh: jq: command not found
>> Traceback (most recent call last):
>> File
>> "/usr/lib/python2.7/site-packages/salt/utils/templates.py",
>> line 368, in render_jinja_tmpl
>> output = template.render(**decoded_context)
>> File
>> "/usr/lib/python2.7/site-packages/jinja2/environment.py", line
>> 989, in render
>> return self.environment.handle_exception(exc_info, True)
>> File
>> "/usr/lib/python2.7/site-packages/jinja2/environment.py", line
>> 754, in handle_exception
>> reraise(exc_type, exc_value, tb)
>> File "<template>", line 26, in top-level template code
>> File "/usr/lib/python2.7/site-packages/salt/utils/jinja.py",
>> line 403, in load_json
>> 'Unable to load json from {0}'.format(value))
>> TemplateRuntimeError: Unable to load json from /bin/sh: jq:
>> command not found
>>
>> ; line 26
>>
>> ---
>> [...]
>> wait until all active mds but one have stopped:
>> salt.state:
>> - tgt: {{ master }}
>> - sls: ceph.wait.mds.1-mds
>>
>> {% set standbys = salt['saltutil.runner']('cmd.run', cmd='ceph
>> --format=json fs dump 2>/dev/null | jq -c [.standbys[].name]')
>> | load_json %} <======================
>> {% for standby in standbys %}
>> shutdown standby daemon {{ standby }}:
>> salt.state:
>> - tgt: {{ standby }}
>> - sls: ceph.mds.shutdown
>> [...]
>> ---
>> [CRITICAL] Rendering SLS 'base:ceph.restart.mds.default-shrink'
>> failed: Jinja error: Unable to load json from /bin/sh: jq:
>> command not found
>> Traceback (most recent call last):
>> File
>> "/usr/lib/python2.7/site-packages/salt/utils/templates.py",
>> line 368, in render_jinja_tmpl
>> output = template.render(**decoded_context)
>> File
>> "/usr/lib/python2.7/site-packages/jinja2/environment.py", line
>> 989, in render
>> return self.environment.handle_exception(exc_info, True)
>> File
>> "/usr/lib/python2.7/site-packages/jinja2/environment.py", line
>> 754, in handle_exception
>> reraise(exc_type, exc_value, tb)
>> File "<template>", line 26, in top-level template code
>> File "/usr/lib/python2.7/site-packages/salt/utils/jinja.py",
>> line 403, in load_json
>> 'Unable to load json from {0}'.format(value))
>> TemplateRuntimeError: Unable to load json from /bin/sh: jq:
>> command not found
>>
>> ; line 26
>>
>> ---
>> [...]
>> wait until all active mds but one have stopped:
>> salt.state:
>> - tgt: {{ master }}
>> - sls: ceph.wait.mds.1-mds
>>
>> {% set standbys = salt['saltutil.runner']('cmd.run', cmd='ceph
>> --format=json fs dump 2>/dev/null | jq -c [.standbys[].name]')
>> | load_json %} <======================
>> {% for standby in standbys %}
>> shutdown standby daemon {{ standby }}:
>> salt.state:
>> - tgt: {{ standby }}
>> - sls: ceph.mds.shutdown
>> [...]
>> ---
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> [WARNING ] Although 'dmidecode' was found in path, the current
>> user cannot execute it. Grains output might not be accurate.
>> sesadmin_master:
>> Data failed to compile:
>> ----------
>> Rendering SLS 'base:ceph.restart.mds.default-shrink'
>> failed: Jinja error: Unable to load json from /bin/sh: jq:
>> command not found
>> Traceback (most recent call last):
>> File
>> "/usr/lib/python2.7/site-packages/salt/utils/templates.py",
>> line 368, in render_jinja_tmpl
>> output = template.render(**decoded_context)
>> File
>> "/usr/lib/python2.7/site-packages/jinja2/environment.py", line
>> 989, in render
>> return self.environment.handle_exception(exc_info, True)
>> File
>> "/usr/lib/python2.7/site-packages/jinja2/environment.py", line
>> 754, in handle_exception
>> reraise(exc_type, exc_value, tb)
>> File "<template>", line 26, in top-level template code
>> File "/usr/lib/python2.7/site-packages/salt/utils/jinja.py",
>> line 403, in load_json
>> 'Unable to load json from {0}'.format(value))
>> TemplateRuntimeError: Unable to load json from /bin/sh: jq:
>> command not found
>>
>> ; line 26
>>
>> ---
>> [...]
>> wait until all active mds but one have stopped:
>> salt.state:
>> - tgt: {{ master }}
>> - sls: ceph.wait.mds.1-mds
>>
>> {% set standbys = salt['saltutil.runner']('cmd.run', cmd='ceph
>> --format=json fs dump 2>/dev/null | jq -c [.standbys[].name]')
>> | load_json %} <======================
>> {% for standby in standbys %}
>> shutdown standby daemon {{ standby }}:
>> salt.state:
>> - tgt: {{ standby }}
>> - sls: ceph.mds.shutdown
>> [...]
>> ---
>> sesadmin:~ #
>>
>> _______________________________________________
>> Deepsea-users mailing list
>> Deepsea-users at lists.suse.com
>> http://lists.suse.com/mailman/listinfo/deepsea-users
>>
>
--
Nathan Cutler
Software Engineer Distributed Storage
SUSE LINUX, s.r.o.
Tel.: +420 284 084 037
_______________________________________________
Deepsea-users mailing list
Deepsea-users at lists.suse.com
http://lists.suse.com/mailman/listinfo/deepsea-users
More information about the Deepsea-users
mailing list