[caasp-beta] read only fs on caasp kubernetes nodes

[Simeon Bobylev]

Thank you Thorsten.

I have another weird issue when trying de deploy CaaSP Admin node :

The machine has booted after the initial installation but Velum is still not 
inaccessible 20min later. I rebooted the node but same problem.
By checking log files, it seems that some services are waiting for mariadb :

==> 
/var/log/containers/velum-public-127.0.0.1_default_velum-dashboard-7c256d89831570117d416a2761ace54ebc682afd44c1c66270f4acd2158aa616.log 
<==
{"log":"Waiting for mariadb to be ready in 5 
seconds\n","stream":"stdout","time":"2018-02-22T14:28:15.93480394Z"}

==> 
/var/log/containers/velum-public-127.0.0.1_default_salt-master-8f4b5411619cea0b94257ec7b299f16ca00f681a609d6217060b1924f9d8a972.log 
<==
{"log":"[ERROR   ] Could not store events - returner 'mysql.event_return' 
raised exception: MySQL returner could not connect to database: (1045, 
\"Access denied for user 'salt'@'localhost' (using password: 
YES)\")\n","stream":"stderr","time":"2018-02-22T14:29:51.824838923Z"}

And if I look into mariadb container logs, it seems mariadb is starting... 
but never starts.

c002-caasadmin-01:~ # docker logs -f 
k8s_velum-mariadb_velum-private-127.0.0.1_default_bf640ab62f9d8d01fa0c2f7e66744787_1
ERROR 2002 (HY000): Can't connect to local MySQL server through socket 
'/tmp/mysql.sock' (2 "No such file or directory")
ERROR 2002 (HY000): Can't connect to local MySQL server through socket 
'/tmp/mysql.sock' (2 "No such file or directory")
MySQL init process in progress...
180222 14:25:42 [Note] /usr/sbin/mysqld (mysqld 10.0.31-MariaDB) starting as 
process 40 ...
ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using 
password: NO)
Setting root password...
Root password already set, nothing to do here

Removing anonymous users...
 ... Success!
Removing remote root access...
 ... Success!
Removing test database...
 - Dropping test database...
 ... Success!
 - Removing privileges on test database...
 ... Success!
Reloading privileges...
 ... Success!
/usr/local/bin/entrypoint.sh: ignoring /docker-entrypoint-initdb.d/*


MySQL init process done. Ready for start up.

Cleaning up...
180222 14:25:45 [Note] /usr/sbin/mysqld (mysqld 10.0.31-MariaDB) starting as 
process 1 ...


Do you know any workaround to fix that ?


Siméon Bobylev ¦ System Engineer ¦ Cortex IT SA ¦ Route de l'Ile aux Bois 1A 
¦ 1870 Monthey ¦ Switzerland
Direct: +41 24 524 1204 ¦ Main: +41 24 524 1200 ¦ Email: 
simeon.bobylev at cortex-it.ch <mailto:simeon.bobylev at cortex-it.ch>

http://www.cortex-it.ch/ <http://www.cortex-it.ch/>  ¦ A WIRD Group Company

-----Original Message-----
From: caasp-beta-bounces at lists.suse.com 
[mailto:caasp-beta-bounces at lists.suse.com] On Behalf Of Thorsten Kukuk
Sent: mercredi, 21 février 2018 14:28
To: caasp-beta at lists.suse.com
Subject: Re: [caasp-beta] read only fs on caasp kubernetes nodes

On Wed, Feb 21, Simeon Bobylev wrote:

> Hi all,
>
>
>
> Is there a specific reason that /dev/sda2 is mounted in read only into
> / on CaaSP Kubernetes nodes ?

Yes, that's part of the concept and needed for transactional updates.

> c002-caasnode-01:~ # mkdir /var/lib/controller
>
> mkdir: cannot create directory ‘/var/lib/controller’: Read-only
> file system

# transactional-update shell
#> mksubvolume /var/lib/controller
#> exit
# systemctl reboot


  Thorsten

--
Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & CaaSP SUSE 
LINUX GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany
GF: Felix Imendoerffer, Jane Smithard, Graham Norton, HRB 21284 (AG 
Nuernberg) _______________________________________________
caasp-beta mailing list
caasp-beta at lists.suse.com
http://lists.suse.com/mailman/listinfo/caasp-beta