[ClusterLabs] mess in the CIB
Lentes, Bernd
bernd.lentes at helmholtz-muenchen.de
Tue Oct 6 13:57:01 EDT 2020
Hi guys,
i have a very strange problem with my CIB.
We have a two-node cluster running about 15 VirtualDomains as resources.
Two of them seem to be messed up.
Here is the config from crm:
primitive vm_ssh VirtualDomain \
params config="/mnt/share/vm_ssh.xml" \
params hypervisor="qemu:///system" \
params migration_transport=ssh \
params migrate_options="--p2p --tunnelled" \
op start interval=0 timeout=120 \
op stop interval=0 timeout=180 \
op monitor interval=30 timeout=25 \
op migrate_from interval=0 timeout=300 \
op migrate_to interval=0 timeout=300 \
meta allow-migrate=true target-role=Started is-managed=true maintenance=false \
utilization cpu=2 hv_memory=4096
ha-idg-1:/mnt/share # crm configure show vm_snipanalysis
primitive vm_snipanalysis VirtualDomain \
params config="/mnt/share/vm_snipanalysis.xml" \
params hypervisor="qemu:///system" \
params migration_transport=ssh \
params migrate_options="--p2p --tunnelled" \
op start interval=0 timeout=120 \
op stop interval=0 timeout=180 \
op monitor interval=30 timeout=25 \
op migrate_from interval=0 timeout=300 \
op migrate_to interval=0 timeout=300 \
meta allow-migrate=true target-role=Stopped is-managed=false maintenance=false
Everything looks ok for me.
Here are the two config files for libvirt:
ha-idg-1:/etc/libvirt/qemu # less /mnt/share/vm_snipanalysis.xml
<domain type='kvm'>
<name>vm_snipanalysis</name>
<uuid>b3b91a8c-b13f-4368-8439-7d8a4108ef3b</uuid>
<memory unit='KiB'>32768000</memory>
<currentMemory unit='KiB'>32768000</currentMemory>
<vcpu placement='static'>12</vcpu>
<os>
<type arch='x86_64' machine='pc-i440fx-2.9'>hvm</type>
</os>
<features>
<acpi/>
<apic/>
<vmport state='off'/>
</features>
<cpu>
<topology sockets='1' cores='6' threads='2'/>
</cpu>
<clock offset='utc'>
<timer name='rtc' tickpolicy='catchup'/>
<timer name='pit' tickpolicy='delay'/>
<timer name='hpet' present='no'/>
</clock>
<on_poweroff>destroy</on_poweroff>
<on_reboot>restart</on_reboot>
<on_crash>destroy</on_crash>
<pm>
<suspend-to-mem enabled='no'/>
<suspend-to-disk enabled='no'/>
</pm>
<devices>
<emulator>/usr/bin/qemu-kvm</emulator>
<disk type='file' device='disk'>
<driver name='qemu' type='raw' cache='none'/>
<source file='/mnt/ocfs2/vm_snipanalysis.raw'/>
<target dev='vda' bus='virtio'/>
<boot order='1'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
</disk>
<disk type='file' device='cdrom'>
<driver name='qemu' type='raw'/>
<source file='/mnt/mcd/AG_BioInformatik/Technik/software_und_treiber/linux/ubuntu/ubuntu-20.04-live-server-amd64.iso'/>
<target dev='hdb' bus='ide'/>
<readonly/>
<address type='drive' controller='0' bus='0' target='0' unit='1'/>
</disk>
<controller type='usb' index='0' model='ich9-ehci1'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x7'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci1'>
<master startport='0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0' multifunction='on'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci2'>
<master startport='2'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x1'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci3'>
<master startport='4'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x2'/>
</controller>
<controller type='pci' index='0' model='pci-root'/>
<controller type='ide' index='0'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
</controller>
<controller type='virtio-serial' index='0'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
</controller>
<interface type='bridge'>
<mac address='00:50:56:00:00:14'/>
<source bridge='br0'/>
<model type='e1000'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
</interface>
<serial type='pty'>
<target type='isa-serial' port='0'>
<model name='isa-serial'/>
</target>
</serial>
<console type='pty'>
<target type='serial' port='0'/>
</console>
<input type='mouse' bus='ps2'/>
<input type='keyboard' bus='ps2'/>
<input type='tablet' bus='usb'>
<address type='usb' bus='0' port='3'/>
</input>
<graphics type='vnc' port='5916' autoport='no' listen='127.0.0.1'>
<listen type='address' address='127.0.0.1'/>
</graphics>
<video>
<model type='virtio' heads='1' primary='yes'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
</video>
<redirdev bus='usb' type='spicevmc'>
<address type='usb' bus='0' port='1'/>
</redirdev>
<redirdev bus='usb' type='spicevmc'>
<address type='usb' bus='0' port='2'/>
</redirdev>
<memballoon model='virtio'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
</memballoon>
</devices>
</domain>
and
ha-idg-1:/etc/libvirt/qemu # less /mnt/share/vm_ssh.xml
<!--
WARNING: THIS IS AN AUTO-GENERATED FILE. CHANGES TO IT ARE LIKELY TO BE
OVERWRITTEN AND LOST. Changes to this xml configuration should be made using:
virsh edit sebastian
or other application using the libvirt API.
-->
<domain type='kvm'>
<name>vm_ssh</name>
<uuid>b3b91a8d-b13f-4368-8439-7d8a4109ef3b</uuid>
<memory unit='KiB'>4194304</memory>
<currentMemory unit='KiB'>4194304</currentMemory>
<vcpu placement='static'>2</vcpu>
<os>
<type arch='x86_64' machine='pc-i440fx-2.9'>hvm</type>
</os>
<features>
<acpi/>
<apic/>
<vmport state='off'/>
</features>
<!-- cpu mode='custom' match='exact' check='full'>
<model fallback='forbid'>Westmere-IBRS</model>
<feature policy='require' name='vme'/>
<feature policy='require' name='f16c'/>
<feature policy='require' name='rdrand'/>
<feature policy='require' name='hypervisor'/>
<feature policy='require' name='arat'/>
<feature policy='require' name='xsaveopt'/>
<feature policy='require' name='abm'/>
</cpu -->
<!-- cpu mode='host-model' check='full'>
<model fallback='allow'/>
</cpu -->
<clock offset='utc'>
<timer name='rtc' tickpolicy='catchup'/>
<timer name='pit' tickpolicy='delay'/>
<timer name='hpet' present='no'/>
</clock>
<on_poweroff>destroy</on_poweroff>
<on_reboot>restart</on_reboot>
<on_crash>destroy</on_crash>
<pm>
<suspend-to-mem enabled='no'/>
<suspend-to-disk enabled='no'/>
</pm>
<devices>
<emulator>/usr/bin/qemu-kvm</emulator>
<disk type='file' device='disk'>
<driver name='qemu' type='raw' cache='none'/>
<source file='/mnt/ocfs2/vm_ssh.raw'/>
<target dev='vda' bus='virtio'/>
<boot order='1'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
</disk>
<!-- disk type='file' device='cdrom'>
<driver name='qemu' type='raw'/>
<source file='/mnt/idg-2/SysAdmin_AG_Wurst/software_und_treiber/linux/knoppix/KNOPPIX_V7.7.1DVD-2016-10-22-EN.iso'/>
<target dev='hdb' bus='ide'/>
<readonly/>
<boot order='2'/>
<address type='drive' controller='0' bus='0' target='0' unit='1'/>
</disk -->
<controller type='usb' index='0' model='ich9-ehci1'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x7'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci1'>
<master startport='0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0' multifunction='on'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci2'>
<master startport='2'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x1'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci3'>
<master startport='4'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x2'/>
</controller>
<controller type='pci' index='0' model='pci-root'/>
<controller type='ide' index='0'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
</controller>
<controller type='virtio-serial' index='0'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
</controller>
<interface type='bridge'>
<mac address='00:50:56:00:00:13'/>
<source bridge='br0'/>
<model type='e1000'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
</interface>
<serial type='pty'>
<target port='0'/>
</serial>
<console type='pty'>
<target type='serial' port='0'/>
</console>
<input type='mouse' bus='ps2'/>
<input type='keyboard' bus='ps2'/>
<input type='tablet' bus='usb'>
<address type='usb' bus='0' port='3'/>
</input>
<graphics type='vnc' port='5910' autoport='no' listen='127.0.0.1'>
<listen type='address' address='127.0.0.1'/>
</graphics>
<video>
<model type='virtio' heads='1' primary='yes'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
</video>
<redirdev bus='usb' type='spicevmc'>
<address type='usb' bus='0' port='1'/>
</redirdev>
<redirdev bus='usb' type='spicevmc'>
<address type='usb' bus='0' port='2'/>
</redirdev>
<memballoon model='virtio'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
</memballoon>
</devices>
</domain>
Also in the libvirt config files i don't see a problem.
BUT in the cib:
<primitive id="vm_ssh" class="ocf" provider="heartbeat" type="VirtualDomain">
<instance_attributes id="vm_snipanalysis-instance_attributes">
<nvpair name="config" value="/mnt/share/vm_ssh.xml" id="vm_snipanalysis-instance_attributes-config"/> <======
</instance_attributes>
<instance_attributes id="vm_snipanalysis-instance_attributes-0">
<nvpair name="hypervisor" value="qemu:///system" id="vm_snipanalysis-instance_attributes-0-hypervisor"/> <==========
</instance_attributes>
<instance_attributes id="vm_snipanalysis-instance_attributes-1">
<nvpair name="migration_transport" value="ssh" id="vm_snipanalysis-instance_attributes-1-migration_transport"/> <=======
</instance_attributes>
<instance_attributes id="vm_snipanalysis-instance_attributes-2">
<nvpair name="migrate_options" value="--p2p --tunnelled" id="vm_snipanalysis-instance_attributes-2-migrate_options"/>
</instance_attributes>
<operations>
<op name="start" interval="0" timeout="120" id="vm_snipanalysis-start-0"/>
<op name="stop" interval="0" timeout="180" id="vm_snipanalysis-stop-0"/>
<op name="monitor" interval="30" timeout="25" id="vm_snipanalysis-monitor-30"/>
<op name="migrate_from" interval="0" timeout="300" id="vm_snipanalysis-migrate_from-0"/>
<op name="migrate_to" interval="0" timeout="300" id="vm_snipanalysis-migrate_to-0"/>
</operations>
<meta_attributes id="vm_snipanalysis-meta_attributes">
<nvpair name="allow-migrate" value="true" id="vm_snipanalysis-meta_attributes-allow-migrate"/>
<nvpair name="target-role" value="Started" id="vm_snipanalysis-meta_attributes-target-role"/>
<nvpair name="is-managed" value="true" id="vm_snipanalysis-meta_attributes-is-managed"/>
<nvpair name="maintenance" value="false" id="vm_snipanalysis-meta_attributes-maintenance"/>
</meta_attributes>
<utilization id="vm_snipanalysis-utilization">
<nvpair name="cpu" value="2" id="vm_snipanalysis-utilization-cpu"/>
<nvpair name="hv_memory" value="4096" id="vm_snipanalysis-utilization-hv_memory"/>
</utilization>
</primitive>
and
<primitive id="vm_snipanalysis" class="ocf" provider="heartbeat" type="VirtualDomain">
<instance_attributes id="vm_snipanalysis-instance_attributes-3">
<nvpair name="config" value="/mnt/share/vm_snipanalysis.xml" id="vm_snipanalysis-instance_attributes-3-config"/>
</instance_attributes>
<instance_attributes id="vm_snipanalysis-instance_attributes-4">
<nvpair name="hypervisor" value="qemu:///system" id="vm_snipanalysis-instance_attributes-4-hypervisor"/>
</instance_attributes>
<instance_attributes id="vm_snipanalysis-instance_attributes-5">
<nvpair name="migration_transport" value="ssh" id="vm_snipanalysis-instance_attributes-5-migration_transport"/>
</instance_attributes>
<instance_attributes id="vm_snipanalysis-instance_attributes-6">
<nvpair name="migrate_options" value="--p2p --tunnelled" id="vm_snipanalysis-instance_attributes-6-migrate_options"/>
</instance_attributes>
<operations>
<op name="start" interval="0" timeout="120" id="vm_snipanalysis-start-0-0"/>
<op name="stop" interval="0" timeout="180" id="vm_snipanalysis-stop-0-0"/>
<op name="monitor" interval="30" timeout="25" id="vm_snipanalysis-monitor-30-0"/>
<op name="migrate_from" interval="0" timeout="300" id="vm_snipanalysis-migrate_from-0-0"/>
<op name="migrate_to" interval="0" timeout="300" id="vm_snipanalysis-migrate_to-0-0"/>
</operations>
<meta_attributes id="vm_snipanalysis-meta_attributes-0">
<nvpair name="allow-migrate" value="true" id="vm_snipanalysis-meta_attributes-0-allow-migrate"/>
<nvpair name="target-role" value="Stopped" id="vm_snipanalysis-meta_attributes-0-target-role"/>
<nvpair name="is-managed" value="false" id="vm_snipanalysis-meta_attributes-0-is-managed"/>
<nvpair name="maintenance" value="false" id="vm_snipanalysis-meta_attributes-0-maintenance"/>
</meta_attributes>
</primitive>
The config of vm_snipanalysis seems to be ok.
But vm_ssh ... why are some instance-attributes of it named with snapanalysis?
I didn't change the configuration of both in the last weeks.
Does anyone have a clue ?
Thanks.
Bernd
--
Bernd Lentes
Systemadministration
Institute for Metabolism and Cell Death (MCD)
Building 25 - office 122
HelmholtzZentrum München
bernd.lentes at helmholtz-muenchen.de
phone: +49 89 3187 1241
phone: +49 89 3187 3827
fax: +49 89 3187 2294
http://www.helmholtz-muenchen.de/mcd
stay healthy
Helmholtz Zentrum München
Helmholtz Zentrum München
More information about the Users
mailing list