[ClusterLabs] mess in the CIB
Ken Gaillot
kgaillot at redhat.com
Tue Oct 6 14:28:19 EDT 2020
On Tue, 2020-10-06 at 19:57 +0200, Lentes, Bernd wrote:
> Hi guys,
>
> i have a very strange problem with my CIB.
> We have a two-node cluster running about 15 VirtualDomains as
> resources.
> Two of them seem to be messed up.
> Here is the config from crm:
>
> primitive vm_ssh VirtualDomain \
> params config="/mnt/share/vm_ssh.xml" \
> params hypervisor="qemu:///system" \
> params migration_transport=ssh \
> params migrate_options="--p2p --tunnelled" \
> op start interval=0 timeout=120 \
> op stop interval=0 timeout=180 \
> op monitor interval=30 timeout=25 \
> op migrate_from interval=0 timeout=300 \
> op migrate_to interval=0 timeout=300 \
> meta allow-migrate=true target-role=Started is-managed=true
> maintenance=false \
> utilization cpu=2 hv_memory=4096
>
> ha-idg-1:/mnt/share # crm configure show vm_snipanalysis
> primitive vm_snipanalysis VirtualDomain \
> params config="/mnt/share/vm_snipanalysis.xml" \
> params hypervisor="qemu:///system" \
> params migration_transport=ssh \
> params migrate_options="--p2p --tunnelled" \
> op start interval=0 timeout=120 \
> op stop interval=0 timeout=180 \
> op monitor interval=30 timeout=25 \
> op migrate_from interval=0 timeout=300 \
> op migrate_to interval=0 timeout=300 \
> meta allow-migrate=true target-role=Stopped is-managed=false
> maintenance=false
> Everything looks ok for me.
I see is-managed=false for vm_snipanalysis, but I'm assuming you're
aware of that and it's not a problem.
>
> Here are the two config files for libvirt:
>
> ha-idg-1:/etc/libvirt/qemu # less /mnt/share/vm_snipanalysis.xml
> <domain type='kvm'>
> <name>vm_snipanalysis</name>
> <uuid>b3b91a8c-b13f-4368-8439-7d8a4108ef3b</uuid>
> <memory unit='KiB'>32768000</memory>
> <currentMemory unit='KiB'>32768000</currentMemory>
> <vcpu placement='static'>12</vcpu>
> <os>
> <type arch='x86_64' machine='pc-i440fx-2.9'>hvm</type>
> </os>
> <features>
> <acpi/>
> <apic/>
> <vmport state='off'/>
> </features>
> <cpu>
> <topology sockets='1' cores='6' threads='2'/>
> </cpu>
> <clock offset='utc'>
> <timer name='rtc' tickpolicy='catchup'/>
> <timer name='pit' tickpolicy='delay'/>
> <timer name='hpet' present='no'/>
> </clock>
> <on_poweroff>destroy</on_poweroff>
> <on_reboot>restart</on_reboot>
> <on_crash>destroy</on_crash>
> <pm>
> <suspend-to-mem enabled='no'/>
> <suspend-to-disk enabled='no'/>
> </pm>
> <devices>
> <emulator>/usr/bin/qemu-kvm</emulator>
> <disk type='file' device='disk'>
> <driver name='qemu' type='raw' cache='none'/>
> <source file='/mnt/ocfs2/vm_snipanalysis.raw'/>
> <target dev='vda' bus='virtio'/>
> <boot order='1'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x08'
> function='0x0'/>
> </disk>
> <disk type='file' device='cdrom'>
> <driver name='qemu' type='raw'/>
> <source
> file='/mnt/mcd/AG_BioInformatik/Technik/software_und_treiber/linux/ub
> untu/ubuntu-20.04-live-server-amd64.iso'/>
> <target dev='hdb' bus='ide'/>
> <readonly/>
> <address type='drive' controller='0' bus='0' target='0'
> unit='1'/>
> </disk>
>
> <controller type='usb' index='0' model='ich9-ehci1'>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x05'
> function='0x7'/>
> </controller>
> <controller type='usb' index='0' model='ich9-uhci1'>
> <master startport='0'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x05'
> function='0x0' multifunction='on'/>
> </controller>
> <controller type='usb' index='0' model='ich9-uhci2'>
> <master startport='2'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x05'
> function='0x1'/>
> </controller>
> <controller type='usb' index='0' model='ich9-uhci3'>
> <master startport='4'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x05'
> function='0x2'/>
> </controller>
> <controller type='pci' index='0' model='pci-root'/>
> <controller type='ide' index='0'>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x01'
> function='0x1'/>
> </controller>
> <controller type='virtio-serial' index='0'>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x06'
> function='0x0'/>
> </controller>
> <interface type='bridge'>
> <mac address='00:50:56:00:00:14'/>
> <source bridge='br0'/>
> <model type='e1000'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x03'
> function='0x0'/>
> </interface>
> <serial type='pty'>
> <target type='isa-serial' port='0'>
> <model name='isa-serial'/>
> </target>
> </serial>
> <console type='pty'>
> <target type='serial' port='0'/>
> </console>
> <input type='mouse' bus='ps2'/>
> <input type='keyboard' bus='ps2'/>
> <input type='tablet' bus='usb'>
> <address type='usb' bus='0' port='3'/>
> </input>
> <graphics type='vnc' port='5916' autoport='no'
> listen='127.0.0.1'>
> <listen type='address' address='127.0.0.1'/>
> </graphics>
> <video>
> <model type='virtio' heads='1' primary='yes'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x02'
> function='0x0'/>
> </video>
> <redirdev bus='usb' type='spicevmc'>
> <address type='usb' bus='0' port='1'/>
> </redirdev>
> <redirdev bus='usb' type='spicevmc'>
> <address type='usb' bus='0' port='2'/>
> </redirdev>
> <memballoon model='virtio'>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x07'
> function='0x0'/>
> </memballoon>
> </devices>
> </domain>
>
> and
>
> ha-idg-1:/etc/libvirt/qemu # less /mnt/share/vm_ssh.xml
> <!--
> WARNING: THIS IS AN AUTO-GENERATED FILE. CHANGES TO IT ARE LIKELY TO
> BE
> OVERWRITTEN AND LOST. Changes to this xml configuration should be
> made using:
> virsh edit sebastian
> or other application using the libvirt API.
> -->
>
> <domain type='kvm'>
> <name>vm_ssh</name>
> <uuid>b3b91a8d-b13f-4368-8439-7d8a4109ef3b</uuid>
> <memory unit='KiB'>4194304</memory>
> <currentMemory unit='KiB'>4194304</currentMemory>
> <vcpu placement='static'>2</vcpu>
> <os>
> <type arch='x86_64' machine='pc-i440fx-2.9'>hvm</type>
> </os>
> <features>
> <acpi/>
> <apic/>
> <vmport state='off'/>
> </features>
> <!-- cpu mode='custom' match='exact' check='full'>
> <model fallback='forbid'>Westmere-IBRS</model>
> <feature policy='require' name='vme'/>
> <feature policy='require' name='f16c'/>
> <feature policy='require' name='rdrand'/>
> <feature policy='require' name='hypervisor'/>
> <feature policy='require' name='arat'/>
> <feature policy='require' name='xsaveopt'/>
> <feature policy='require' name='abm'/>
> </cpu -->
> <!-- cpu mode='host-model' check='full'>
> <model fallback='allow'/>
> </cpu -->
> <clock offset='utc'>
> <timer name='rtc' tickpolicy='catchup'/>
> <timer name='pit' tickpolicy='delay'/>
> <timer name='hpet' present='no'/>
> </clock>
> <on_poweroff>destroy</on_poweroff>
> <on_reboot>restart</on_reboot>
> <on_crash>destroy</on_crash>
> <pm>
> <suspend-to-mem enabled='no'/>
> <suspend-to-disk enabled='no'/>
> </pm>
> <devices>
> <emulator>/usr/bin/qemu-kvm</emulator>
> <disk type='file' device='disk'>
> <driver name='qemu' type='raw' cache='none'/>
> <source file='/mnt/ocfs2/vm_ssh.raw'/>
> <target dev='vda' bus='virtio'/>
> <boot order='1'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x08'
> function='0x0'/>
> </disk>
> <!-- disk type='file' device='cdrom'>
> <driver name='qemu' type='raw'/>
> <source file='/mnt/idg-
> 2/SysAdmin_AG_Wurst/software_und_treiber/linux/knoppix/KNOPPIX_V7.7.1
> DVD-2016-10-22-EN.iso'/>
> <target dev='hdb' bus='ide'/>
> <readonly/>
> <boot order='2'/>
> <address type='drive' controller='0' bus='0' target='0'
> unit='1'/>
> </disk -->
> <controller type='usb' index='0' model='ich9-ehci1'>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x05'
> function='0x7'/>
> </controller>
> <controller type='usb' index='0' model='ich9-uhci1'>
> <master startport='0'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x05'
> function='0x0' multifunction='on'/>
> </controller>
> <controller type='usb' index='0' model='ich9-uhci2'>
> <master startport='2'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x05'
> function='0x1'/>
> </controller>
> <controller type='usb' index='0' model='ich9-uhci3'>
> <master startport='4'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x05'
> function='0x2'/>
> </controller>
> <controller type='pci' index='0' model='pci-root'/>
> <controller type='ide' index='0'>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x01'
> function='0x1'/>
> </controller>
> <controller type='virtio-serial' index='0'>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x06'
> function='0x0'/>
> </controller>
> <interface type='bridge'>
> <mac address='00:50:56:00:00:13'/>
> <source bridge='br0'/>
> <model type='e1000'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x03'
> function='0x0'/>
> </interface>
> <serial type='pty'>
> <target port='0'/>
> </serial>
> <console type='pty'>
> <target type='serial' port='0'/>
> </console>
> <input type='mouse' bus='ps2'/>
> <input type='keyboard' bus='ps2'/>
> <input type='tablet' bus='usb'>
> <address type='usb' bus='0' port='3'/>
> </input>
> <graphics type='vnc' port='5910' autoport='no'
> listen='127.0.0.1'>
> <listen type='address' address='127.0.0.1'/>
> </graphics>
> <video>
> <model type='virtio' heads='1' primary='yes'/>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x02'
> function='0x0'/>
> </video>
> <redirdev bus='usb' type='spicevmc'>
> <address type='usb' bus='0' port='1'/>
> </redirdev>
> <redirdev bus='usb' type='spicevmc'>
> <address type='usb' bus='0' port='2'/>
> </redirdev>
> <memballoon model='virtio'>
> <address type='pci' domain='0x0000' bus='0x00' slot='0x07'
> function='0x0'/>
> </memballoon>
> </devices>
> </domain>
> Also in the libvirt config files i don't see a problem.
>
> BUT in the cib:
>
> <primitive id="vm_ssh" class="ocf" provider="heartbeat"
> type="VirtualDomain">
> <instance_attributes id="vm_snipanalysis-
> instance_attributes">
> <nvpair name="config" value="/mnt/share/vm_ssh.xml"
> id="vm_snipanalysis-instance_attributes-config"/> <======
> </instance_attributes>
> <instance_attributes id="vm_snipanalysis-instance_attributes-
> 0">
> <nvpair name="hypervisor" value="qemu:///system"
> id="vm_snipanalysis-instance_attributes-0-hypervisor"/> <==========
> </instance_attributes>
> <instance_attributes id="vm_snipanalysis-instance_attributes-
> 1">
> <nvpair name="migration_transport" value="ssh"
> id="vm_snipanalysis-instance_attributes-1-
> migration_transport"/> <=======
> </instance_attributes>
> <instance_attributes id="vm_snipanalysis-instance_attributes-
> 2">
> <nvpair name="migrate_options" value="--p2p --tunnelled"
> id="vm_snipanalysis-instance_attributes-2-migrate_options"/>
> </instance_attributes>
> <operations>
> <op name="start" interval="0" timeout="120"
> id="vm_snipanalysis-start-0"/>
> <op name="stop" interval="0" timeout="180"
> id="vm_snipanalysis-stop-0"/>
> <op name="monitor" interval="30" timeout="25"
> id="vm_snipanalysis-monitor-30"/>
> <op name="migrate_from" interval="0" timeout="300"
> id="vm_snipanalysis-migrate_from-0"/>
> <op name="migrate_to" interval="0" timeout="300"
> id="vm_snipanalysis-migrate_to-0"/>
> </operations>
> <meta_attributes id="vm_snipanalysis-meta_attributes">
> <nvpair name="allow-migrate" value="true"
> id="vm_snipanalysis-meta_attributes-allow-migrate"/>
> <nvpair name="target-role" value="Started"
> id="vm_snipanalysis-meta_attributes-target-role"/>
> <nvpair name="is-managed" value="true" id="vm_snipanalysis-
> meta_attributes-is-managed"/>
> <nvpair name="maintenance" value="false"
> id="vm_snipanalysis-meta_attributes-maintenance"/>
> </meta_attributes>
> <utilization id="vm_snipanalysis-utilization">
> <nvpair name="cpu" value="2" id="vm_snipanalysis-
> utilization-cpu"/>
> <nvpair name="hv_memory" value="4096" id="vm_snipanalysis-
> utilization-hv_memory"/>
> </utilization>
> </primitive>
>
> and
>
> <primitive id="vm_snipanalysis" class="ocf" provider="heartbeat"
> type="VirtualDomain">
> <instance_attributes id="vm_snipanalysis-instance_attributes-
> 3">
> <nvpair name="config"
> value="/mnt/share/vm_snipanalysis.xml" id="vm_snipanalysis-
> instance_attributes-3-config"/>
> </instance_attributes>
> <instance_attributes id="vm_snipanalysis-instance_attributes-
> 4">
> <nvpair name="hypervisor" value="qemu:///system"
> id="vm_snipanalysis-instance_attributes-4-hypervisor"/>
> </instance_attributes>
> <instance_attributes id="vm_snipanalysis-instance_attributes-
> 5">
> <nvpair name="migration_transport" value="ssh"
> id="vm_snipanalysis-instance_attributes-5-migration_transport"/>
> </instance_attributes>
> <instance_attributes id="vm_snipanalysis-instance_attributes-
> 6">
> <nvpair name="migrate_options" value="--p2p --tunnelled"
> id="vm_snipanalysis-instance_attributes-6-migrate_options"/>
> </instance_attributes>
> <operations>
> <op name="start" interval="0" timeout="120"
> id="vm_snipanalysis-start-0-0"/>
> <op name="stop" interval="0" timeout="180"
> id="vm_snipanalysis-stop-0-0"/>
> <op name="monitor" interval="30" timeout="25"
> id="vm_snipanalysis-monitor-30-0"/>
> <op name="migrate_from" interval="0" timeout="300"
> id="vm_snipanalysis-migrate_from-0-0"/>
> <op name="migrate_to" interval="0" timeout="300"
> id="vm_snipanalysis-migrate_to-0-0"/>
> </operations>
> <meta_attributes id="vm_snipanalysis-meta_attributes-0">
> <nvpair name="allow-migrate" value="true"
> id="vm_snipanalysis-meta_attributes-0-allow-migrate"/>
> <nvpair name="target-role" value="Stopped"
> id="vm_snipanalysis-meta_attributes-0-target-role"/>
> <nvpair name="is-managed" value="false"
> id="vm_snipanalysis-meta_attributes-0-is-managed"/>
> <nvpair name="maintenance" value="false"
> id="vm_snipanalysis-meta_attributes-0-maintenance"/>
> </meta_attributes>
> </primitive>
>
> The config of vm_snipanalysis seems to be ok.
> But vm_ssh ... why are some instance-attributes of it named with
> snapanalysis?
> I didn't change the configuration of both in the last weeks.
It's unlikely that changed at any time; more likely it was created like
that. Whatever was used to create the initial configuration would be
where to look for clues.
As long as the IDs are unique, their content doesn't matter to
pacemaker, so it's just a cosmetic issue.
>
> Does anyone have a clue ?
> Thanks.
>
> Bernd
>
--
Ken Gaillot <kgaillot at redhat.com>
More information about the Users
mailing list