<div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Oct 17, 2022 at 9:42 PM Ken Gaillot <<a href="mailto:kgaillot@redhat.com">kgaillot@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">This turned out to be interesting.<br>
<br>
In the first case, the resource history contains a start action and a<br>
recurring monitor. The parameters to both change, so the resource<br>
requires a restart.<br>
<br>
In the second case, the resource's history was apparently cleaned at<br>
some point, so the cluster re-probed it and found it running. That<br>
means its history contained only the probe and the recurring monitor.<br>
Neither probe nor recurring monitor changes require a restart, so<br>
nothing is done.<br>
<br>
It would probably make sense to distinguish between probes that found<br>
the resource running and probes that found it not running. Parameter<br>
changes in the former should probably be treated like start.<br></blockquote><div><br></div><div>Which leaves the non trivial task to the RA to determine during a probe</div><div>if a resource is not just running or stopped but has been started with </div><div>exactly those parameters - right? May be easy for some RAs and</div><div>a real issue for others. Not talking of which RA has it implemented</div><div>like that already. Error code would be generic-error to trigger a stop-start</div><div>- right?</div><div>If I'm getting it right even without that in depth checking on probe it</div><div>would have worked in this case as the probe happens before parameter</div><div>change.</div><div><br></div><div>Klaus  </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<br>
On Mon, 2022-10-17 at 12:43 +0200, Lentes, Bernd wrote:<br>
> Hi,<br>
> <br>
> i try to find out why there is sometimes a restart of the resource<br>
> and sometimes not.<br>
> Unpredictable behaviour is someting i expect from Windows, not from<br>
> Linux.<br>
> Here you see two "crm resource trace "resource"".<br>
> In the first case the resource is restarted , in the second not.<br>
> The command i used is identical in both cases.<br>
> <br>
> ha-idg-2:~/trace-untrace # date; crm resource trace vm-genetrap<br>
> Fri Oct 14 19:05:51 CEST 2022<br>
> INFO: Trace for vm-genetrap is written to<br>
> /var/lib/heartbeat/trace_ra/<br>
> INFO: Trace set, restart vm-genetrap to trace non-monitor operations<br>
> <br>
> =====================================================================<br>
> =============<br>
> <br>
> 1st try:<br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  Diff: --- 7.28974.3 2<br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  Diff: +++ 7.28975.0 299af44e1c8a3867f9e7a4b25f2c3d6a<br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  +  /cib:  @epoch=28975, @num_updates=0<br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++ /cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-monitor-<br>
> 30']:  <instance_attributes id="vm-genetrap-monitor-30-instance_a<br>
> ttributes"/><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                          <nvpair<br>
> name="trace_ra" value="1" id="vm-genetrap-monito<br>
> r-30-instance_attributes-trace_ra"/><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                        </instance_att<br>
> ributes><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++ /cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-stop-<br>
> 0']:  <instance_attributes id="vm-genetrap-stop-0-instance_attribute<br>
> s"/><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                      <nvpair<br>
> name="trace_ra" value="1" id="vm-genetrap-stop-0-ins<br>
> tance_attributes-trace_ra"/><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                    </instance_attribu<br>
> tes><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++ /cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-start-<br>
> 0']:  <instance_attributes id="vm-genetrap-start-0-instance_attribu<br>
> tes"/><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                       <nvpair<br>
> name="trace_ra" value="1" id="vm-genetrap-start-0-i<br>
> nstance_attributes-trace_ra"/><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                     </instance_attrib<br>
> utes><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++ /cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-migrate_from-<br>
> 0']:  <instance_attributes id="vm-genetrap-migrate_from-0-in<br>
> stance_attributes"/><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                              <nvpair<br>
> name="trace_ra" value="1" id="vm-genetrap-mi<br>
> grate_from-0-instance_attributes-trace_ra"/><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                            </instance<br>
> _attributes><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++ /cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-migrate_to-<br>
> 0']:  <instance_attributes id="vm-genetrap-migrate_to-0-instan<br>
> ce_attributes"/><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                            <nvpair<br>
> name="trace_ra" value="1" id="vm-genetrap-migr<br>
> ate_to-0-instance_attributes-trace_ra"/><br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                          </instance_a<br>
> ttributes><br>
> Oct 14 19:05:52 [26001] ha-idg-1       crmd:     info:<br>
> abort_transition_graph:  Transition 791 aborted by<br>
> instance_attributes.vm-genetrap-monitor-30-instance_attributes<br>
> 'create': Configuration change | cib=7.28975.0<br>
> source=te_update_diff_v2:483<br>
> path=/cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-monitor-30'] complete=true<br>
> Oct 14 19:05:52 [26001] ha-idg-1       crmd:   notice:<br>
> do_state_transition:     State transition S_IDLE -> S_POLICY_ENGINE |<br>
> input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph<br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_process_request:     Completed cib_apply_diff operation for<br>
> section 'all': OK (rc=0, origin=ha-idg-2/cibadmin/2,<br>
> version=7.28975.0)<br>
> Oct 14 19:05:52 [25997] ha-idg-1 stonith-ng:     info:<br>
> update_cib_stonith_devices_v2:   Updating device list from the cib:<br>
> create op[@id='vm-genetrap-monitor-30']<br>
> Oct 14 19:05:52 [25997] ha-idg-1 stonith-ng:     info:<br>
> cib_devices_update:      Updating devices to version 7.28975.0<br>
> Oct 14 19:05:52 [25997] ha-idg-1 stonith-ng:   notice:<br>
> unpack_config:   On loss of CCM Quorum: Ignore<br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_file_backup: Archived previous version as<br>
> /var/lib/pacemaker/cib/cib-68.raw<br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_file_write_with_digest:      Wrote version 7.28975.0 of the CIB<br>
> to disk (digest: d1ef5a98039f28697320c1eba4ca02cc)<br>
> Oct 14 19:05:52 [25996] ha-idg-1        cib:     info:<br>
> cib_file_write_with_digest:      Reading cluster configuration file<br>
> /var/lib/pacemaker/cib/cib.WIMMCF (digest:<br>
> /var/lib/pacemaker/cib/cib.NfxNwG)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:   notice:<br>
> unpack_config:   On loss of CCM Quorum: Ignore<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status_fencing: Node ha-idg-1 is active<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status: Node ha-idg-1 is online<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status_fencing: Node ha-idg-2 is active<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status: Node ha-idg-2 is online<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777482 is already processed<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777492 is already processed<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777482 is already processed<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777492 is already processed<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    fence_ilo_ha-idg-<br>
> 2      (stonith:fence_ilo2):   Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    fence_ilo_ha-idg-<br>
> 1      (stonith:fence_ilo4):   Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> clone_print:      Clone Set: cl_share [gr_share]<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> short_print:          Started: [ ha-idg-1 ha-idg-2 ]<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> clone_print:      Clone Set: ClusterMon-clone [ClusterMon-SMTP]<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> short_print:          Stopped (disabled): [ ha-idg-1 ha-idg-2 ]<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> mausdb       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-sim  (ocf::lentes:VirtualDomain):    Started ha-<br>
> idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> geneious     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-idcc-<br>
> devel   (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> genetrap     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-mouseidgenes<br>
> (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> greensql     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> severin      (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    ping_19216810010        (ocf::pacemaker:ping):  Stop<br>
> ped (disabled)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    ping_19216810020        (ocf::pacemaker:ping):  Stop<br>
> ped (disabled)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm_crispor      (ocf::heartbeat:VirtualDomain):<br>
> Stopped (unmanaged)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> dietrich     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> pathway      (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-crispor-<br>
> server       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-geneious-<br>
> license     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-nc-<br>
> mcd       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-amok (ocf::lentes:VirtualDomain):    Started ha-<br>
> idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-geneious-license-mcd<br>
> (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-documents-oo<br>
> (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    fs_test_ocfs2   (ocf::lentes:Filesystem.new):   Star<br>
> ted ha-idg-2<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-ssh  (ocf::lentes:VirtualDomain):    Started ha-<br>
> idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm_snipanalysis<br>
> (ocf::lentes:VirtualDomain):    Stopped (disabled, unmanaged)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> seneca       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> photoshop    (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-check-<br>
> mk     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> encore       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> <br>
> -------------------------------------------------------------------<br>
> -------------------------------------------------<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> rsc_action_digest_cmp:   Parameters to vm-genetrap_start_0 on ha-idg-<br>
> 1 changed: was e2eeb4e5d1604535fabae9ce5407d685 vs. now<br>
> 516b745764a83d26e0d73daf2c65ca38 (reload:3.0.14)<br>
> 0:0;82:692:0:167bea02-e39a-4fbc-a09f-3ba4d704c4f9<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> check_action_definition: params:reload   <parameters<br>
> migration_network_suffix="-private" migrate_options="--verbose"<br>
> migration_transport="ssh" shutdown_mode="acpi,agent"<br>
> config="/mnt/share/vm_genetrap.xml" hypervisor="qemu:///system"<br>
> trace_ra="1"/><br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> rsc_action_digest_cmp:   Parameters to vm-genetrap_monitor_30000 on<br>
> ha-idg-1 changed: was 2c5e72e3ebb855036a484cb7e2823f92 vs. now<br>
> d81c72a6c99d1a5c2defaa830fb82b23 (reschedule:3.0.14)<br>
> 0:0;83:692:0:167bea02-e39a-4fbc-a09f-3ba4d704c4f9<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> check_action_definition: params:reload   <parameters<br>
> migration_network_suffix="-private" migrate_options="--verbose"<br>
> migration_transport="ssh" shutdown_mode="acpi,agent"<br>
> config="/mnt/share/vm_genetrap.xml" hypervisor="qemu:///system"<br>
> trace_ra="1" CRM_meta_timeout="25000"/><br>
> -------------------------------------------------------------------<br>
> --------------------------------------------------<br>
> <br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Resource ClusterMon-SMTP:0 cannot run<br>
> anywhere<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Resource ClusterMon-SMTP:1 cannot run<br>
> anywhere<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Resource ping_19216810010 cannot run<br>
> anywhere<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Resource ping_19216810020 cannot run<br>
> anywhere<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Unmanaged resource vm_crispor allocated to<br>
> no node: inactive<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Unmanaged resource vm_snipanalysis allocated<br>
> to no node: inactive<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> RecurringOp:      Start recurring monitor (30s) for vm-genetrap on<br>
> ha-idg-1<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   fence_ilo_ha-idg-2      (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   fence_ilo_ha-idg-1      (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   dlm:0   (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   clvmd:0 (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   gfs2_share:0    (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   gfs2_snap:0     (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   fs_ocfs2:0      (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   dlm:1   (Started ha-idg-2)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   clvmd:1 (Started ha-idg-2)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   gfs2_share:1    (Started ha-idg-2)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   gfs2_snap:1     (Started ha-idg-2)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   fs_ocfs2:1      (Started ha-idg-2)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   ClusterMon-SMTP:0       (Stopped)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   ClusterMon-SMTP:1       (Stopped)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-mausdb       (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-sim  (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-geneious     (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-idcc-devel   (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:   notice:<br>
> LogAction:        * Restart    vm-genetrap                 ( ha-idg-1 <br>
> )   due to resource definition change<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-mouseidgenes (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-greensql     (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-severin      (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   ping_19216810010        (Stopped)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   ping_19216810020        (Stopped)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm_crispor      (Stopped unmanaged)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-dietrich     (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-pathway      (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-crispor-server       (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-geneious-license     (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-nc-mcd       (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-amok (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-geneious-license-mcd (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-documents-oo (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   fs_test_ocfs2   (Started ha-idg-2)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-ssh  (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm_snipanalysis (Stopped unmanaged)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-seneca       (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-photoshop    (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-check-mk     (Started ha-idg-1)<br>
> Oct 14 19:05:52 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-encore       (Started ha-idg-1)<br>
> <br>
> restart !!!!!<br>
> <br>
> =====================================================================<br>
> =================<br>
> <br>
> 2nd try:<br>
> <br>
> ha-idg-2:~/trace-untrace # cibadmin -Q|grep trace|grep genetrap<br>
> ha-idg-2:~/trace-untrace #<br>
> ha-idg-2:~/trace-untrace # date; crm resource trace vm-genetrap<br>
> Fri Oct 14 19:26:32 CEST 2022<br>
> INFO: Trace for vm-genetrap is written to<br>
> /var/lib/heartbeat/trace_ra/<br>
> INFO: Trace set, restart vm-genetrap to trace non-monitor operations<br>
> <br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  Diff: --- 7.28977.1 2<br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  Diff: +++ 7.28978.0 941fea150a15ecf82f00290ff9ecae0e<br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  +  /cib:  @epoch=28978, @num_updates=0<br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++ /cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-monitor-<br>
> 30']:  <instance_attributes id="vm-genetrap-monitor-30-instance_a<br>
> ttributes"/><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                          <nvpair<br>
> name="trace_ra" value="1" id="vm-genetrap-monito<br>
> r-30-instance_attributes-trace_ra"/><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                        </instance_att<br>
> ributes><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++ /cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-stop-<br>
> 0']:  <instance_attributes id="vm-genetrap-stop-0-instance_attribute<br>
> s"/><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                      <nvpair<br>
> name="trace_ra" value="1" id="vm-genetrap-stop-0-ins<br>
> tance_attributes-trace_ra"/><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                    </instance_attribu<br>
> tes><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++ /cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-start-<br>
> 0']:  <instance_attributes id="vm-genetrap-start-0-instance_attribu<br>
> tes"/><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                       <nvpair<br>
> name="trace_ra" value="1" id="vm-genetrap-start-0-i<br>
> nstance_attributes-trace_ra"/><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                     </instance_attrib<br>
> utes><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++ /cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-migrate_from-<br>
> 0']:  <instance_attributes id="vm-genetrap-migrate_from-0-in<br>
> stance_attributes"/><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                              <nvpair<br>
> name="trace_ra" value="1" id="vm-genetrap-mi<br>
> grate_from-0-instance_attributes-trace_ra"/><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                            </instance<br>
> _attributes><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++ /cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-migrate_to-<br>
> 0']:  <instance_attributes id="vm-genetrap-migrate_to-0-instan<br>
> ce_attributes"/><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                            <nvpair<br>
> name="trace_ra" value="1" id="vm-genetrap-migr<br>
> ate_to-0-instance_attributes-trace_ra"/><br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_perform_op:  ++                                                  <br>
>                                                          </instance_a<br>
> ttributes><br>
> Oct 14 19:26:33 [26001] ha-idg-1       crmd:     info:<br>
> abort_transition_graph:  Transition 797 aborted by<br>
> instance_attributes.vm-genetrap-monitor-30-instance_attributes<br>
> 'create': Configuration change | cib=7.28978.0 source=te_update_diff<br>
> _v2:483 path=/cib/configuration/resources/primitive[@id='vm-<br>
> genetrap']/operations/op[@id='vm-genetrap-monitor-30'] complete=true<br>
> Oct 14 19:26:33 [26001] ha-idg-1       crmd:   notice:<br>
> do_state_transition:     State transition S_IDLE -> S_POLICY_ENGINE |<br>
> input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph<br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_process_request:     Completed cib_apply_diff operation for<br>
> section 'all': OK (rc=0, origin=ha-idg-2/cibadmin/2,<br>
> version=7.28978.0)<br>
> Oct 14 19:26:33 [25997] ha-idg-1 stonith-ng:     info:<br>
> update_cib_stonith_devices_v2:   Updating device list from the cib:<br>
> create op[@id='vm-genetrap-monitor-30']<br>
> Oct 14 19:26:33 [25997] ha-idg-1 stonith-ng:     info:<br>
> cib_devices_update:      Updating devices to version 7.28978.0<br>
> Oct 14 19:26:33 [25997] ha-idg-1 stonith-ng:   notice:<br>
> unpack_config:   On loss of CCM Quorum: Ignore<br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_file_backup: Archived previous version as<br>
> /var/lib/pacemaker/cib/cib-71.raw<br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_file_write_with_digest:      Wrote version 7.28978.0 of the CIB<br>
> to disk (digest: 69dc34584ba70cfb6868a00a3c59c45f)<br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_file_write_with_digest:      Reading cluster configuration file<br>
> /var/lib/pacemaker/cib/cib.JQq4Ul (digest:<br>
> /var/lib/pacemaker/cib/cib.GeC2uK)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:   notice:<br>
> unpack_config:   On loss of CCM Quorum: Ignore<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status_fencing: Node ha-idg-1 is active<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status: Node ha-idg-1 is online<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status_fencing: Node ha-idg-2 is active<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status: Node ha-idg-2 is online<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_op_status:     Operation monitor found resource vm-genetrap <br>
> active on ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_op_status:     Operation monitor found resource vm-genetrap <br>
> active on ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777482 is already processed<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777492 is already processed<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777482 is already processed<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777492 is already processed<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    fence_ilo_ha-idg-<br>
> 2      (stonith:fence_ilo2):   Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    fence_ilo_ha-idg-<br>
> 1      (stonith:fence_ilo4):   Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> clone_print:      Clone Set: cl_share [gr_share]<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> short_print:          Started: [ ha-idg-1 ha-idg-2 ]<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> clone_print:      Clone Set: ClusterMon-clone [ClusterMon-SMTP]<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> short_print:          Stopped (disabled): [ ha-idg-1 ha-idg-2 ]<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> mausdb       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-sim  (ocf::lentes:VirtualDomain):    Started ha-<br>
> idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> geneious     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-idcc-<br>
> devel   (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> genetrap     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-mouseidgenes<br>
> (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> greensql     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> severin      (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    ping_19216810010        (ocf::pacemaker:ping):  Stop<br>
> ped (disabled)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    ping_19216810020        (ocf::pacemaker:ping):  Stop<br>
> ped (disabled)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm_crispor      (ocf::heartbeat:VirtualDomain):<br>
> Stopped (unmanaged)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> dietrich     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> pathway      (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-crispor-<br>
> server       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-geneious-<br>
> license     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-nc-<br>
> mcd       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-amok (ocf::lentes:VirtualDomain):    Started ha-<br>
> idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-geneious-license-mcd<br>
> (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-documents-oo<br>
> (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    fs_test_ocfs2   (ocf::lentes:Filesystem.new):   Star<br>
> ted ha-idg-2<br>
> Oct 14 19:26:33 [26001] ha-idg-1       crmd:   notice:<br>
> do_state_transition:     State transition S_IDLE -> S_POLICY_ENGINE |<br>
> input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph<br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_process_request:     Completed cib_apply_diff operation for<br>
> section 'all': OK (rc=0, origin=ha-idg-2/cibadmin/2,<br>
> version=7.28978.0)<br>
> Oct 14 19:26:33 [25997] ha-idg-1 stonith-ng:     info:<br>
> update_cib_stonith_devices_v2:   Updating device list from the cib:<br>
> create op[@id='vm-genetrap-monitor-30']<br>
> Oct 14 19:26:33 [25997] ha-idg-1 stonith-ng:     info:<br>
> cib_devices_update:      Updating devices to version 7.28978.0<br>
> Oct 14 19:26:33 [25997] ha-idg-1 stonith-ng:   notice:<br>
> unpack_config:   On loss of CCM Quorum: Ignore<br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_file_backup: Archived previous version as<br>
> /var/lib/pacemaker/cib/cib-71.raw<br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_file_write_with_digest:      Wrote version 7.28978.0 of the CIB<br>
> to disk (digest: 69dc34584ba70cfb6868a00a3c59c45f)<br>
> Oct 14 19:26:33 [25996] ha-idg-1        cib:     info:<br>
> cib_file_write_with_digest:      Reading cluster configuration file<br>
> /var/lib/pacemaker/cib/cib.JQq4Ul (digest:<br>
> /var/lib/pacemaker/cib/cib.GeC2uK)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:   notice:<br>
> unpack_config:   On loss of CCM Quorum: Ignore<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status_fencing: Node ha-idg-1 is active<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status: Node ha-idg-1 is online<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status_fencing: Node ha-idg-2 is active<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_online_status: Node ha-idg-2 is online<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_op_status:     Operation monitor found resource vm-genetrap <br>
> active on ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> determine_op_status:     Operation monitor found resource vm-genetrap <br>
> active on ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777482 is already processed<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777492 is already processed<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777482 is already processed<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> unpack_node_loop:        Node 1084777492 is already processed<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    fence_ilo_ha-idg-<br>
> 2      (stonith:fence_ilo2):   Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    fence_ilo_ha-idg-<br>
> 1      (stonith:fence_ilo4):   Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> clone_print:      Clone Set: cl_share [gr_share]<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> short_print:          Started: [ ha-idg-1 ha-idg-2 ]<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> clone_print:      Clone Set: ClusterMon-clone [ClusterMon-SMTP]<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> short_print:          Stopped (disabled): [ ha-idg-1 ha-idg-2 ]<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> mausdb       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-sim  (ocf::lentes:VirtualDomain):    Started ha-<br>
> idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> geneious     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-idcc-<br>
> devel   (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> genetrap     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-mouseidgenes<br>
> (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> greensql     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> severin      (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    ping_19216810010        (ocf::pacemaker:ping):  Stop<br>
> ped (disabled)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    ping_19216810020        (ocf::pacemaker:ping):  Stop<br>
> ped (disabled)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm_crispor      (ocf::heartbeat:VirtualDomain):<br>
> Stopped (unmanaged)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> dietrich     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> pathway      (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-crispor-<br>
> server       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-geneious-<br>
> license     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-nc-<br>
> mcd       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-amok (ocf::lentes:VirtualDomain):    Started ha-<br>
> idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-geneious-license-mcd<br>
> (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-documents-oo<br>
> (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    fs_test_ocfs2   (ocf::lentes:Filesystem.new):   Star<br>
> ted ha-idg-2<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-ssh  (ocf::lentes:VirtualDomain):    Started ha-<br>
> idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm_snipanalysis<br>
> (ocf::lentes:VirtualDomain):    Stopped (disabled, unmanaged)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> seneca       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> photoshop    (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-check-<br>
> mk     (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> common_print:    vm-<br>
> encore       (ocf::lentes:VirtualDomain):    Started ha-idg-1<br>
> <br>
> -------------------------------------------------------------------<br>
> ----------------------------<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> rsc_action_digest_cmp:   Parameters to vm-genetrap_monitor_30000 on<br>
> ha-idg-1 changed: was 2c5e72e3ebb855036a484cb7e2823f92 vs. now<br>
> d81c72a6c99d1a5c2defaa830fb82b23 (reschedule:3.0.14)<br>
> 0:0;28:797:0:167bea02-e39a-4fbc-a09f-3ba4d704c4f9<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> check_action_definition: params:reload   <parameters<br>
> migration_network_suffix="-private" migrate_options="--verbose"<br>
> migration_transport="ssh" shutdown_mode="acpi,agent"<br>
> config="/mnt/share/vm_genetrap.xml" hypervisor="qemu:///system"<br>
> trace_ra="1" CRM_meta_timeout="25000"/><br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Resource ClusterMon-SMTP:0 cannot run<br>
> anywhere<br>
> -------------------------------------------------------------------<br>
> -----------------------------<br>
> <br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Resource ClusterMon-SMTP:1 cannot run<br>
> anywhere<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Resource ping_19216810010 cannot run<br>
> anywhere<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Resource ping_19216810020 cannot run<br>
> anywhere<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Unmanaged resource vm_crispor allocated to<br>
> no node: inactive<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> pcmk__native_allocate:   Unmanaged resource vm_snipanalysis allocated<br>
> to no node: inactive<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> RecurringOp:      Start recurring monitor (30s) for vm-genetrap on<br>
> ha-idg-1<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   fence_ilo_ha-idg-2      (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   fence_ilo_ha-idg-1      (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   dlm:0   (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   clvmd:0 (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   gfs2_share:0    (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   gfs2_snap:0     (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   fs_ocfs2:0      (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   dlm:1   (Started ha-idg-2)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   clvmd:1 (Started ha-idg-2)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   gfs2_share:1    (Started ha-idg-2)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   gfs2_snap:1     (Started ha-idg-2)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   fs_ocfs2:1      (Started ha-idg-2)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   ClusterMon-SMTP:0       (Stopped)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   ClusterMon-SMTP:1       (Stopped)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-mausdb       (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-sim  (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-geneious     (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-idcc-devel   (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-genetrap     (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-mouseidgenes (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-greensql     (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-severin      (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   ping_19216810010        (Stopped)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   ping_19216810020        (Stopped)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm_crispor      (Stopped unmanaged)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-dietrich     (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-pathway      (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-crispor-server       (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-geneious-license     (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-nc-mcd       (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-amok (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-geneious-license-mcd (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-documents-oo (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   fs_test_ocfs2   (Started ha-idg-2)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-ssh  (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm_snipanalysis (Stopped unmanaged)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-seneca       (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-photoshop    (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-check-mk     (Started ha-idg-1)<br>
> Oct 14 19:26:33 [26000] ha-idg-1    pengine:     info:<br>
> LogActions:      Leave   vm-encore       (Started ha-idg-1)<br>
> <br>
> no restart !!!<br>
> <br>
> There is only one difference i see is the section i marked with "--<br>
> -------- ".<br>
> But i don't understand why this is different.<br>
> <br>
> Bernd<br>
> _______________________________________________<br>
> Manage your subscription:<br>
> <a href="https://lists.clusterlabs.org/mailman/listinfo/users" rel="noreferrer" target="_blank">https://lists.clusterlabs.org/mailman/listinfo/users</a><br>
> <br>
> ClusterLabs home: <a href="https://www.clusterlabs.org/" rel="noreferrer" target="_blank">https://www.clusterlabs.org/</a><br>
-- <br>
Ken Gaillot <<a href="mailto:kgaillot@redhat.com" target="_blank">kgaillot@redhat.com</a>><br>
<br>
_______________________________________________<br>
Manage your subscription:<br>
<a href="https://lists.clusterlabs.org/mailman/listinfo/users" rel="noreferrer" target="_blank">https://lists.clusterlabs.org/mailman/listinfo/users</a><br>
<br>
ClusterLabs home: <a href="https://www.clusterlabs.org/" rel="noreferrer" target="_blank">https://www.clusterlabs.org/</a><br>
<br>
</blockquote></div></div>