<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Segoe UI";
panose-1:2 11 5 2 4 2 4 2 2 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="FR" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Reid,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">I have activated the trace mode on the MYSQL resource on my lab and I rebooted Node2, after reboot:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">+ echo Node1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">+ tr -d<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">+ master_host=Node1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">+ echo Node1<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">+ [ Node1 -a Node1 != Node2 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">+ ocf_log info Changing MySQL configuration to replicate from zabbixmysqlmaster01.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">I can see that the variable "master_host" is well filled.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">In production, I did the same thing and variable “master_host” is not filled:
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">+ echo<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">+ tr -d<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">+ master_host=<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">+ [ -a != Node2 ]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">+ ocf_log info No MySQL master present - clearing replication state<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">That is why I would like to know concretely what the variable
</span><span lang="EN-US">"$OCF_RESKEY_CRM_meta_notify_master_uname"</span><span lang="EN-US" style="mso-fareast-language:EN-US"> does.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">How is the master_host name retrieved?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">Best regards,<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="background:white;border-collapse:collapse">
<tbody>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="line-height:18.75pt"><span style="font-size:13.0pt;color:#1E195A">Thomas Cas</span><span style="color:#3C566A"> </span><span style="font-size:13.0pt;color:#FF7828"> | Technicien du support infogérance</span><span style="color:#3C566A"><o:p></o:p></span></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="line-height:18.75pt"><span lang="EN-US" style="font-size:10.0pt;color:#1E195A">PHONE : </span><span lang="EN-US" style="color:black">+33 3 51 25 23 26
</span><span lang="EN-US" style="font-size:10.0pt;color:#002060">WEB :</span><span lang="EN-US" style="color:black"> </span><span style="color:black"><a href="https://www.ikoula.com/en"><span lang="EN-US" style="color:black">www.ikoula.com/en</span></a></span><span lang="EN-US" style="font-size:10.0pt;color:#111111"><o:p></o:p></span></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="line-height:18.75pt"><span style="font-size:10.0pt;color:#111111">IKOULA Data Center 34 rue Pont Assy - 51100 Reims - FRANCE</span><o:p></o:p></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="line-height:21.0pt"><span lang="EN-US" style="font-size:10.0pt;color:#336600">Before printing this letter, think about the impact on the environment!</span><span lang="EN-US" style="color:#3C566A"><o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="background:white;border-collapse:collapse">
<tbody>
<tr>
<td valign="bottom" style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal"><span style="color:black"><a href="https://www.ikoula.com/en"><span style="color:#428BCA;text-decoration:none"><img border="0" width="268" height="91" style="width:2.7916in;height:.9479in" id="Image_x0020_13" src="cid:image001.png@01D93239.E745B450" alt="Ikoula"></span></a></span><span style="color:black"> </span><o:p></o:p></p>
</td>
<td valign="bottom" style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="margin-bottom:22.5pt"><span style="color:black"><a href="https://twitter.com/ikoula_en" title="Twitter Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="Image_x0020_14" src="cid:image002.png@01D93239.E745B450" alt="Twitter"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="https://www.linkedin.com/company/ikoula" title="Linkedin Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="Image_x0020_15" src="cid:image003.png@01D93239.E745B450" alt="Linkedin"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="http://www.youtube.fr/ikoulanet" title="YouTube Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="Image_x0020_16" src="cid:image004.png@01D93239.E745B450" alt="Youtube"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="https://pressroom.ikoula.com/" title="Pressroom Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="Image_x0020_17" src="cid:image005.png@01D93239.E745B450" alt="Pressroom"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="https://blog.ikoula.com/en" title="Blog Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="Image_x0020_18" src="cid:image006.png@01D93239.E745B450" alt="Blog"></span></a></span><span style="color:#3C566A"> <o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US">De :</span></b><span lang="EN-US"> Reid Wahl <nwahl@redhat.com>
<br>
<b>Envoyé :</b> vendredi 27 janvier 2023 09:32<br>
<b>À :</b> Thomas CAS <tcas@ikoula.com><br>
<b>Cc :</b> Cluster Labs - All topics related to open-source clustering welcomed <users@clusterlabs.org><br>
<b>Objet :</b> Re: [ClusterLabs] Problem with MariaDB cluster<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal">On Fri, Jan 27, 2023 at 12:23 AM Thomas CAS <<a href="mailto:tcas@ikoula.com">tcas@ikoula.com</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hello Reid,<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Thank you so much for your answer and bug report.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">If it is a bug, I do not understand why the problem is present in production but not on my lab which is identical?</span><o:p></o:p></p>
</div>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">That's a good question. I'm not sure, and I haven't worked much with this resource agent. Does the lab show interesting logs at all from the resource agent during startup? I wonder if it's hitting the same "No MySQL master present" issue
but *not* the error that follows. That error is coming from mysql itself, not from the resource agent.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">After the agent hits the "No MySQL master present" issue, it calls the unset_master() function. You can take a look at the agent script (in /usr/lib/ocf/resource.d/heartbeat/mysql by default) to see all the things that unset_master() is
doing, and try to determine what's behaving differently in production vs. lab.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">What does the "$OCF_RESKEY_CRM_meta_notify_master_uname" variable do? (which shell command is done through this variable)</span><o:p></o:p></p>
</div>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Pacemaker sets it during a resource's notify operation. It's set to some information that's used only during a notify operation, and it's unset otherwise. You can see some other similar meta variables in the mysql_notify() function. The
mysql_notify() function gets called during a notify operation, so those variables might be set. They won't be set when mysql_start() is called during a start operation.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Best regards,</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="background:white;border-collapse:collapse">
<tbody>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:18.75pt">
<span style="font-size:13.0pt;color:#1E195A">Thomas Cas</span><span style="color:#3C566A"> </span><span style="font-size:13.0pt;color:#FF7828"> | Technicien du support infogérance</span><o:p></o:p></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:18.75pt">
<span lang="EN-US" style="font-size:10.0pt;color:#1E195A">PHONE : </span><span lang="EN-US" style="color:black">+33 3 51 25 23 26
</span><span lang="EN-US" style="font-size:10.0pt;color:#002060">WEB :</span><span lang="EN-US" style="color:black"> </span><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ikoula.com%2Fen&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570154976%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=uNarHoMr%2FuGeTV6PG6OWomI%2Fuu80OgcY2ER8IYBXv6s%3D&reserved=0" target="_blank"><span lang="EN-US" style="color:black">www.ikoula.com/en</span></a></span><o:p></o:p></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:18.75pt">
<span style="font-size:10.0pt;color:#111111">IKOULA Data Center 34 rue Pont Assy - 51100 Reims - FRANCE</span><o:p></o:p></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:21.0pt">
<span lang="EN-US" style="font-size:10.0pt;color:#336600">Before printing this letter, think about the impact on the environment!</span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="background:white;border-collapse:collapse">
<tbody>
<tr>
<td valign="bottom" style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ikoula.com%2Fen&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=h8av%2BxS5nwirxw2yo0QqWLYhrGQo4Lz%2F6ysNY6T2Ors%3D&reserved=0" target="_blank"><span style="color:#428BCA;text-decoration:none"><img border="0" width="268" height="91" style="width:2.7916in;height:.9479in" id="m_177347375138369734Image_x0020_7" src="cid:image001.png@01D93239.E745B450" alt="Ikoula"></span></a> </span><o:p></o:p></p>
</td>
<td valign="bottom" style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:22.5pt"><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2Fikoula_en&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=01Qxj8kQM5dPETsPR79XKdFiw6naohw8hfdxQu5aJ4w%3D&reserved=0" target="_blank" title="Twitter Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="m_177347375138369734Image_x0020_8" src="cid:image002.png@01D93239.E745B450" alt="Twitter"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fikoula&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=rhf%2F3YDXmJBMWRYJdg0AZ3YmkXVUVEosXpXzonOMWIE%3D&reserved=0" target="_blank" title="Linkedin Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="m_177347375138369734Image_x0020_9" src="cid:image003.png@01D93239.E745B450" alt="Linkedin"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.youtube.fr%2Fikoulanet&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5gh3ZTTfeW0BMgSoconZDKkqjGPHvWtqyoBNBk4ovpQ%3D&reserved=0" target="_blank" title="YouTube Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="m_177347375138369734Image_x0020_10" src="cid:image004.png@01D93239.E745B450" alt="Youtube"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpressroom.ikoula.com%2F&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=4konuDkG%2Bu1PBTKfyeCHpz6xL%2BgkQQCoQOfbGEhdy8c%3D&reserved=0" target="_blank" title="Pressroom Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="m_177347375138369734Image_x0020_11" src="cid:image005.png@01D93239.E745B450" alt="Pressroom"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.ikoula.com%2Fen&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NReeC%2BRXLPcjWP%2F1mf87SrQaWlZ2dVEfdCvhiKctiTo%3D&reserved=0" target="_blank" title="Blog Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="m_177347375138369734Image_x0020_12" src="cid:image006.png@01D93239.E745B450" alt="Blog"></span></a></span><span style="color:#3C566A"> </span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid windowtext 1.0pt;padding:3.0pt 0cm 0cm 0cm;border-color:currentcolor currentcolor">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US">De :</span></b><span lang="EN-US"> Reid Wahl <<a href="mailto:nwahl@redhat.com" target="_blank">nwahl@redhat.com</a>>
<br>
<b>Envoyé :</b> jeudi 26 janvier 2023 20:31<br>
<b>À :</b> Cluster Labs - All topics related to open-source clustering welcomed <<a href="mailto:users@clusterlabs.org" target="_blank">users@clusterlabs.org</a>>; Thomas CAS <<a href="mailto:tcas@ikoula.com" target="_blank">tcas@ikoula.com</a>><br>
<b>Objet :</b> Re: [ClusterLabs] Problem with MariaDB cluster</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" align="left" width="100%" style="width:100.0%">
<tbody>
<tr>
<td style="background:#A6A6A6;padding:5.25pt 1.5pt 5.25pt 1.5pt"></td>
<td width="100%" style="width:100.0%;background:#EAEAEA;padding:5.25pt 3.75pt 5.25pt 11.25pt">
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;mso-element:frame;mso-element-frame-hspace:2.25pt;mso-element-wrap:around;mso-element-anchor-vertical:paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly">
<span style="font-size:9.0pt;font-family:"Segoe UI",sans-serif;color:#212121">Vous ne recevez pas souvent de courriers de la part de
<a href="mailto:nwahl@redhat.com" target="_blank">nwahl@redhat.com</a>. <a href="https://aka.ms/LearnAboutSenderIdentification" target="_blank">
Découvrez pourquoi cela est important</a></span><o:p></o:p></p>
</div>
</td>
<td width="75" style="width:56.25pt;background:#EAEAEA;padding:5.25pt 3.75pt 5.25pt 3.75pt">
</td>
</tr>
</tbody>
</table>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">On Thu, Jan 26, 2023 at 7:39 AM Thomas CAS <<a href="mailto:tcas@ikoula.com" target="_blank">tcas@ikoula.com</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Hello,</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">I'm having trouble with a MariaDB cluster (2 nodes, master-slave) on Debian 11.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">I don't know what to do anymore.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US">Environment:</span></b><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Node1:
</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> OS: Debian 11</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Kernel: 5.10.0-21-amd64 #1 SMP Debian 5.10.162-1 (2023-01-21)</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Versions: resource-agents (4.7.0-1), pacemaker (2.0.5-2), corosync (3.1.2-2), mariadb (10.5.18-0+deb11u1)</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Node2:
</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> OS: Debian 11</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Kernel: 5.10.0-21-amd64 #1 SMP Debian 5.10.162-1 (2023-01-21)</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Versions: resource-agents (4.7.0-1), pacemaker (2.0.5-2), corosync (3.1.2-2), mariadb (10.5.18-0+deb11u1)</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">crm configure show as attachment.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US">Problem:
</span></b><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US"> </span></b><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">When I restart Node2 (which is a slave), it goes up correctly in the cluster:</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">$ crm status</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Cluster Summary:</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> * Stack: corosync</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> * Current DC: Node1 (version 2.0.5-ba59be7122) - partition with quorum</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> * Last updated: Thu Jan 26 12:04:57 2023</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> * Last change: Thu Jan 26 11:39:58 2023 by root via cibadmin on Node2</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> * 2 nodes configured</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> * 3 resource instances configured</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Node List:</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> * Online: [ Node1 Node2 ]</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Full List of Resources:</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> * VIP (ocf::heartbeat:IPaddr2): Started Node1</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> * Clone Set: MYSQLREPLICATOR [MYSQL] (promotable):</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> * Masters: [ Node1 ]</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> * Slaves: [ Node2 ]</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">But it does not retrieve the replication information. (SHOW SLAVE STATUS; returns nothing)</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">In the Node2 logs, I can see this message that explains that replication is not taking place:</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="border-collapse:collapse">
<tbody>
<tr>
<td width="626" valign="top" style="width:469.8pt;border:solid windowtext 1.0pt;background:black;padding:0cm 5.4pt 0cm 5.4pt">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white">Jan 25 16:29:38 mysql(MYSQL)[22862]: INFO: No MySQL master present - clearing replication state</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white">Jan 25 16:29:39 mysql(MYSQL)[22862]: WARNING: MySQL Slave IO threads currently not running.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white">Jan 25 16:29:39 mysql(MYSQL)[22862]: ERROR: MySQL Slave SQL threads currently not running.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white">Jan 25 16:29:39 mysql(MYSQL)[22862]: ERROR: See for details</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white">Jan 25 16:29:39 mysql(MYSQL)[22862]: ERROR: ERROR 1200 (HY000) at line 1: Misconfigured slave: MASTER_HOST was not set; Fix in config
file or with CHANGE MASTER TO</span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">From what I see in the following file, Node2 does not seem to find the master name. So it clears its replication information:</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">/usr/lib/ocf/resource.d/heartbeat/mysql</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="border-collapse:collapse">
<tbody>
<tr>
<td width="626" valign="top" style="width:469.8pt;border:solid windowtext 1.0pt;background:black;padding:0cm 5.4pt 0cm 5.4pt">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> master_host=`echo $OCF_RESKEY_CRM_meta_notify_master_uname|tr -d " "`</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> if [ "$master_host" -a "$master_host" != ${NODENAME} ]; then</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> ocf_log info "Changing MySQL configuration to replicate from $master_host."</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> set_master</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> start_slave</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> if [ $? -ne 0 ]; then</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> ocf_exit_reason "Failed to start slave"</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> return $OCF_ERR_GENERIC</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> fi</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> else</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> ocf_log info "No MySQL master present - clearing replication state"</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> unset_master</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="color:white"> fi</span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">As it is a production environment, I performed a bare metal restore of these machines on 2 LAB machines and I have no problem…</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">In production, there is a lot of writing but the servers are far from being saturated.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US">Thank you in advance for all the help you can give me.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"><br>
Best regards,</span><o:p></o:p></p>
</div>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I'm sorry you've encountered this.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I don't understand why the resource agent checks $OCF_RESKEY_CRM_meta_notify_master_uname during the start operation. That value gets set only during a notify operation. That looks
like a bug in the resource agent.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I've filed an issue against it here:
<a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FClusterLabs%2Fresource-agents%2Fissues%2F1839&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1rZ5TyqG4PhgpfaJr%2FrRp9retwphLm2Ifm669sVx3p4%3D&reserved=0" target="_blank">
https://github.com/ClusterLabs/resource-agents/issues/1839</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="background:white;border-collapse:collapse">
<tbody>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:18.75pt">
<span style="font-size:13.0pt;color:#1E195A">Thomas Cas</span><span style="color:#3C566A"> </span><span style="font-size:13.0pt;color:#FF7828"> | Technicien du support infogérance</span><o:p></o:p></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:18.75pt">
<span lang="EN-US" style="font-size:10.0pt;color:#1E195A">PHONE : </span><span lang="EN-US" style="color:black">+33 3 51 25 23 26
</span><span lang="EN-US" style="font-size:10.0pt;color:#002060">WEB :</span><span lang="EN-US" style="color:black"> </span><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ikoula.com%2Fen&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=h8av%2BxS5nwirxw2yo0QqWLYhrGQo4Lz%2F6ysNY6T2Ors%3D&reserved=0" target="_blank"><span lang="EN-US" style="color:black">www.ikoula.com/en</span></a></span><o:p></o:p></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:18.75pt">
<span style="font-size:10.0pt;color:#111111">IKOULA Data Center 34 rue Pont Assy - 51100 Reims - FRANCE</span><o:p></o:p></p>
</td>
</tr>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;line-height:21.0pt">
<span lang="EN-US" style="font-size:10.0pt;color:#336600">Before printing this letter, think about the impact on the environment!</span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="background:white;border-collapse:collapse">
<tbody>
<tr>
<td valign="bottom" style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ikoula.com%2Fen&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=h8av%2BxS5nwirxw2yo0QqWLYhrGQo4Lz%2F6ysNY6T2Ors%3D&reserved=0" target="_blank"><span style="color:#428BCA;text-decoration:none"><img border="0" width="268" height="91" style="width:2.7916in;height:.9479in" id="m_177347375138369734m_-1836375398557362329Image_x0020_1" src="cid:image001.png@01D93239.E745B450" alt="Ikoula"></span></a> </span><o:p></o:p></p>
</td>
<td valign="bottom" style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:22.5pt"><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2Fikoula_en&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=01Qxj8kQM5dPETsPR79XKdFiw6naohw8hfdxQu5aJ4w%3D&reserved=0" target="_blank" title="Twitter Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="m_177347375138369734m_-1836375398557362329Image_x0020_2" src="cid:image002.png@01D93239.E745B450" alt="Twitter"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fikoula&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=rhf%2F3YDXmJBMWRYJdg0AZ3YmkXVUVEosXpXzonOMWIE%3D&reserved=0" target="_blank" title="Linkedin Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="m_177347375138369734m_-1836375398557362329Image_x0020_3" src="cid:image003.png@01D93239.E745B450" alt="Linkedin"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.youtube.fr%2Fikoulanet&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5gh3ZTTfeW0BMgSoconZDKkqjGPHvWtqyoBNBk4ovpQ%3D&reserved=0" target="_blank" title="YouTube Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="m_177347375138369734m_-1836375398557362329Image_x0020_4" src="cid:image004.png@01D93239.E745B450" alt="Youtube"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpressroom.ikoula.com%2F&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=4konuDkG%2Bu1PBTKfyeCHpz6xL%2BgkQQCoQOfbGEhdy8c%3D&reserved=0" target="_blank" title="Pressroom Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="m_177347375138369734m_-1836375398557362329Image_x0020_5" src="cid:image005.png@01D93239.E745B450" alt="Pressroom"></span></a></span><span style="color:#3C566A"> </span><span style="color:black"><a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.ikoula.com%2Fen&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NReeC%2BRXLPcjWP%2F1mf87SrQaWlZ2dVEfdCvhiKctiTo%3D&reserved=0" target="_blank" title="Blog Ikoula"><span style="color:#428BCA;text-decoration:none"><img border="0" width="24" height="24" style="width:.25in;height:.25in" id="m_177347375138369734m_-1836375398557362329Image_x0020_6" src="cid:image006.png@01D93239.E745B450" alt="Blog"></span></a></span><span style="color:#3C566A"> </span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">_______________________________________________<br>
Manage your subscription:<br>
<a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.clusterlabs.org%2Fmailman%2Flistinfo%2Fusers&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Q5d%2BqFrualB8vQfiCG20iIkSdVCIypAR3cUChkYx2uo%3D&reserved=0" target="_blank">https://lists.clusterlabs.org/mailman/listinfo/users</a><br>
<br>
ClusterLabs home: <a href="https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.clusterlabs.org%2F&data=05%7C01%7Ctcas%40ikoula.com%7C226d88b9b1754639362e08db00410952%7Ccb7a4a4ea7f747cc931f80db4a66f1c7%7C0%7C0%7C638104051570311189%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=83gTfCx%2F%2Fyor41uHtAvTeoZogsqc7WXzCDBIBU2K%2F1M%3D&reserved=0" target="_blank">
https://www.clusterlabs.org/</a><o:p></o:p></p>
</div>
</blockquote>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">Regards,<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Reid Wahl (He/Him)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Senior Software Engineer, Red Hat<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">RHEL High Availability - Pacemaker<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Regards,<o:p></o:p></p>
</div>
<p class="MsoNormal">Reid Wahl (He/Him)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Senior Software Engineer, Red Hat<o:p></o:p></p>
</div>
<p class="MsoNormal">RHEL High Availability - Pacemaker<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>