July 2022 - Xymon - Xymon mailman web

Capture and send data To Elasticsearch and Kibana
by francois.outteryck＠soprasteria.com 27 Sep '22

27 Sep '22

Hi Peter, Examples of task.cfg configuration with status and stachg events : [capture_status] ENVFILE /home/xymon/server/etc/xymonserver.cfg NEED xymond CMD xymond_channel --channel=status /home/xymon/server/ext/capture.sh --log=$XYMONSERVERLOGS/xymond_task_capture.log LOGFILE /var/log/xymon/lunch_capture.log [capture_stachg] ENVFILE /home/xymon/server/etc/xymonserver.cfg NEED xymond CMD xymond_channel --channel=stachg /home/xymon/server/ext/capture.sh --log=$XYMONSERVERLOGS/xymond_task_capture_stachg.log LOGFILE /var/log/xymon/lunch_capture_stachg.log Capture.sh script simple made to call a php script : #!/bin/sh /usr/bin/php /var/www/kibana/capture.php $@ </dev/stdin >>/var/log/xymon/xymond_capture_php.log 2>&1 And capture.php make all job : <?php date_default_timezone_set('Europe/Paris'); $TODO=FALSE; $ARRAY_COLLECTOR=array(); $COLLECTOR=null; while (FALSE !== ($line = fgets(STDIN))) if ($line!='') { $tab=reduce_array($line); if (sizeof($tab)==0) continue; if ($line=="@@\n") { if ($TODO) { $metadata['Message']=implode('',$ARRAY_COLLECTOR); SendData($id,$metadata,$COLLECTOR); $TODO=FALSE; $COLLECTOR=null; } } else if (substr($tab[0],0,8)=='@@stachg') { if ($TODO) { $metadata['Message']=implode('',$ARRAY_COLLECTOR); SendData($id,$metadata,$COLLECTOR); $TODO=FALSE; $COLLECTOR=null; } /* 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 /* @@stachg#seq|timestamp|sender|origin|hostname|testname|expiretime|color|prevcolor|changetime|disabletime|disablemsg|downtimeactive|clienttstamp|modifiers */ $COLLECTOR='stachg'; $metadata=explode('|',$tab[0]); $sender=$metadata[2]; $hostname=$metadata[3]; $metadata=array( 'Collector'=>$COLLECTOR, 'Sender'=>$metadata[2], 'ServerName'=>$metadata[4], 'Type'=>$metadata[5], 'Status'=>$metadata[7], 'PrevStatus'=>$metadata[8], 'LogTime'=>$metadata[1], 'ValidTime'=>$metadata[6], 'LastChange'=>$metadata[9], 'DisableTime'=>$metadata[10], 'DisableMSg'=>$metadata[11], 'Message'=>'' ); $id=$metadata['ServerName'].'_'.$metadata['Type'].'_'.$meta['LastChange']; $ARRAY_COLLECTOR=null; $ARRAY_COLLECTOR=array(); $TODO=TRUE; } else if (substr($tab[0],0,8)=='@@status') { if ($TODO) { $metadata['Message']=implode('',$ARRAY_COLLECTOR); SendData($id,$metadata,$COLLECTOR); $TODO=FALSE; $COLLECTOR=null; } /* 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 /* @@status|timestamp|sender|origin|hostname|testname|expiretime|color|testflags|prevcolor|changetime|ackexpiretime|ackmessage|disableexpiretime|disablemessage|clientmsgtstamp|flapping */ $COLLECTOR='status'; $metadata=explode('|',$tab[0]); $sender=$metadata[2]; $hostname=$metadata[3]; $metadata=array( 'Collector'=>$COLLECTOR, 'Sender'=>$metadata[2], 'ServerName'=>$metadata[4], 'Type'=>$metadata[5], 'Status'=>$metadata[7], 'LogTime'=>$metadata[1], 'ValidTime'=>$metadata[6], 'LastChange'=>$metadata[10], 'DisableTime'=>$metadata[13], 'AckTime'=>$metadata[11], 'DisableMSg'=>$metadata[14], 'Message'=>'' ); $id=$metadata['ServerName'].'.'.$metadata['Type']; $ARRAY_COLLECTOR=null; $ARRAY_COLLECTOR=array(); $TODO=TRUE; } else { if (substr($tab[0],0,2)=='@@') { if ($TODO) { $metadata['Message']=implode('',$ARRAY_COLLECTOR); SendData($id,$metadata,$COLLECTOR); $TODO=FALSE; $COLLECTOR=null; } } if ($TODO) $ARRAY_COLLECTOR[]=$line; } } function CallAPI($method, $url, $data = false) { $curl = curl_init(); switch ($method) { case "POST": curl_setopt($curl, CURLOPT_POST, 1); if ($data) curl_setopt($curl, CURLOPT_POSTFIELDS, $data); break; case "PUT": curl_setopt($curl, CURLOPT_PUT, 1); break; default: if ($data) $url = sprintf("%s?%s", $url, http_build_query($data)); } curl_setopt($curl, CURLOPT_URL, $url); curl_setopt($curl, CURLOPT_RETURNTRANSFER, 1); $result = curl_exec($curl); curl_close($curl); return $result; } function reduce_array($line) { $tab=explode(' ',$line); $nr=array(); for ($i=0;$i<sizeof($tab);$i++) if (trim($tab[$i])!='') $nr[]=trim($tab[$i]); return $nr; } function SendData($id,$cc,$COLLECTOR=null) { if ($COLLECTOR==null) return; $d=new DateTime(); if ($cc['LastChange']!='') {$d->setTimestamp($cc['LastChange']);$cc['LastChange']=$d->format('c');} else {$cc['LastChange']='NaN';} if ($cc['LogTime']!='') {$d->setTimestamp($cc['LogTime']);$cc['LogTime']=$d->format('c');} else {$cc['LogTime']='NaN';} if ($cc['ValidTime']!='') {$d->setTimestamp($cc['ValidTime']);$cc['ValidTime']=$d->format('c');} else {$cc['ValidTime']='NaN';} if (isset($cc['AckTime'])) { if ($cc['AckTime']!='') {$d->setTimestamp($cc['AckTime']);$cc['AckTime']=$d->format('c');} else {$cc['AckTime']='NaN';} } if ($cc['DisableTime']!='') {$d->setTimestamp($cc['DisableTime']);$cc['DisableTime']=$d->format('c'); } else {$cc['DisableTime']='NaN';} $data = json_encode($cc); $data=str_replace('"NaN"','null',$data); echo $id.'=>'.$data."\n"; $url="http://127.0.0.1:9200/xymon/".$COLLECTOR."/".$id; $res=CallAPI("POST",$url,$data); } ?> De : Peter Welter [mailto:peter.welter at gmail.com] Envoyé : vendredi 23 décembre 2016 14:45 À : OUTTERYCK Francois Cc : xymon at xymon.com Objet : Re: [Xymon] Capture and send data To Elasticsearch and Kibana Hi Francois, Looks good, your sample. I am very interested in your integration efforts. How do you select what is going to be inserted in the ELK stack? All status messages that Xymon receives? And could you provide an example of the xymond_channel block in you task.cfg and the capture.sh? Tasks.cfg probably is something like: [es] ... CMD xymond_channel --channel=status /home/xymon/server/ext/capture.sh ... And the capture.sh contains some curl script to the ELK stack? Regards, Peter 2016-12-14 18:15 GMT+01:00 OUTTERYCK Francois <francois.outteryck at soprasteria.com<mailto:francois.outteryck at soprasteria.com>>: Hello, I just do a small work with Xymon in order to send status data to Elasticsearch. And with Kibana reporting is easy. How it work ? Simple : With capture of status message (xymond_channel --channel=status /home/xymon/server/ext/capture.sh ) script encode status message in json and send as document in elasticSearch. Example of Mapping document status in elasticsearch : "status"=> array( "properties"=>array( "ServerName"=> array("type"=> "string"), "Type"=> array("type"=> "string"), "Status"=> array("type"=> "string"), "LastChange"=> array("type"=> "date","format"=> "strict_date_optional_time"), "LogTime"=> array("type"=> "date","format"=> "strict_date_optional_time"), "ValidTime"=> array("type"=> "date","format"=> "strict_date_optional_time"), "AckTime"=> array("type"=> "date","format"=> "strict_date_optional_time"), "DisableTime"=> array("type"=> "date","format"=> "strict_date_optional_time"), "Sender"=> array("type"=> "string"), "DisableMSg"=> array("type"=> "string"), "Message"=> array("type"=> "string") ) ) All is done with a 130 lines script. So simple to integrate in existing environment and so powerfull usage of Xymon/elasticsearch/Kibana For those who don’t know kibana : https://www.elastic.co/products/kibana [cid:image001.png at 01D25EA3.F74489F0] _______________________________________________ Xymon mailing list Xymon at xymon.com<mailto:Xymon at xymon.com> http://lists.xymon.com/mailman/listinfo/xymon

2 1

Terabithia RPMs - EL 9 Release ETA
by phaleintx＠gmail.com 28 Jul '22

28 Jul '22

Hello Xymon folks! Just curious if there is an ETA on the final release of the Terabithia RPMs for EL9? ?I can see they are marked under "Testing" right now. Thanks, Phil

1 0

Can't check kernel version on arm64 systems
by jwinius＠umrk.nl 28 Jul '22

28 Jul '22

Hi Adam, Yes, that one appears to do the trick. All is green and I can once again relax. :-) Thank you very much! Cheers, Jaap Quoting Adam Goryachev via Xymon <xymon at xymon.com>: > On 28/7/2022 19:46, Jaap Winius via Xymon wrote: >> Hi folks, >> >> My systems mostly run the Debian 11 xymon-client and hobbit-plugins >> packages for amd64 and armhf. However, I've now got a few arm64 >> systems (for the Odroid N2+) and have run into a problem. After >> installing a few missing dependencies for this architecture >> (libyaml-tiny-perl, libfile-slurp-perl and lsof), the libs check >> now says: >> >> Couldn't check for string '4.9.277-arm64' in >> /boot/vmlinuz-4.9.277-arm64. Can't check kernel version! >> >> Seeing as there's nothing wrong with my systems, how can I get >> Xymon to ignore this issue, or better yet, run the kernel version >> properly? >> >> Thanks, >> >> Jaap > > > In my case, looks like I made two small changes: > > ???? my $kernel_image_release = $1; > > ???? my $kernel_image_read_command = "strings '$newest_kernel_image'"; > -??? if (`dpkg --print-architecture` =~ /sparc/) { > +??? if (-x '/usr/bin/dpkg' and `dpkg --print-architecture` =~ > /(sparc|arm64)/) { > ??????? $kernel_image_read_command = "zcat -f --stdout > '$newest_kernel_image' | strings"; > ???? } > > -??????????? if ($kernel_image_version =~ /^(Linux version > )?\Q$running_kernel_release\E $.*$ \Q$running_kernel_version\E$/) { > +??????????? if ($kernel_image_version =~ /^(Linux version > )?\Q$running_kernel_release\E $.*$ \Q$running_kernel_version\E/) { > > > In addition, you will need to create these two files: > > $ cat /etc/kernel/postinst.d/statoverride > #!/bin/sh > version="$1" > # passing the kernel version is required > [ -z "${version}" ] && exit 0 > echo "Checking /boot/vmlinuz-${version}" > dpkg-statoverride --list /boot/vmlinuz-${version} > if `dpkg-statoverride --list /boot/vmlinuz-${version} > /dev/null` > then > ?? ?echo "Override found - skipping" > ?? ?exit 0 > else > ?? ?dpkg-statoverride --update --add root adm 0640 /boot/vmlinuz-${version} > fi > exit 0 > > > $ cat /etc/kernel/postrm.d/statoverride > #!/bin/bash > version="$1" > # passing the kernel version is required > [ -z "${version}" ] && exit 0 > echo "Checking /boot/vmlinuz-${version}" > dpkg-statoverride --list /boot/vmlinuz-${version} > if `dpkg-statoverride --list /boot/vmlinuz-${version} > /dev/null` > then > ?? ?echo "No override found - skipping" > ?? ?exit 0 > else > ?? ?dpkg-statoverride --remove /boot/vmlinuz-${version} > fi > exit 0 > > Finally, since these will only run during kernel package > installation/removal, you should run the postinst script manually > for currently installed kernels. > > I do also modify the default permissions for xymon to add it to the > adm group, this provides access to /var/log files as well as the > above kernel images which are group adm and permission 640, so you > either need to do that as well or adjust the permissions assigned in > the postinst so that xymon will have read access. > > Hope that helps

1 0

Can't check kernel version on arm64 systems
by mailinglists＠websitemanagers.com.au 28 Jul '22

28 Jul '22

On 28/7/2022 19:46, Jaap Winius via Xymon wrote: > Hi folks, > > My systems mostly run the Debian 11 xymon-client and hobbit-plugins packages for amd64 and armhf. However, I've now got a few arm64 systems (for the Odroid N2+) and have run into a problem. After installing a few missing dependencies for this architecture (libyaml-tiny-perl, libfile-slurp-perl and lsof), the libs check now says: > > Couldn't check for string '4.9.277-arm64' in /boot/vmlinuz-4.9.277-arm64. Can't check kernel version! > > Seeing as there's nothing wrong with my systems, how can I get Xymon to ignore this issue, or better yet, run the kernel version properly? > > Thanks, > > Jaap In my case, looks like I made two small changes: ???? my $kernel_image_release = $1; ???? my $kernel_image_read_command = "strings '$newest_kernel_image'"; -??? if (`dpkg --print-architecture` =~ /sparc/) { +??? if (-x '/usr/bin/dpkg' and `dpkg --print-architecture` =~ /(sparc|arm64)/) { ??????? $kernel_image_read_command = "zcat -f --stdout '$newest_kernel_image' | strings"; ???? } -??????????? if ($kernel_image_version =~ /^(Linux version )?\Q$running_kernel_release\E $.*$ \Q$running_kernel_version\E$/) { +??????????? if ($kernel_image_version =~ /^(Linux version )?\Q$running_kernel_release\E $.*$ \Q$running_kernel_version\E/) { In addition, you will need to create these two files: $ cat /etc/kernel/postinst.d/statoverride #!/bin/sh version="$1" # passing the kernel version is required [ -z "${version}" ] && exit 0 echo "Checking /boot/vmlinuz-${version}" dpkg-statoverride --list /boot/vmlinuz-${version} if `dpkg-statoverride --list /boot/vmlinuz-${version} > /dev/null` then ?? ?echo "Override found - skipping" ?? ?exit 0 else ?? ?dpkg-statoverride --update --add root adm 0640 /boot/vmlinuz-${version} fi exit 0 $ cat /etc/kernel/postrm.d/statoverride #!/bin/bash version="$1" # passing the kernel version is required [ -z "${version}" ] && exit 0 echo "Checking /boot/vmlinuz-${version}" dpkg-statoverride --list /boot/vmlinuz-${version} if `dpkg-statoverride --list /boot/vmlinuz-${version} > /dev/null` then ?? ?echo "No override found - skipping" ?? ?exit 0 else ?? ?dpkg-statoverride --remove /boot/vmlinuz-${version} fi exit 0 Finally, since these will only run during kernel package installation/removal, you should run the postinst script manually for currently installed kernels. I do also modify the default permissions for xymon to add it to the adm group, this provides access to /var/log files as well as the above kernel images which are group adm and permission 640, so you either need to do that as well or adjust the permissions assigned in the postinst so that xymon will have read access. Hope that helps

1 0

Can't check kernel version on arm64 systems
by zechner＠vrvis.at 28 Jul '22

28 Jul '22

Hi, we had the same problems on our pi, my colleague came up with this patch for the libs [1] check: --- libs.orig +++ libs @@ -73,6 +73,11 @@ if (-x '/usr/bin/dpkg' and `dpkg --print-architecture` =~ /sparc/) { $kernel_image_read_command = "zcat '$newest_kernel_image' | strings"; } + if (-x '/usr/bin/dpkg' and `dpkg --print-architecture` =~ /armhf/) { + my $offset = `grep --only-matching --byte-offset --binary --text '\x1f\x8b' '$newest_kernel_image' 2>/dev/null| head -1 | cut -f 1 -d :`; + $offset =~ s/\n//g; + $kernel_image_read_command = "dd if='$newest_kernel_image' skip=1 bs=$offset 2>/dev/null | gunzip 2>/dev/null | strings"; + } $kernel_image_read_command .= " | egrep '^$kernel_image_release|^Linux version '"; Hope it helps! Cheers Christoph [1] /usr/lib/xymon/client/ext/libs On 28/07/2022 11:46, Jaap Winius via Xymon wrote: > _______________________________________________ > Xymon mailing list > Xymon at xymon.com > http://lists.xymon.com/mailman/listinfo/xymon

2 2

SNMPv3 patch
by jeremy＠laidman.org 28 Jul '22

28 Jul '22

Hi all The attached patch fixes some bugs in the parser of snmphosts.cfg that make the SNMPv3 implementation mostly useless. These are all off-by-one errors that cause strings like "passphrase=" to never be found in the configuration file. I've also changed two instances of debug logging to error logging because they're errors that need operator/sysadmin intervention: one is an error in the configuration (eg "Host X ... no such name") and the other is a connection timeout. Cheers Jeremy

1 0

Can't check kernel version on arm64 systems
by jwinius＠umrk.nl 28 Jul '22

28 Jul '22

Hi folks, My systems mostly run the Debian 11 xymon-client and hobbit-plugins packages for amd64 and armhf. However, I've now got a few arm64 systems (for the Odroid N2+) and have run into a problem. After installing a few missing dependencies for this architecture (libyaml-tiny-perl, libfile-slurp-perl and lsof), the libs check now says: Couldn't check for string '4.9.277-arm64' in /boot/vmlinuz-4.9.277-arm64. Can't check kernel version! Seeing as there's nothing wrong with my systems, how can I get Xymon to ignore this issue, or better yet, run the kernel version properly? Thanks, Jaap

1 0

Xymon on Amazon Linux (terabithia RPM's)
by sys1002＠yahoo.com 21 Jul '22

21 Jul '22

I tried it and could not get it to work. Did it on a ubuntu standard T2.micro 8 GB HDD instead and works with no issues.I hope this helps. On Wednesday, July 20, 2022 at 01:00:11 PM GMT+3, xymon-request at xymon.com <xymon-request at xymon.com> wrote: Send Xymon mailing list submissions to ??? xymon at xymon.com To subscribe or unsubscribe via the World Wide Web, visit ??? http://lists.xymon.com/mailman/listinfo/xymon or, via email, send a message with subject or body 'help' to ??? xymon-request at xymon.com You can reach the person managing the list at ??? xymon-owner at xymon.com When replying, please edit your Subject line so it is more specific than "Re: Contents of Xymon digest..." Today's Topics: ? 1. Xymon on Amazon Linux (terabithia RPM's) (Neil Simmonds) ---------------------------------------------------------------------- Message: 1 Date: Wed, 20 Jul 2022 08:24:17 +0000 From: Neil Simmonds <Neil.Simmonds at studio.co.uk> To: "xymon at xymon.com" <xymon at xymon.com> Subject: [Xymon] Xymon on Amazon Linux (terabithia RPM's) Message-ID: ??? <AS8PR05MB8611A085FFFA9A857CE9F753D48E9 at AS8PR05MB8611.eurprd05.prod.outlook.com> ??? Content-Type: text/plain; charset="us-ascii" Hi all, Has anyone installed Xymon on Amazon Linux 2 using Terabithia RPM's and did you have any issues. I've attempted the install and got an issue with SE Linux policies so am considering if I need to use Red Hat but our preferred option is Amazon Linux so I would like to use it if possible. I'm just a little concerned about compatibility. Kind Regards, Neil. Neil Simmonds Senior Platform & Middleware Engineer (Unix). Studio is a trading name of Studio Retail Ltd which is authorised and regulated by the Financial Conduct Authority for consumer credit and general insurance. Studio Retail Ltd are members of the Finance and Leasing Association (FLA). Registered in England. No: 718151. Registered Office: Church Bridge House, Henry Street, Accrington, BB5 4EE NOTE: This email and any information contained within or attached in a separate file is confidential and intended solely for the Individual to whom it is addressed. The information or data included is solely for the purpose indicated or previously agreed. Any information or data included with this e-mail remains the property of Studio Retail Ltd and the recipient will refrain from utilising the information for any purpose other than that indicated and upon request will destroy the information and remove it from their records. Any views or opinions presented are solely those of the author and do not necessarily represent those of Studio Retail Ltd. ? If you are not the intended recipient, be advised that you have received this email in error and that any use, dissemination, forwarding, printing, or copying of this email is strictly prohibited. No warranties or assurances are made in relation to the safety and content of this e-mail and any attachments. No liability is accepted for any consequences arising from it. Studio Retail Ltd reserves the right to monitor all e-mail communications through its internal and external networks. If you have received this email in error, please notify our careline on +44(0) 371 200 0378.

2 2

Xymon on Amazon Linux (terabithia RPM's)
by Neil.Simmonds＠studio.co.uk 20 Jul '22

20 Jul '22

Hi all, Has anyone installed Xymon on Amazon Linux 2 using Terabithia RPM's and did you have any issues. I've attempted the install and got an issue with SE Linux policies so am considering if I need to use Red Hat but our preferred option is Amazon Linux so I would like to use it if possible. I'm just a little concerned about compatibility. Kind Regards, Neil. Neil Simmonds Senior Platform & Middleware Engineer (Unix). Studio is a trading name of Studio Retail Ltd which is authorised and regulated by the Financial Conduct Authority for consumer credit and general insurance. Studio Retail Ltd are members of the Finance and Leasing Association (FLA). Registered in England. No: 718151. Registered Office: Church Bridge House, Henry Street, Accrington, BB5 4EE NOTE: This email and any information contained within or attached in a separate file is confidential and intended solely for the Individual to whom it is addressed. The information or data included is solely for the purpose indicated or previously agreed. Any information or data included with this e-mail remains the property of Studio Retail Ltd and the recipient will refrain from utilising the information for any purpose other than that indicated and upon request will destroy the information and remove it from their records. Any views or opinions presented are solely those of the author and do not necessarily represent those of Studio Retail Ltd. If you are not the intended recipient, be advised that you have received this email in error and that any use, dissemination, forwarding, printing, or copying of this email is strictly prohibited. No warranties or assurances are made in relation to the safety and content of this e-mail and any attachments. No liability is accepted for any consequences arising from it. Studio Retail Ltd reserves the right to monitor all e-mail communications through its internal and external networks. If you have received this email in error, please notify our careline on +44(0) 371 200 0378.

1 0

Trying to set up a custom graph
by mgoebel＠emich.edu 18 Jul '22

18 Jul '22

Hello, Running Xymon 4.3.29 on Redhat ES 8. I've got custom data creating rrd files, so that part is working. Now when I try to set up the graph I don't get anything on the status page. rrd file cfbytes.rrd : variable cfbytes in xymonserver.cfg TEST2RRD+=",cfconns=ncv,cfbytes=ncv,cfcached=ncv,cfgoodreqs=ncv,cfthreats=ncv" GRAPHS+=",cfconns,cfbytes" NCV_cfbytes="cfbytes:GAUGE" and in graphs.cfg [cfbytes] TITLE Cloudflare traffic YAXIS Bytes DEF:cfbytes=cfbytes.rrd:cfbytes:AVERAGE AREA:cfbytes#00CCCC:time COMMENT:\n GPRINT:cfbytes:LAST: \: %5.1lf (cur) GPRINT:cfbytes:MAX: \: %5.1lf (max) GPRINT:cfbytes:MIN: \: %5.1lf (min) GPRINT:cfbytes:AVERAGE: \: %5.1lf (avg)\n I restarted xymon server to pick up the changes, but am not seeing the new column created. Hoping it is something simple I missed. Thanks, Matt -- Matthew Goebel : m <goebel at emunix.emich.edu>goebel at emich.edu : Unix Jockey @ EMU : Hail Eris Neo-Student, Net Lurker, Donut consumer, and procrastinating medher... "Always with the negative waves, Moriarty" - Oddball "Comfort the troubled, and trouble the comfortable." - Dietrich Bonhoeffer

3 4