August 2022 - Xymon - Xymon mailman web

Capture and send data To Elasticsearch and Kibana
by francois.outteryck＠soprasteria.com 27 Sep '22

27 Sep '22

Hi Peter, Examples of task.cfg configuration with status and stachg events : [capture_status] ENVFILE /home/xymon/server/etc/xymonserver.cfg NEED xymond CMD xymond_channel --channel=status /home/xymon/server/ext/capture.sh --log=$XYMONSERVERLOGS/xymond_task_capture.log LOGFILE /var/log/xymon/lunch_capture.log [capture_stachg] ENVFILE /home/xymon/server/etc/xymonserver.cfg NEED xymond CMD xymond_channel --channel=stachg /home/xymon/server/ext/capture.sh --log=$XYMONSERVERLOGS/xymond_task_capture_stachg.log LOGFILE /var/log/xymon/lunch_capture_stachg.log Capture.sh script simple made to call a php script : #!/bin/sh /usr/bin/php /var/www/kibana/capture.php $@ </dev/stdin >>/var/log/xymon/xymond_capture_php.log 2>&1 And capture.php make all job : <?php date_default_timezone_set('Europe/Paris'); $TODO=FALSE; $ARRAY_COLLECTOR=array(); $COLLECTOR=null; while (FALSE !== ($line = fgets(STDIN))) if ($line!='') { $tab=reduce_array($line); if (sizeof($tab)==0) continue; if ($line=="@@\n") { if ($TODO) { $metadata['Message']=implode('',$ARRAY_COLLECTOR); SendData($id,$metadata,$COLLECTOR); $TODO=FALSE; $COLLECTOR=null; } } else if (substr($tab[0],0,8)=='@@stachg') { if ($TODO) { $metadata['Message']=implode('',$ARRAY_COLLECTOR); SendData($id,$metadata,$COLLECTOR); $TODO=FALSE; $COLLECTOR=null; } /* 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 /* @@stachg#seq|timestamp|sender|origin|hostname|testname|expiretime|color|prevcolor|changetime|disabletime|disablemsg|downtimeactive|clienttstamp|modifiers */ $COLLECTOR='stachg'; $metadata=explode('|',$tab[0]); $sender=$metadata[2]; $hostname=$metadata[3]; $metadata=array( 'Collector'=>$COLLECTOR, 'Sender'=>$metadata[2], 'ServerName'=>$metadata[4], 'Type'=>$metadata[5], 'Status'=>$metadata[7], 'PrevStatus'=>$metadata[8], 'LogTime'=>$metadata[1], 'ValidTime'=>$metadata[6], 'LastChange'=>$metadata[9], 'DisableTime'=>$metadata[10], 'DisableMSg'=>$metadata[11], 'Message'=>'' ); $id=$metadata['ServerName'].'_'.$metadata['Type'].'_'.$meta['LastChange']; $ARRAY_COLLECTOR=null; $ARRAY_COLLECTOR=array(); $TODO=TRUE; } else if (substr($tab[0],0,8)=='@@status') { if ($TODO) { $metadata['Message']=implode('',$ARRAY_COLLECTOR); SendData($id,$metadata,$COLLECTOR); $TODO=FALSE; $COLLECTOR=null; } /* 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 /* @@status|timestamp|sender|origin|hostname|testname|expiretime|color|testflags|prevcolor|changetime|ackexpiretime|ackmessage|disableexpiretime|disablemessage|clientmsgtstamp|flapping */ $COLLECTOR='status'; $metadata=explode('|',$tab[0]); $sender=$metadata[2]; $hostname=$metadata[3]; $metadata=array( 'Collector'=>$COLLECTOR, 'Sender'=>$metadata[2], 'ServerName'=>$metadata[4], 'Type'=>$metadata[5], 'Status'=>$metadata[7], 'LogTime'=>$metadata[1], 'ValidTime'=>$metadata[6], 'LastChange'=>$metadata[10], 'DisableTime'=>$metadata[13], 'AckTime'=>$metadata[11], 'DisableMSg'=>$metadata[14], 'Message'=>'' ); $id=$metadata['ServerName'].'.'.$metadata['Type']; $ARRAY_COLLECTOR=null; $ARRAY_COLLECTOR=array(); $TODO=TRUE; } else { if (substr($tab[0],0,2)=='@@') { if ($TODO) { $metadata['Message']=implode('',$ARRAY_COLLECTOR); SendData($id,$metadata,$COLLECTOR); $TODO=FALSE; $COLLECTOR=null; } } if ($TODO) $ARRAY_COLLECTOR[]=$line; } } function CallAPI($method, $url, $data = false) { $curl = curl_init(); switch ($method) { case "POST": curl_setopt($curl, CURLOPT_POST, 1); if ($data) curl_setopt($curl, CURLOPT_POSTFIELDS, $data); break; case "PUT": curl_setopt($curl, CURLOPT_PUT, 1); break; default: if ($data) $url = sprintf("%s?%s", $url, http_build_query($data)); } curl_setopt($curl, CURLOPT_URL, $url); curl_setopt($curl, CURLOPT_RETURNTRANSFER, 1); $result = curl_exec($curl); curl_close($curl); return $result; } function reduce_array($line) { $tab=explode(' ',$line); $nr=array(); for ($i=0;$i<sizeof($tab);$i++) if (trim($tab[$i])!='') $nr[]=trim($tab[$i]); return $nr; } function SendData($id,$cc,$COLLECTOR=null) { if ($COLLECTOR==null) return; $d=new DateTime(); if ($cc['LastChange']!='') {$d->setTimestamp($cc['LastChange']);$cc['LastChange']=$d->format('c');} else {$cc['LastChange']='NaN';} if ($cc['LogTime']!='') {$d->setTimestamp($cc['LogTime']);$cc['LogTime']=$d->format('c');} else {$cc['LogTime']='NaN';} if ($cc['ValidTime']!='') {$d->setTimestamp($cc['ValidTime']);$cc['ValidTime']=$d->format('c');} else {$cc['ValidTime']='NaN';} if (isset($cc['AckTime'])) { if ($cc['AckTime']!='') {$d->setTimestamp($cc['AckTime']);$cc['AckTime']=$d->format('c');} else {$cc['AckTime']='NaN';} } if ($cc['DisableTime']!='') {$d->setTimestamp($cc['DisableTime']);$cc['DisableTime']=$d->format('c'); } else {$cc['DisableTime']='NaN';} $data = json_encode($cc); $data=str_replace('"NaN"','null',$data); echo $id.'=>'.$data."\n"; $url="http://127.0.0.1:9200/xymon/".$COLLECTOR."/".$id; $res=CallAPI("POST",$url,$data); } ?> De : Peter Welter [mailto:peter.welter at gmail.com] Envoyé : vendredi 23 décembre 2016 14:45 À : OUTTERYCK Francois Cc : xymon at xymon.com Objet : Re: [Xymon] Capture and send data To Elasticsearch and Kibana Hi Francois, Looks good, your sample. I am very interested in your integration efforts. How do you select what is going to be inserted in the ELK stack? All status messages that Xymon receives? And could you provide an example of the xymond_channel block in you task.cfg and the capture.sh? Tasks.cfg probably is something like: [es] ... CMD xymond_channel --channel=status /home/xymon/server/ext/capture.sh ... And the capture.sh contains some curl script to the ELK stack? Regards, Peter 2016-12-14 18:15 GMT+01:00 OUTTERYCK Francois <francois.outteryck at soprasteria.com<mailto:francois.outteryck at soprasteria.com>>: Hello, I just do a small work with Xymon in order to send status data to Elasticsearch. And with Kibana reporting is easy. How it work ? Simple : With capture of status message (xymond_channel --channel=status /home/xymon/server/ext/capture.sh ) script encode status message in json and send as document in elasticSearch. Example of Mapping document status in elasticsearch : "status"=> array( "properties"=>array( "ServerName"=> array("type"=> "string"), "Type"=> array("type"=> "string"), "Status"=> array("type"=> "string"), "LastChange"=> array("type"=> "date","format"=> "strict_date_optional_time"), "LogTime"=> array("type"=> "date","format"=> "strict_date_optional_time"), "ValidTime"=> array("type"=> "date","format"=> "strict_date_optional_time"), "AckTime"=> array("type"=> "date","format"=> "strict_date_optional_time"), "DisableTime"=> array("type"=> "date","format"=> "strict_date_optional_time"), "Sender"=> array("type"=> "string"), "DisableMSg"=> array("type"=> "string"), "Message"=> array("type"=> "string") ) ) All is done with a 130 lines script. So simple to integrate in existing environment and so powerfull usage of Xymon/elasticsearch/Kibana For those who don’t know kibana : https://www.elastic.co/products/kibana [cid:image001.png at 01D25EA3.F74489F0] _______________________________________________ Xymon mailing list Xymon at xymon.com<mailto:Xymon at xymon.com> http://lists.xymon.com/mailman/listinfo/xymon

2 1

mrtg column
by kspringer＠innovateteam.com 29 Aug '22

29 Aug '22

Anyone know how to get an MRTG column to appear?? I've got graphs magically appearing in the Trends page for hosts, but there's no MRTG column on the main status pages.? This used to be standard many xymon versions ago, but seemingly things have changed. -- Kris Springer

1 0

Xymon migration issue
by matt＠oddprocess.org 23 Aug '22

23 Aug '22

I migrated a Xymon 4.3.30 install from Arch Linux to Ubuntu 20.04. Everything appears to work perfectly, however, I can no longer see the dropdown menu at the top when I am on the page of an actual test (conn, disk, etc). The menu is fine everywhere else. Any suggestions? Thanks!

3 3

False positives for applet.py (system-config-printer)
by alt36＠cam.ac.uk 22 Aug '22

22 Aug '22

On 21/08/2022 11:52, Jaap Winius via Xymon wrote: > After more experimentation, I've managed to get Xymon to give me the > "all green" again, but only after adding a rather generic line to > libs.local.yaml: > > ?? - '.*$deleted$.*' > > Any more specific and the aforementioned false positive pops up again. > Any suggestions on how to make it more specific would be welcome. That's a rather far-reaching config line; it will mean any and all (deleted) files will be ignored by the libs test, if you've put it under '*' ! The crucial line in the libs script is return 1 if $path =~ $regexp; i.e. you want a perl regular expression for the entries in libs.local.yml. Given you mentioned /nfs/home/jwinius/.xsession-errors (deleted) nfs.umrk.nl:/nfs/home) you could thus try, perhaps, - '^/nfs/home/.*/\.xsession-errors ' (NB the trailing space is deliberate, given the example string you'd like to match). Look for online tutorials about perl regular expressions if it's not clear what's going on there. Adam

1 0

False positives for applet.py (system-config-printer)
by jwinius＠umrk.nl 21 Aug '22

21 Aug '22

Hi folks, After more experimentation, I've managed to get Xymon to give me the "all green" again, but only after adding a rather generic line to libs.local.yaml: - '.*$deleted$.*' Any more specific and the aforementioned false positive pops up again. Any suggestions on how to make it more specific would be welcome. Thanks, Jaap Quoting Jaap Winius via Xymon <xymon at xymon.com>: > Hi folks, > > Adam Thorn mentioned to me in an exchange a few months ago that "the > libs test pretty much just runs the lsof command and looks for files > which are either 'deleted' or 'DEL', so you can do this check for > yourself for a particular pid." His example command didn't quite > work, but I get the idea. In the case of applet.py, I find lines > like the following: > > applet.py 237463 jwinius 2w unknown 0,51 > /nfs/home/jwinius/.xsession-errors (deleted) nfs.umrk.nl:/nfs/home) > > What must be added to /etc/xymon/libs.local.yaml to whitelist lines > like this for all users? > > Thanks, > > Jaap > > > Quoting Jaap Winius via Xymon <xymon at xymon.com>: > >> Hi folks, >> >> Our virtual workstations run CUPS along with the >> "system-config-printer" package, which provides a "graphical >> interface to configure the printing system." Unfortunately, Xymon >> keeps reporting false-positives for this package, in particular for >> lines involving this one python script: >> >> /usr/bin/python3 /usr/share/system-config-printer/applet.py >> >> Xymon often erroneously reports that such processes have "libs >> linked that were upgraded", even though no upgrades have taken >> place. Also, there may be multiple reports of this per user and per >> session, and these will persist even after the user has logged out. >> >> Can anyone explain how to prevent these false positives? I imagine >> the solution will involve creating /etc/xymon/libs.local.yaml with >> a few lines added to it. >> >> Our virtual workstations run Debian 11.4 (Bullseye) with Xfce 4.16, >> cups 2.3.3op2-3+deb11u2, system-config-printer 1.5.14-1, xrdp >> 0.9.12-1.1 and xymon-client 4.3.30-1. The xymon server is also runs >> version 4.3.30-1 on top of Debian 11.4. >> >> Thanks, >> >> Jaap

1 0

False positives for applet.py (system-config-printer)
by jwinius＠umrk.nl 20 Aug '22

20 Aug '22

Hi folks, Adam Thorn mentioned to me in an exchange a few months ago that "the libs test pretty much just runs the lsof command and looks for files which are either 'deleted' or 'DEL', so you can do this check for yourself for a particular pid." His example command didn't quite work, but I get the idea. In the case of applet.py, I find lines like the following: applet.py 237463 jwinius 2w unknown 0,51 /nfs/home/jwinius/.xsession-errors (deleted) nfs.umrk.nl:/nfs/home) What must be added to /etc/xymon/libs.local.yaml to whitelist lines like this for all users? Thanks, Jaap Quoting Jaap Winius via Xymon <xymon at xymon.com>: > Hi folks, > > Our virtual workstations run CUPS along with the > "system-config-printer" package, which provides a "graphical > interface to configure the printing system." Unfortunately, Xymon > keeps reporting false-positives for this package, in particular for > lines involving this one python script: > > /usr/bin/python3 /usr/share/system-config-printer/applet.py > > Xymon often erroneously reports that such processes have "libs > linked that were upgraded", even though no upgrades have taken > place. Also, there may be multiple reports of this per user and per > session, and these will persist even after the user has logged out. > > Can anyone explain how to prevent these false positives? I imagine > the solution will involve creating /etc/xymon/libs.local.yaml with > a few lines added to it. > > Our virtual workstations run Debian 11.4 (Bullseye) with Xfce 4.16, > cups 2.3.3op2-3+deb11u2, system-config-printer 1.5.14-1, xrdp > 0.9.12-1.1 and xymon-client 4.3.30-1. The xymon server is also runs > version 4.3.30-1 on top of Debian 11.4. > > Thanks, > > Jaap

1 0

False positives for applet.py (system-config-printer)
by jwinius＠umrk.nl 20 Aug '22

20 Aug '22

Hi folks, Our virtual workstations run CUPS along with the "system-config-printer" package, which provides a "graphical interface to configure the printing system." Unfortunately, Xymon keeps reporting false-positives for this package, in particular for lines involving this one python script: /usr/bin/python3 /usr/share/system-config-printer/applet.py Xymon often erroneously reports that such processes have "libs linked that were upgraded", even though no upgrades have taken place. Also, there may be multiple reports of this per user and per session, and these will persist even after the user has logged out. Can anyone explain how to prevent these false positives? I imagine the solution will involve creating /etc/xymon/libs.local.yaml with a few lines added to it. Our virtual workstations run Debian 11.4 (Bullseye) with Xfce 4.16, cups 2.3.3op2-3+deb11u2, system-config-printer 1.5.14-1, xrdp 0.9.12-1.1 and xymon-client 4.3.30-1. The xymon server is also runs version 4.3.30-1 on top of Debian 11.4. Thanks, Jaap

1 0

Terabithia RPMs - unable to access testing/el9
by john.horne＠plymouth.ac.uk 19 Aug '22

19 Aug '22

Hello, I have tried to access the el9 Terabithia RPMS for a Rocky 9 server, but I am getting a 403 error when using 'dnf install', and if I go the repository itself I get a permission denied error. I can see the RPMs are present in testing, but cannot access them. Anyone know when these might be available, either in testing or the main 'el9' repository? Thanks, John. -- John Horne | Senior Operations Analyst | Technology and Information Services University of Plymouth | Drake Circus | Plymouth | Devon | PL4 8AA | UK ________________________________ [http://www.plymouth.ac.uk/images/email_footer.gif]<http://www.plymouth.ac.uk/worldclass> This email and any files with it are confidential and intended solely for the use of the recipient to whom it is addressed. If you are not the intended recipient then copying, distribution or other use of the information contained is strictly prohibited and you should not rely on it. If you have received this email in error please let the sender know immediately and delete it from your system(s). Internet emails are not necessarily secure. While we take every care, University of Plymouth accepts no responsibility for viruses and it is your responsibility to scan emails and their attachments. University of Plymouth does not accept responsibility for any changes made after it was sent. Nothing in this email or its attachments constitutes an order for goods or services unless accompanied by an official order form.

2 2

Xymon with Apache
by KK1051＠att.com 19 Aug '22

19 Aug '22

Server version: Apache/2.4.51 (Oracle Linux Server) I am getting [Thu Aug 18 10:06:27.593958 2022] [cgid:error] [pid 17035:tid 17035] (13)Permission denied: [client 192.168.1.89:55583] AH01257: unable to connect to cgi daemon after multiple tries: /usr/local/xymon/cgi-bin/svcstatus.sh, referer: http://192.168.1.101/xymon/ I am finding info about MPM prefork. All those made no change in this issue. I have compared to my other servers. Those are solaris platforms and Server version: Apache/2.4.46 (Unix) My apache runs as user apache and group xmon. Xymon also runs as group xmon. Server version: Apache/2.4.51 (Oracle Linux Server) I am close I smell it. Thanks for your time. Kevin H. King Principal-Advanced Technical Support Technology Operations, SS7 Signaling AT&T Services, Inc. 2722 Windridge Dr. Acworth Ga. 30102 m 404.444.0410 | o 678.403.2921 | kevin.h.king at att.com<mailto:kevin.h.king at att.com>

3 2

Xymon with Apache
by kc6ovd＠gmail.com 19 Aug '22

19 Aug '22

An HTML attachment was scrubbed... URL: <http://lists.xymon.com/pipermail/xymon/attachments/20220819/641cff6f/attach…>

2 1