[Xymon] XYMON Proxy Issue

25 Feb 2014

      Hello,
Here a part of the solution:
Communication Issue
Observing le connections between agents and proxy using netstat, I see a
lot of CLOSE_WAIT on the side of the proxy and some SYN_SENT on the side
of agents.
=> The xymonproxy program doesn't close its connections, then the system
reach its limit of nbr of active connections and refuse the new ones.
Modifying the creation of the socket in the C program, we were successfull
in making the connections correctly handled:
230d229
<         struct linger so_linger;
715,717d713
<                                       so_linger.l_onoff = 0;
<                               so_linger.l_linger = 10;
<                               setsockopt(cwalk->ssocket, SOL_SOCKET,
SO_LINGER, &so_linger, sizeof(so_linger));
Select Issue
In the C program, the line n = select(maxfd+1, &fdread, &fdwrite, NULL,
&selecttmo); is in error because the n generated is equaled to -1 .
We didn't found yet why and how the solve it. Any idea ?
Cordialement, Regards,Mit freundlichen Grüßen,
Gautier BEGIN
Next Absences:     - From 3th Apr to 21th Apr
System Tools Team Lead
CACEIS and APERAM accounts
CSC Computer Sciences Luxembourg S.A.
12D Impasse Drosbach
L-1882 Luxembourg
Global Outsourcing Service | p:+352 24 834 276 | m:+352 621 229 172 |
gbegin at csc.com | www.csc.com
CSC • This is a PRIVATE message. If you are not the intended recipient,
please delete without copying and kindly advise us by e-mail of the
mistake in delivery.  NOTE: Regardless of content, this e-mail shall not
operate to bind CSC to any order or other contract unless pursuant to
explicit written agreement or government initiative expressly permitting
the use of e-mail for such purpose
•
CSC Computer Sciences SAS • Registered Office: Immeuble Le Balzac, 10
Place des Vosges, 92072 Paris La Défense Cedex, France • Registered in
France: RCS Nanterre B 315 268 664
From:   Gautier Begin/LUX/CSC
To:     xymon at xymon.com, "Xymon" <xymon-bounces at xymon.com>
Date:   02/19/2014 10:44 AM
Subject:        Re: [Xymon] XYMON Proxy Issue
Any news ?
Cordialement, Regards,Mit freundlichen Grüßen,
Gautier BEGIN
From:   Gautier Begin/LUX/CSC at CSC
To:     xymon at xymon.com, "Xymon" <xymon-bounces at xymon.com>
Date:   02/17/2014 06:56 PM
Subject:        Re: [Xymon] XYMON Proxy Issue
Sent by:        "Xymon" <xymon-bounces at xymon.com>
Hi,
I made a truss on the xymonproxy process and get such errors
(ECONNABORTED/EINPROGRESS)
16881/1:        33.7424  0.0002 fcntl(6, F_SETFL, FNONBLOCK)      = 0
16881/1:        33.7427  0.0003 connect(6, 0xFFBFD838, 16, SOV_DEFAULT)

= 0
16881/1:        33.7429  0.0002 shutdown(4, SHUT_RDWR, SOV_DEFAULT)      =
0
16881/1:        33.7430  0.0001 close(4)      = 0
16881/1:        33.7432  0.0002 close(5)      = 0
16881/1:        33.7433  0.0001 pollsys(0xFFBFD320, 4, 0xFFBFD3D8,
0x00000000)  = 4
16881/1:        33.7435  0.0002 read(9, " c o n f i g   b b w i n"..,
8185)     = 29
16881/1:        33.7437  0.0002 read(7, 0x000544E3, 9124)      = 0
16881/1:        33.7439  0.0002 getsockopt(6, SOL_SOCKET, SO_ERROR,
0xFFBFD4B8, 0xFFBFD4B4, SOV_DEFAULT) = 0
16881/1:        33.7440  0.0001 write(6, " d a t a   S N F N L X 2"..,
402)     = 402
16881/1:        33.7465  0.0025 accept(3, 0x0004E7A0, 0xFFBFD4B0,
SOV_DEFAULT)  Err#130 ECONNABORTED
...
6881/1:        33.2151  0.0002 accept(3, 0x0004E810, 0xFFBFD4B0,
SOV_DEFAULT)  = 8
16881/1:        33.2152  0.0001 fcntl(8, F_SETFL, FNONBLOCK)      = 0
16881/1:        33.2153  0.0001 time()      = 1392657199
16881/1:        33.2155  0.0002 shutdown(4, SHUT_RDWR, SOV_DEFAULT)      =
0
16881/1:        33.2156  0.0001 close(4)      = 0
16881/1:        33.2158  0.0002 shutdown(7, SHUT_WR, SOV_DEFAULT)      = 0
16881/1:        33.2160  0.0002 close(5)      = 0
16881/1:        33.2161  0.0001 time()      = 1392657199
16881/1:        33.2162  0.0001 so_socket(PF_INET, SOCK_STREAM,
IPPROTO_IP, "", SOV_DEFAULT) = 4
16881/1:        33.2163  0.0001 fcntl(4, F_SETFL, FNONBLOCK)      = 0
16881/1:        33.2166  0.0003 connect(4, 0xFFBFD838, 16, SOV_DEFAULT)

Err#150 EINPROGRESS
16881/1:        33.2167  0.0001 pollsys(0xFFBFD328, 5, 0xFFBFD3D8,
0x00000000)  = 3
16881/1:        33.2168  0.0001 read(8, " c o n f i g   b b w i n"..,
8185)     = 31
16881/1:        33.2171  0.0003 read(6, " s t a t u s   C A C X N"..,
49145)    = 9630
..
Cordialement, Regards,Mit freundlichen Grüßen,
Gautier BEGIN
Next Absences:    - From 20th Feb to 21th Feb
- From 3th Apr to 21th Apr
System Tools Team Lead
CACEIS and APERAM accounts
CSC Computer Sciences Luxembourg S.A.
12D Impasse Drosbach
L-1882 Luxembourg
Global Outsourcing Service | p:+352 24 834 276 | m:+352 621 229 172 |
gbegin at csc.com | www.csc.com
CSC • This is a PRIVATE message. If you are not the intended recipient,
please delete without copying and kindly advise us by e-mail of the
mistake in delivery.  NOTE: Regardless of content, this e-mail shall not
operate to bind CSC to any order or other contract unless pursuant to
explicit written agreement or government initiative expressly permitting
the use of e-mail for such purpose
•
CSC Computer Sciences SAS • Registered Office: Immeuble Le Balzac, 10
Place des Vosges, 92072 Paris La Défense Cedex, France • Registered in
France: RCS Nanterre B 315 268 664
From:        Gautier Begin/LUX/CSC at CSC
To:        xymon at xymon.com
Date:        02/17/2014 04:55 PM
Subject:        [Xymon] XYMON Proxy Issue
Sent by:        "Xymon" <xymon-bounces at xymon.com>
Hello
I'm using XYMON 4.3.12 under Solaris 10.5
Since I put a proxy between my XYMON server and ~1000 agents, I have such
pbl:

Many test are in pruple state, especially BBWin agents.

Even if the test is green, nothing is displayed in RRD graph.

I find timeout messages in logs (agents and server and xymonnet on the
proxy):
2014-02-17 15:58:32 ->  Recipient '10.195.243.205', timeout 15
2014-02-17 15:58:32 ->  1st line: 'combo'
2014-02-17 16:02:53 Whoops ! Failed to send message (timeout)

The xymonproxy log always complaining with a  message that I don't
understand:
 2014-02-17 12:59:30 xymonproxy version 4.3.12 starting 
 2014-02-17 12:59:30 Listening on 0.0.0.0:1984 
 2014-02-17 12:59:30 Sending to Xymon server(s) 10.195.241.64:1984 
 2014-02-17 12:59:30 select() failed: Invalid argument 
 2014-02-17 12:59:30 select() failed: Invalid argument 
 2014-02-17 12:59:30 select() failed: Invalid argument 

Many connections in TIME_WAIT from the proxy to the server, sometime the
status is SYN_SENT

Tests coming from a second xymonproxy with fewer BBWin agents ( ~70) are
working fine.

I tried to play with timeout parameters on servers with no succès.
Any idea ?
Cordialement, Regards,Mit freundlichen Grüßen,
Gautier BEGIN

Xymon mailing list
Xymon at xymon.com
http://lists.xymon.com/mailman/listinfo/xymon

Xymon mailing list
Xymon at xymon.com
http://lists.xymon.com/mailman/listinfo/xymon

[Xymon] XYMON Proxy Issue

gbegin＠csc.com

Communication Issue

Select Issue