[Spce-user] 6.5.3 - kamailio-lb stops responding to tcp/tls requests after some time...

Mon Apr 1 00:38:19 EDT 2019

Hi,

I use this script - but I have switched to TCP instead of TLS for the time
being as using I deem TLS as officially NOT usable AT ALL on the new SPCE
6.5.3 .... I urge the developers to urgently fix this...   With about 100
TLS clients Kamailio-LB WILL STOP RESPONDING to TLS requests within about
5-10 minutes max...

root at mobile-sipwise-1:~# cat check_timeout
#!/bin/bash
if [ `tail -10 /var/log/ngcp/kamailio-lb.log |grep -c 'ERROR'` -gt 0 ]
then
tail -20 /var/log/ngcp/kamailio-lb.log|mail -s "Mobile Kamailio-LB
restarted" admin at domain.com
/usr/sbin/service kamailio-lb restart
fi

On Sat, Mar 30, 2019 at 9:47 AM Andy Clark <andyclark05251978 at gmail.com>
wrote:

> Hi,
> That would be great if you can send me the script - Thank you
>
> Is it a cron job that runs every 1 min?
>
> On Mon, Mar 25, 2019 at 11:04 AM Walter Klomp <walter at myrepublic.net>
> wrote:
>
>> Yes I have a script that runs every minute checking for the word ERROR in
>> the kamailio-lb logfile for the last 10 lines and restarts the kamailio-lb
>> service if this occurs. This doesn’t affect live calls and so far seems to
>> work well.
>>
>> It’s a rudimentary solution and needs a bit of tweaking. If you want the
>> script let me know.
>>
>> On Tue, 26 Mar 2019 at 00:44, Andy Clark <andyclark05251978 at gmail.com>
>> wrote:
>>
>>> I have the same issue - any temp solution?
>>>
>>> I'd like to put my spce 6.5.3.1+0~mr6.5.3.1 into production - but am
>>> worried about this issue
>>>
>>> On Sun, Mar 24, 2019 at 6:48 PM Walter Klomp <walter at myrepublic.net>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> This morning something else happened which also stopped tcp
>>>> connections...
>>>>
>>>> Mar 25 09:41:17 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/tcp_main.c:973]: tcpconn_new(): mem. allocation failure
>>>> Mar 25 09:41:17 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/tcp_main.c:4042]: handle_new_connect(): tcpconn_new failed, closing
>>>> socket
>>>> Mar 25 09:41:18 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/mem/q_malloc.c:290]: qm_find_free(): qm_find_free(0x7efd040d9000,
>>>> 66296); Free fragment not found!
>>>> Mar 25 09:41:18 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/mem/q_malloc.c:423]: qm_malloc(): qm_malloc(0x7efd040d9000, 66296)
>>>> called from core: core/tcp_main.c: tcpconn_new(971), module: core; Free
>>>> fragment not found!
>>>> Mar 25 09:41:18 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/tcp_main.c:973]: tcpconn_new(): mem. allocation failure
>>>> Mar 25 09:41:18 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/tcp_main.c:4042]: handle_new_connect(): tcpconn_new failed, closing
>>>> socket
>>>> Mar 25 09:41:18 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/mem/q_malloc.c:290]: qm_find_free(): qm_find_free(0x7efd040d9000,
>>>> 66296); Free fragment not found!
>>>> Mar 25 09:41:18 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/mem/q_malloc.c:423]: qm_malloc(): qm_malloc(0x7efd040d9000, 66296)
>>>> called from core: core/tcp_main.c: tcpconn_new(971), module: core; Free
>>>> fragment not found!
>>>> Mar 25 09:41:18 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/tcp_main.c:973]: tcpconn_new(): mem. allocation failure
>>>> Mar 25 09:41:18 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/tcp_main.c:4042]: handle_new_connect(): tcpconn_new failed, closing
>>>> socket
>>>> Mar 25 09:41:19 mobile-sipwise-1 lb[11500]: NOTICE: <script>: Relaying
>>>> request, fs='udp:127.0.0.1:5060' du='sip:127.0.0.1:5062' - R=
>>>> sip:s at 103.7.203.8:5060 ID=1833244586 at 127.0.0.2 UA='sipsak 0.9.7pre'
>>>> Mar 25 09:41:19 mobile-sipwise-1 lb[11507]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:103.7.203.8:5060' du='127.0.0.2:34803' -
>>>> ID=1833244586 at 127.0.0.2 UA='<null>'
>>>> Mar 25 09:41:19 mobile-sipwise-1 lb[11501]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:103.7.203.8:5060' du='127.0.0.2:34803' -
>>>> ID=1833244586 at 127.0.0.2 UA='<null>'
>>>> Mar 25 09:41:21 mobile-sipwise-1 lb[11506]: NOTICE: <script>: Relaying
>>>> request, fs='udp:127.0.0.1:5060' du='sip:127.0.0.1:5062' -
>>>> R=sip:nagios at voip.sipwise.local:5060 ID=131947360 at 127.0.0.2 UA='sipsak
>>>> 0.9.7pre'
>>>> Mar 25 09:41:21 mobile-sipwise-1 lb[11504]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:127.0.0.1:5060' du='127.0.0.2:9475' - ID=
>>>> 131947360 at 127.0.0.2 UA='<null>'
>>>> Mar 25 09:41:21 mobile-sipwise-1 lb[11508]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:127.0.0.1:5060' du='127.0.0.2:9475' - ID=
>>>> 131947360 at 127.0.0.2 UA='<null>'
>>>> Mar 25 09:41:29 mobile-sipwise-1 lb[11493]: NOTICE: <script>: Relaying
>>>> request, fs='udp:127.0.0.1:5060' du='sip:127.0.0.1:5062' - R=
>>>> sip:s at 103.7.203.8:5060 ID=496525631 at 127.0.0.2 UA='sipsak 0.9.7pre'
>>>> Mar 25 09:41:29 mobile-sipwise-1 lb[11505]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:103.7.203.8:5060' du='127.0.0.2:53386' -
>>>> ID=496525631 at 127.0.0.2 UA='<null>'
>>>> Mar 25 09:41:29 mobile-sipwise-1 lb[11503]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:103.7.203.8:5060' du='127.0.0.2:53386' -
>>>> ID=496525631 at 127.0.0.2 UA='<null>'
>>>> Mar 25 09:41:31 mobile-sipwise-1 lb[11502]: NOTICE: <script>: Relaying
>>>> request, fs='udp:127.0.0.1:5060' du='sip:127.0.0.1:5062' -
>>>> R=sip:nagios at voip.sipwise.local:5060 ID=816014641 at 127.0.0.2 UA='sipsak
>>>> 0.9.7pre'
>>>> Mar 25 09:41:31 mobile-sipwise-1 lb[11507]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:127.0.0.1:5060' du='127.0.0.2:7517' - ID=
>>>> 816014641 at 127.0.0.2 UA='<null>'
>>>> Mar 25 09:41:31 mobile-sipwise-1 lb[11501]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:127.0.0.1:5060' du='127.0.0.2:7517' - ID=
>>>> 816014641 at 127.0.0.2 UA='<null>'
>>>> Mar 25 09:41:37 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/mem/q_malloc.c:290]: qm_find_free(): qm_find_free(0x7efd040d9000,
>>>> 66296); Free fragment not found!
>>>> Mar 25 09:41:37 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/mem/q_malloc.c:423]: qm_malloc(): qm_malloc(0x7efd040d9000, 66296)
>>>> called from core: core/tcp_main.c: tcpconn_new(971), module: core; Free
>>>> fragment not found!
>>>> Mar 25 09:41:37 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/tcp_main.c:973]: tcpconn_new(): mem. allocation failure
>>>> Mar 25 09:41:37 mobile-sipwise-1 lb[11526]: ERROR: <core>
>>>> [core/tcp_main.c:4042]: handle_new_connect(): tcpconn_new failed, closing
>>>> socket
>>>> Mar 25 09:41:39 mobile-sipwise-1 lb[11494]: NOTICE: <script>: Relaying
>>>> request, fs='udp:127.0.0.1:5060' du='sip:127.0.0.1:5062' - R=
>>>> sip:s at 103.7.203.8:5060 ID=528716727 at 127.0.0.2 UA='sipsak 0.9.7pre'
>>>> Mar 25 09:41:39 mobile-sipwise-1 lb[11506]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:103.7.203.8:5060' du='127.0.0.2:45992' -
>>>> ID=528716727 at 127.0.0.2 UA='<null>'
>>>> Mar 25 09:41:39 mobile-sipwise-1 lb[11504]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:103.7.203.8:5060' du='127.0.0.2:45992' -
>>>> ID=528716727 at 127.0.0.2 UA='<null>'
>>>> Mar 25 09:41:41 mobile-sipwise-1 lb[11508]: NOTICE: <script>: Relaying
>>>> request, fs='udp:127.0.0.1:5060' du='sip:127.0.0.1:5062' -
>>>> R=sip:nagios at voip.sipwise.local:5060 ID=1925737118 at 127.0.0.2
>>>> UA='sipsak 0.9.7pre'
>>>> Mar 25 09:41:41 mobile-sipwise-1 lb[11505]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:127.0.0.1:5060' du='127.0.0.2:8102' - ID=
>>>> 1925737118 at 127.0.0.2 UA='<null>'
>>>> Mar 25 09:41:41 mobile-sipwise-1 lb[11503]: NOTICE: <script>: Sending
>>>> reply from inbound, fs='udp:127.0.0.1:5060' du='127.0.0.2:8102' - ID=
>>>> 1925737118 at 127.0.0.2 UA='<null>'
>>>>
>>>> What's going on with this Kamailio-lb ?  Haven't had such issues before
>>>> with 5.5.x and 4.5.x (ever...)
>>>>
>>>> Any setting I need to change ?
>>>>
>>>>
>>>> --
>>>>
>>>> Warmest Regards,
>>>> Walter
>>>>
>>>>
>>>>

-- 
The contents of this email and any attachments are confidential and may 
also be privileged. You must not disseminate the contents of this email and 
any attachments without permission of the sender. If you have received this 
email by mistake, please delete all copies and inform the sender 
immediately. You may refer to our company's Privacy Policy here 
<https://myrepublic.net/sg/legal/terms-of-use-policies/privacy-policy/>.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.sipwise.com/mailman/private/spce-user_lists.sipwise.com/attachments/20190401/4434c88b/attachment.html>