[Spce-user] kamailio freezes and crashes
danbratly at tuta.io
danbratly at tuta.io
Tue Jan 30 07:29:54 EST 2024
Hi Marco,
both, sometimes a crash and sometimes "just" a freeze.
I have attached a coredump of a crash as attachment.
BR
Dan
Jan 29, 2024, 15:51 by spce-user at lists.sipwise.com:
> Hi,
>
> It is just a simple freeze of kamailio or you have noticed a crash?
> In the second case can you check in folder "/ngcp-data/coredumps/" if you have a core file related to kamailio? If so it would be good if you can install the kamailio debug symbols and send us back the full backtrace of the coredump (please remove any sensitive date before share it with the mailing list).
>
> Thank you
> Marco
>
>
> On Fri, Jan 26, 2024 at 3:00 PM danbratly--- via Spce-user <> spce-user at lists.sipwise.com> > wrote:
>
>>
>>
>> Hi all,
>> i have updated to version mr11.5.1. since then the proxy sometimes crashes or "freezes".
>> With the mr10.5.4 release there were no such problems.
>> kamailio version used: 5.7.3-1+0~mr11.5.1.11
>>
>>
>> the following error is associated with a freeze. the message has spammed the log, no more requests were accepted and processed during this time until the proxy was restarted manually
>> CRITICAL: <core> [core/mem/q_malloc.c:535]: qm_free(): BUG: freeing already freed pointer (0x7f4df0ef3608), called from core: core/xavp.c: xavp_free_unsafe(101), first free pv_headers: pvh_xavp.c: pvh_xavi_new_value(112) - ignoring
>>
>> However, it has already happened that the proxy froze without there being a corresponding message in the log.
>>
>>
>> Here are some more log messages that regularly appear in the log.
>> ERROR: ROUTE_REG_HANDLE <core> [core/lvalue.c:351]: lval_pvar_assign(): non existing right pvar
>> ERROR: ROUTE_REG_HANDLE <core> [core/lvalue.c:411]: lval_assign(): assignment failed at pos: (166,15-166,57)
>> ---
>> ERROR: <core> [core/udp_server.c:640]: udp_send(): sendto(sock, buf: 0x7f60bce89ea0, len: 332, 0, dst: (xxx.xxx.xxx.xxx:5060), tolen: 16) - err: Invalid argument (22)
>> CRITICAL: <core> [core/udp_server.c:646]: udp_send(): invalid sendtoparameters#012one possible reason is the server is bound to localhost and#012attempts to send to the net
>> ERROR: nathelper [nathelper.c:2380]: nh_timer(): sip udp_send failed
>>
>>
>> I have not noticed any connection between the log entries and the freezes/crashes.
>>
>> Anyone have any idea where to look for the "real" error or how to fix it?
>>
>> Thanks Alot !
>>
>> BR
>>
>> Dan
>> --
>> Spce-user mailing list
>> >> Spce-user at lists.sipwise.com
>> >> http://lists.sipwise.com/mailman/listinfo/spce-user_lists.sipwise.com
>>
>
>
> --
>
> Sipwise GmbH | an Alcatel-Lucent Company
> Leonard-Bernstein-Straße 10 | 1220 Wien
> Email: invoice at sipwise.com <mailto:gfuchs at sipwise.com>
> Website: > https://www.sipwise.com
>
> Particulars according Austrian Companies Code paragraph 14
> Geschäftsführer: DI Dr. Gernot Fuchs Sitz: Wien FG: Landesgericht Wien FN: 305595f
> Die übermittelten Informationen sind ausschließlich dem Empfänger vorbehalten und können vertrauliches oder privilegiertes Material enthalten. Ein Gebrauch, Weiterleitung oder Verbreitung in jeglicher Form seitens Dritter ist nicht gestattet. Sollten Sie diese Nachricht irrtümlich erhalten haben, bitten wir Sie, sich mit dem Absender in Verbindung zu setzen und die Nachricht einschließlich der Anlagen zu löschen. Jegliche nicht autorisierte Nutzung dieser E-Mail ist illegal.
> Hinweis zum Datenschutz: Sipwise GmbH ist der Schutz Ihrer Daten wichtig. Auch durch die Kommunikation per E-Mail werden personenbezogene Daten ausgetauscht. Erfahren Sie mehr unter: > www.sipwise.com <http://www.sipwise.com/>
>
> Managing Director: DI Dr. Gernot Fuchs HQ: Vienna FG: Vienna Regional Court FN: 305595f
> Confidentially notice. This e-mail transmission may contain legally privileged and/or confidential information. Please do not read it if you are not the intended recipient(s). Any use, reproduction or disclosure by any other person is prohibited. If you have received this e-mail in error, please notify the sender and destroy the original transmission and its attachments without reading or saving it in any manner. Any unauthorized use of this e-mail is illegal.
> Note on data protection: Sipwise GmbH attaches great importance to the protection of your data. Personal data is also exchanged through communication by e-mail. Learn more at: > www.sipwise.com <http://www.sipwise.com/>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.sipwise.com/pipermail/spce-user_lists.sipwise.com/attachments/20240130/87f83bd2/attachment.html>
-------------- next part --------------
GNU gdb (Debian 13.1-3) 13.1
Copyright (C) 2023 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<https://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/sbin/kamailio...
Reading symbols from /usr/lib/debug/.build-id/24/4f921fc3c02b034b64917e34e49f1c4b4f4096.debug...
warning: Can't open file /dev/zero (deleted) during file-backed mapping note processing
[New LWP 1248044]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/sbin/kamailio -P /run/kamailio/kamailio.proxy.pid -f /etc/kamailio/proxy/k'.
Program terminated with signal SIGBUS, Bus error.
#0 0x000055df1de95afb in xavp_destroy_list_unsafe (head=0x7ffa6f9f03f8) at core/xavp.c:619
619 core/xavp.c: No such file or directory.
(gdb) backtrace
#0 0x000055df1de95afb in xavp_destroy_list_unsafe (head=0x7ffa6f9f03f8) at core/xavp.c:619
#1 xavp_free_unsafe (xa=0x7ffa6f9f03d8) at core/xavp.c:99
#2 0x000055df1de972c4 in xavp_destroy_list_unsafe (head=head at entry=0x7ffa74078030) at core/xavp.c:620
#3 0x00007ffb690ffd2c in free_cell_helper (dead_cell=0x7ffa74077dc0, silent=<optimized out>, fname=<optimized out>, fline=<optimized out>) at ./src/modules/tm/h_table.c:265
#4 0x00007ffb69190cd0 in wait_handler (ti=<optimized out>, wait_tl=<optimized out>, data=0x7ffa74077dc0) at ./src/modules/tm/timer.c:651
#5 0x000055df1de792ac in timer_list_expire (slow_mark=22698, slow_l=<optimized out>, h=0x7ffa6bf85278, t=<optimized out>) at core/timer.c:861
#6 timer_handler () at core/timer.c:925
#7 timer_main () at core/timer.c:963
#8 0x000055df1dc7d77c in main_loop () at ./src/main.c:1918
#9 0x000055df1dc71b39 in main (argc=<optimized out>, argv=<optimized out>) at ./src/main.c:3212
(gdb) bt full
#0 0x000055df1de95afb in xavp_destroy_list_unsafe (head=0x7ffa6f9f03f8) at core/xavp.c:619
avp = 0x707365725f646c6f
foo = 0x707365725f646c6f
#1 xavp_free_unsafe (xa=0x7ffa6f9f03d8) at core/xavp.c:99
__func__ = "xavp_free_unsafe"
#2 0x000055df1de972c4 in xavp_destroy_list_unsafe (head=head at entry=0x7ffa74078030) at core/xavp.c:620
avp = 0x7ffa6e1705b8
foo = <optimized out>
#3 0x00007ffb690ffd2c in free_cell_helper (dead_cell=0x7ffa74077dc0, silent=<optimized out>, fname=<optimized out>, fline=<optimized out>) at ./src/modules/tm/h_table.c:265
b = <optimized out>
i = <optimized out>
rpl = <optimized out>
tt = 0x0
foo = <optimized out>
cbs = <optimized out>
cbs_tmp = <optimized out>
__func__ = "free_cell_helper"
#4 0x00007ffb69190cd0 in wait_handler (ti=<optimized out>, wait_tl=<optimized out>, data=0x7ffa74077dc0) at ./src/modules/tm/timer.c:651
p_cell = 0x7ffa74077dc0
ret = <optimized out>
unlinked = <optimized out>
rcount = <optimized out>
__func__ = "wait_handler"
#5 0x000055df1de792ac in timer_list_expire (slow_mark=22698, slow_l=<optimized out>, h=0x7ffa6bf85278, t=<optimized out>) at core/timer.c:861
tl = 0x7ffa74077e78
ret = <optimized out>
tl = <optimized out>
ret = <optimized out>
#6 timer_handler () at core/timer.c:925
saved_ticks = <optimized out>
run_slow_timer = 0
i = <optimized out>
saved_ticks = <optimized out>
run_slow_timer = <optimized out>
i = <optimized out>
__func__ = "timer_handler"
__llevel = <optimized out>
__kld = <optimized out>
__llevel = <optimized out>
__kld = <optimized out>
#7 timer_main () at core/timer.c:963
No locals.
#8 0x000055df1dc7d77c in main_loop () at ./src/main.c:1918
i = <optimized out>
pid = <optimized out>
si = <optimized out>
si_desc = "udp receiver child=7 sock=127.0.0.1:5062\000\245\340\035\337U\000\000", '\377' <repeats 16 times>, "6\004\r\000\000\000\000\000\234d\324u\373\177\000\000\001\000\000\000\000\000\000\000\t\000\000\000\000\000\000\000Thu Jan \000\321?\230\255\373|\304:54 2024\t\000\000\000\000\000\000"
nrprocs = <optimized out>
woneinit = 1
__func__ = "main_loop"
error = <optimized out>
#9 0x000055df1dc71b39 in main (argc=<optimized out>, argv=<optimized out>) at ./src/main.c:3212
cfg_stream = <optimized out>
c = <optimized out>
r = <optimized out>
tmp = 0x7ffed5e66e3a ""
tmp_len = 791621423
port = 791621423
proto = 0
ahost = 0x0
aport = 0
options = 0x55df1df9bb78 ":f:cm:M:dVIhEeb:l:L:n:vKrRDTN:W:w:t:u:g:P:G:SQ:O:a:A:x:X:Y:"
ret = -1
seed = 269559081
rfd = <optimized out>
debug_save = <optimized out>
debug_flag = <optimized out>
dont_fork_cnt = <optimized out>
n_lst = <optimized out>
p = <optimized out>
st = {st_dev = 23, st_ino = 1440, st_nlink = 2, st_mode = 16872, st_uid = 116, st_gid = 122, __pad0 = 0, st_rdev = 0, st_size = 240, st_blksize = 4096, st_blocks = 0, st_atim = {tv_sec = 1705316857, tv_nsec = 436144801}, st_mtim = {tv_sec = 1706169894, tv_nsec = 736160650}, st_ctim = {tv_sec = 1706169894, tv_nsec = 736160650}, __glibc_reserved = {0, 0, 0}}
tbuf = '\000' <repeats 511 times>
option_index = 0
long_options = {{name = 0x55df1df9a22a "help", has_arg = 0, flag = 0x0, val = 104}, {name = 0x55df1dfa37ee "version", has_arg = 0, flag = 0x0, val = 118}, {name = 0x55df1dfb30d2 "alias", has_arg = 1, flag = 0x0, val = 1024}, {name = 0x55df1df9a22f "subst", has_arg = 1, flag = 0x0, val = 1025}, {name = 0x55df1df9a235 "substdef", has_arg = 1, flag = 0x0, val = 1026}, {
name = 0x55df1df9a23e "substdefs", has_arg = 1, flag = 0x0, val = 1027}, {name = 0x55df1df9a248 "server-id", has_arg = 1, flag = 0x0, val = 1028}, {name = 0x55df1df9a252 "loadmodule", has_arg = 1, flag = 0x0, val = 1029}, {name = 0x55df1df9a25d "modparam", has_arg = 1, flag = 0x0, val = 1030}, {name = 0x55df1df9a266 "log-engine", has_arg = 1, flag = 0x0,
val = 1031}, {name = 0x55df1dfa390b "debug", has_arg = 1, flag = 0x0, val = 1032}, {name = 0x55df1df9a271 "cfg-print", has_arg = 0, flag = 0x0, val = 1033}, {name = 0x55df1df9a27b "atexit", has_arg = 1, flag = 0x0, val = 1034}, {name = 0x55df1df9a282 "all-errors", has_arg = 0, flag = 0x0, val = 1035}, {name = 0x0, has_arg = 0, flag = 0x0, val = 0}}
__func__ = "main"
More information about the Spce-user
mailing list