[Spce-user] kamailio wont start after apt-get upgrade

Sat Feb 28 08:03:07 EST 2015

Can you post the output of:

root@:/var/run/kamailio# ls -l
total 8
srw-rw-rw- 1 kamailio kamailio 0 Feb 23 17:56 ctl.lb.sock
srw-rw-rw- 1 kamailio kamailio 0 Feb 23 17:56 ctl.proxy.sock
prw-rw-rw- 1 kamailio kamailio 0 Feb 23 17:56 kamailio.lb.fifo
-rw-r--r-- 1 root     root     5 Feb 23 17:56 kamailio.lb.pid
prw-rw-rw- 1 kamailio kamailio 0 Feb 28 14:01 kamailio.proxy.fifo
-rw-r--r-- 1 root     root     5 Feb 23 17:56 kamailio.proxy.pid
-rw-rw---- 1 kamailio kamailio 0 Feb 23 17:56 kamailio_radius.seq

Should look like this actually.

Best,

Alexander Griesser
Head of Systems Operations

ANEXIA Internetdienstleistungs GmbH

E-Mail: ag at anexia.at<mailto:ag at anexia.at>
Web: http://www.anexia.at<http://www.anexia.at/>

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt
Geschäftsführer: Alexander Windbichler
Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Jasper Hagoort [mailto:jhagoort at dside-telecom.nl]
Gesendet: Samstag, 28. Februar 2015 13:46
An: Alexander Griesser
Cc: spce-user at lists.sipwise.com
Betreff: Re: AW: AW: AW: AW: [Spce-user] kamailio wont start after apt-get upgrade

[Das Bild wurde vom Absender entfernt.]

Jasper Hagoort
Directeur

Zalmweg 36E | 4941 VX Raamsdonksveer
T +31 (0)162 714 450 | F +31 (0)162 714 451

dside-telecom.nl<http://www.dside-telecom.nl>

________________________________
Van: "Alexander Griesser" <ag at anexia.at>
Aan: "Jasper Hagoort" <jhagoort at dside-telecom.nl>
Cc: spce-user at lists.sipwise.com
Verzonden: Zaterdag 28 februari 2015 13:37:10
Onderwerp: AW: AW: AW: AW: [Spce-user] kamailio wont start after apt-get upgrade
OK, please check if there’s already a PID file flying around:

/var/run/kamailio/kamailio.proxy.pid

If so, delete it.
Also check if there are probably still some zombie processes running of this application:

ps ax | grep [p]roxy

If no processes are running and the PID file is not there and kamailo-proxy still refuses to start, can you see anything useful in /var/log/ngcp/kamailo-proxy.log or is the logfile empty?
If the logfile is empty and it gets a bit trickier – you will have to strace the start up the process by running:

strace –f –o /tmp/trace.txt /usr/sbin/kamailio -f /etc/kamailio/proxy/kamailio.cfg -P /var/run/kamailio/kamailio.proxy.pid -m 125 -M 32 -u kamailio -g kamailio

It will still fail probably, but you will have a trace file in /tmp/trace.txt then – zip it and attach it to your next mail.

Best,

Alexander Griesser
Head of Systems Operations

ANEXIA Internetdienstleistungs GmbH

E-Mail: ag at anexia.at<mailto:ag at anexia.at>
Web: http://www.anexia.at<http://www.anexia.at/>

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt
Geschäftsführer: Alexander Windbichler
Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Jasper Hagoort [mailto:jhagoort at dside-telecom.nl]
Gesendet: Samstag, 28. Februar 2015 13:32
An: Alexander Griesser
Cc: spce-user at lists.sipwise.com
Betreff: Re: AW: AW: AW: [Spce-user] kamailio wont start after apt-get upgrade

The update workt but the proxy wont start

/etc/init.d/kamailio-proxy restart
+ umask 0022
+ TYPE=proxy
+ PATH=/sbin:/bin:/usr/sbin:/usr/bin
+ DAEMON=/usr/sbin/kamailio
+ NAME=kamailio
+ DESC=kamailio-proxy
+ HOMEDIR=/var/run/kamailio
+ PIDFILE=/var/run/kamailio/kamailio.proxy.pid
+ DEFAULTS=/etc/default/kamailio.proxy
+ CFGFILE=/etc/kamailio/proxy/kamailio.cfg
+ RUN_KAMAILIO=no
+ [ ! -f /usr/sbin/kamailio ]
+ [ -f /etc/default/kamailio.proxy ]
+ . /etc/default/kamailio.proxy
+ RUN_KAMAILIO=yes
+ USER=kamailio
+ GROUP=kamailio
+ SHM_MEMORY=2006
+ PKG_MEMORY=32
+ SSD_SUID=no
+ DUMP_CORE=yes
+ [ yes != yes ]
+ test -z 2006
+ test -z 32
+ echo 2006
+ sed -e s/[^0-9]//g
+ SHM_MEMORY=2006
+ echo 32
+ sed -e s/[^0-9]//g
+ PKG_MEMORY=32
+ [ 2006 -le 0 ]
+ [ 32 -le 0 ]
+ [ -z kamailio ]
+ [ -z kamailio ]
+ /usr/sbin/ngcp-virt-identify --type container
+ test yes = yes
+ ulimit -c unlimited
+ ulimit -l unlimited
+ ulimit -n 16384
+ [ no != yes ]
+ OPTIONS=-f /etc/kamailio/proxy/kamailio.cfg -P /var/run/kamailio/kamailio.proxy.pid -m 2006 -M 32 -u kamailio -g kamailio
+ SSDOPTS=
+ check_kamailio_config
+ /usr/sbin/kamailio -f /etc/kamailio/proxy/kamailio.cfg -P /var/run/kamailio/kamailio.proxy.pid -m 2006 -M 32 -u kamailio -g kamailio -c
+ out=config file ok, exiting...
+ retcode=0
+ [ 0 != 0 ]
+ check_homedir
+ [ ! -d /var/run/kamailio ]
+ chown kamailio:kamailio /var/run/kamailio
+ create_radius_seqfile
+ RADIUS_SEQ_FILE=/var/run/kamailio/kamailio_radius.seq
+ [ ! -f /var/run/kamailio/kamailio_radius.seq ]
+ chown kamailio:kamailio /var/run/kamailio/kamailio_radius.seq
+ chmod 660 /var/run/kamailio/kamailio_radius.seq
+ echo Restarting kamailio-proxy:
Restarting kamailio-proxy:
+ start-stop-daemon --oknodo --stop --quiet --pidfile /var/run/kamailio/kamailio.proxy.pid --retry=5 --exec /usr/sbin/kamailio
+ [ 0 -ne 0 ]
+ [ -x /usr/sbin/ngcp-check_active ]
+ /usr/sbin/ngcp-check_active -q
+ status=0
+ echo Active node or transition.
Active node or transition.
+ start_kamailio_daemon
+ start-stop-daemon --start --quiet --pidfile /var/run/kamailio/kamailio.proxy.pid --exec /usr/sbin/kamailio -- -f /etc/kamailio/proxy/kamailio.cfg -P /var/run/kamailio/kamailio.proxy.pid -m 2006 -M 32 -u kamailio -g kamailio
loading modules under /usr/lib/x86_64-linux-gnu/kamailio/modules:/usr/lib/kamailio/modules
Listening on
             udp: 127.0.0.1:5062
             tcp: 127.0.0.1:5062
Aliases:

+ res=255
+ echo -n kamailio
kamailio + [ 255 -eq 0 ]
+ [ ! -r /var/run/kamailio/kamailio.proxy.pid ]
+ echo error, failed to start.
error, failed to start.
+ exit 1
[Das Bild wurde vom Absender entfernt.]

Jasper Hagoort
Directeur

Zalmweg 36E | 4941 VX Raamsdonksveer
T +31 (0)162 714 450 | F +31 (0)162 714 451

dside-telecom.nl<http://www.dside-telecom.nl>
________________________________
Van: "Alexander Griesser" <ag at anexia.at>
Aan: "Jasper Hagoort" <jhagoort at dside-telecom.nl>
Cc: spce-user at lists.sipwise.com
Verzonden: Zaterdag 28 februari 2015 13:19:34
Onderwerp: AW: AW: AW: [Spce-user] kamailio wont start after apt-get upgrade
Hi Jasper,

alright, here’s the problem. The postinstallation script tries to start kamailo but fails and therefore exits with non-zero status which breaks the installation of the other packages.
So what you could do now to just override the start failure and fix the dependency issues you’re having right now, is to add the following line right after the shebang in /etc/init.d/kamailo-proxy:

OLD:
#!/bin/sh

NEW:
#!/bin/sh
exit 0

After that, `apt-get upgrade` should complete successfully – make sure to revert this change once the package has been installed successfully.

Best,

Alexander Griesser
Head of Systems Operations

ANEXIA Internetdienstleistungs GmbH

E-Mail: ag at anexia.at<mailto:ag at anexia.at>
Web: http://www.anexia.at<http://www.anexia.at/>

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt
Geschäftsführer: Alexander Windbichler
Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Jasper Hagoort [mailto:jhagoort at dside-telecom.nl]
Gesendet: Samstag, 28. Februar 2015 13:12
An: Alexander Griesser
Cc: spce-user at lists.sipwise.com
Betreff: Re: AW: AW: [Spce-user] kamailio wont start after apt-get upgrade

the output but i cant find anything :-(

root at sip ~ # apt-get -f install
Reading package lists... Done
Building dependency tree
Reading state information... Done
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
9 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
[master ed1a91c] saving uncommitted changes in /etc prior to apt run
 Author: root <root at sip.dside.nl>
 15 files changed, 16 insertions(+), 3 deletions(-)
Setting up ngcp-kamailio (4.1.6-1+0~mr3.7.1.2) ...
+ set -e
+ HOMEDIR=/var/run/kamailio
+ adduser --quiet --system --group --disabled-password --shell /bin/false --gecos Kamailio --home /var/run/kamailio kamailio
+ [ -x /etc/init.d/kamailio-lb ]
+ update-rc.d kamailio-lb defaults 23
+ invoke-rc.d kamailio-lb start
Active node or transition.
Starting kamailio-lb using /etc/kamailio/lb/kamailio.cfg:
kamailio already running.
+ [ -x /etc/init.d/kamailio-proxy ]
+ update-rc.d kamailio-proxy defaults 23
+ invoke-rc.d kamailio-proxy start
Active node or transition.
Starting kamailio-proxy using /etc/kamailio/proxy/kamailio.cfg:
loading modules under /usr/lib/x86_64-linux-gnu/kamailio/modules:/usr/lib/kamailio/modules
Listening on
             udp: 127.0.0.1:5062
             tcp: 127.0.0.1:5062
Aliases:

kamailio error, failed to start.
invoke-rc.d: initscript kamailio-proxy, action "start" failed.
+ exit 1
dpkg: error processing ngcp-kamailio (--configure):
 subprocess installed post-installation script returned error exit status 1
dpkg: dependency problems prevent configuration of ngcp-kamailio-mysql-modules:amd64:
 ngcp-kamailio-mysql-modules:amd64 depends on ngcp-kamailio (= 4.1.6-1+0~mr3.7.1.2); however:
  Package ngcp-kamailio is not configured yet.

dpkg: error processing ngcp-kamailio-mysql-modules:amd64 (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of ngcp-kamailio-lcrrate-modules:amd64:
 ngcp-kamailio-lcrrate-modules:amd64 depends on ngcp-kamailio-mysql-modules (= 4.1.6-1+0~mr3.7.1.2); however:
  Package ngcp-kamailio-mysql-modules:amd64 is not configured yet.

dpkg: error processing ngcp-kamailio-lcrrate-modules:amd64 (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of ngcp-kamailio-lua-modules:amd64:
 ngcp-kamailio-lua-modules:amd64 depends on ngcp-kamailio (= 4.1.6-1+0~mr3.7.1.2); however:
  Package ngcp-kamailio is not configured yet.

dpkg: error processing ngcp-kamailio-lua-modules:amd64 (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of ngcp-kamailio-presence-modules:amd64:
 ngcp-kamailio-presence-modules:amd64 depends on ngcp-kamailio (= 4.1.6-1+0~mr3.7.1.2); however:
  Package ngcp-kamailio is not configured yet.

dpkg: error processing ngcp-kamailio-presence-modules:amd64 (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of ngcp-kamailio-tls-modules:amd64:
 ngcp-kamailio-tls-modules:amd64 depends on ngcp-kamailio (= 4.1.6-1+0~mr3.7.1.2); however:
  Package ngcp-kamailio is not configured yet.

dpkg: error processing ngcp-kamailio-tls-modules:amd64 (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of ngcp-kamailio-utils-modules:amd64:
 ngcp-kamailio-utils-modules:amd64 depends on ngcp-kamailio (= 4.1.6-1+0~mr3.7.1.2); however:
  Package ngcp-kamailio is not configured yet.

dpkg: error processing ngcp-kamailio-utils-modules:amd64 (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of ngcp-kamailio-websocket-modules:amd64:
 ngcp-kamailio-websocket-modules:amd64 depends on ngcp-kamailio (= 4.1.6-1+0~mr3.7.1.2); however:
  Package ngcp-kamailio is not configured yet.

dpkg: error processing ngcp-kamailio-websocket-modules:amd64 (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of ngcp-kamailio-xml-modules:amd64:
 ngcp-kamailio-xml-modules:amd64 depends on ngcp-kamailio (= 4.1.6-1+0~mr3.7.1.2); however:
  Package ngcp-kamailio is not configured yet.

dpkg: error processing ngcp-kamailio-xml-modules:amd64 (--configure):
 dependency problems - leaving unconfigured
Errors were encountered while processing:
 ngcp-kamailio
 ngcp-kamailio-mysql-modules:amd64
 ngcp-kamailio-lcrrate-modules:amd64
 ngcp-kamailio-lua-modules:amd64
 ngcp-kamailio-presence-modules:amd64
 ngcp-kamailio-tls-modules:amd64
 ngcp-kamailio-utils-modules:amd64
 ngcp-kamailio-websocket-modules:amd64
 ngcp-kamailio-xml-modules:amd64
E: Sub-process /usr/bin/dpkg returned an error code (1)
[Das Bild wurde vom Absender entfernt.]

Jasper Hagoort
Directeur

Zalmweg 36E | 4941 VX Raamsdonksveer
T +31 (0)162 714 450 | F +31 (0)162 714 451

dside-telecom.nl<http://www.dside-telecom.nl>
________________________________
Van: "Alexander Griesser" <ag at anexia.at>
Aan: "Jasper Hagoort" <jhagoort at dside-telecom.nl>
Cc: spce-user at lists.sipwise.com
Verzonden: Zaterdag 28 februari 2015 11:26:37
Onderwerp: AW: AW: [Spce-user] kamailio wont start after apt-get upgrade
Interesting.

The postinst script tries to do the following actions (at least on my system) and fails at one of these points.
You might want to replace the shebang in the first line with „#! /bin/sh –x“ to see where it stops or add some „echo“ debugging to this script to see where it bails out.
Location is /var/lib/dpkg/info/ngcp-kamailio.postinst.

#! /bin/sh
#

set -e

HOMEDIR=/var/run/kamailio

case "$1" in
    configure)
        adduser --quiet --system --group --disabled-password \
                --shell /bin/false --gecos "Kamailio" \
                --home "$HOMEDIR" kamailio || true
        ;;

    abort-upgrade|abort-remove|abort-deconfigure)
        ;;

    *)
        echo "postinst called with unknown argument \`$1'" >&2
        exit 1
        ;;
esac

# Automatically added by dh_installinit
if [ -x "/etc/init.d/kamailio-lb" ]; then
        update-rc.d kamailio-lb defaults 23 >/dev/null
        invoke-rc.d kamailio-lb start || exit $?
fi
# End automatically added section
# Automatically added by dh_installinit
if [ -x "/etc/init.d/kamailio-proxy" ]; then
        update-rc.d kamailio-proxy defaults 23 >/dev/null
        invoke-rc.d kamailio-proxy start || exit $?
fi
# End automatically added section
# Automatically added by dh_makeshlibs
if [ "$1" = "configure" ]; then
        ldconfig
fi
# End automatically added section

Alexander Griesser
Head of Systems Operations

ANEXIA Internetdienstleistungs GmbH

E-Mail: ag at anexia.at<mailto:ag at anexia.at>
Web: http://www.anexia.at<http://www.anexia.at/>

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt
Geschäftsführer: Alexander Windbichler
Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Jasper Hagoort [mailto:jhagoort at dside-telecom.nl]
Gesendet: Samstag, 28. Februar 2015 11:22
An: Alexander Griesser
Cc: spce-user at lists.sipwise.com
Betreff: Re: AW: [Spce-user] kamailio wont start after apt-get upgrade

root at sip ~ # apt-get -f install
Reading package lists... Done
Building dependency tree
Reading state information... Done
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
9 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
Setting up ngcp-kamailio (4.1.6-1+0~mr3.7.1.2) ...
Active node or transition.
Starting kamailio-lb using /etc/kamailio/lb/kamailio.cfg:
kamailio already running.
Active node or transition.
Starting kamailio-proxy using /etc/kamailio/proxy/kamailio.cfg:
loading modules under /usr/lib/x86_64-linux-gnu/kamailio/modules:/usr/lib/kamailio/modules
Listening on
             udp: 127.0.0.1:5062
             tcp: 127.0.0.1:5062
Aliases:

kamailio error, failed to start.
invoke-rc.d: initscript kamailio-proxy, action "start" failed.
dpkg: error processing ngcp-kamailio (--configure):
 subprocess installed post-installation script returned error exit status 1
dpkg: dependency problems prevent configuration of ngcp-kamailio-mysql-modules:amd64:
 ngcp-kamailio-mysql-modules:amd64 depends on ngcp-kamailio (= 4.1.6-1+0~mr3.7.1.2); however:
  Package ngcp-kamailio is not configured yet.