<div dir="ltr">Hi Alex, <div><br></div><div>You are correct.</div><div><br></div><div>The main process running is Kamailio.</div><div><br></div><div><div>mysql> show processlist;</div><div>+--------+------------+-----------+------------+---------+--------+-----------+---------------------------------------------------- --------------------------------------------------+</div><div>| Id | User | Host | db | Command | Time | State | Info |</div><div>+--------+------------+-----------+------------+---------+--------+-----------+---------------------------------------------------- --------------------------------------------------+</div><div>| 22 | nagios | localhost | NULL | Sleep | 1 | | NULL |</div><div>| 406181 | kamailio | localhost | kamailio | Query | 101443 | query end | insert into acc (method,from_tag,to_tag,callid,sip_ code,sip_reason,time,time_hires,src_user,src_doma |</div><div>| 409077 | kamailio | localhost | kamailio | Query | 95831 | query end | insert into acc (method,from_tag,to_tag,callid,sip_ code,sip_reason,time,time_hires,src_user,src_doma |</div><div>| 411835 | kamailio | localhost | kamailio | Query | 90758 | query end | insert into acc (method,from_tag,to_tag,callid,sip_ code,sip_reason,time,time_hires,src_user,src_doma |</div></div><div><br></div><div><br></div><div>This is what is shown from show processlist.</div><div><br></div><div>Not sure how prevent this from happening.</div><div><br></div><div>Regards,</div><div><br></div><div>Tabi</div><img src="http://t.signaletre.com/e1t/o/5/f18dQhb0S7ks8dDMPbW2n0x6l2B9gXrN7sKj6v4LTTlW653lLR4X9P3HW64QWy01pctGFW2JNYSB1k1H6H0?si=6355392162955264&pi=31dfab13-a79d-4f52-e215-9eaadecc6c9b" style="display:none!important" height="1" width="1"></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Mar 17, 2015 at 7:50 PM, Alexander Griesser <span dir="ltr"><<a href="mailto:ag@anexia.at" target="_blank">ag@anexia.at</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="DE" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">Well, increasing won’t help in the long run.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">Whatever is maxing out your connections, it will max out the new limit pretty soon again, so you need to find out where these connections
are coming from.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">What does show processlist show? Are there many connections in sleep state?<u></u><u></u></span></p><span class="">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">Best,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span lang="DE-AT" style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">Alexander Griesser<u></u><u></u></span></b></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black">Head of Systems Operations<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">ANEXIA Internetdienstleistungs GmbH<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black">E-Mail:
<a href="mailto:ag@anexia.at" target="_blank">ag@anexia.at</a><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black">Web:
<a href="http://www.anexia.at/" target="_blank">http://www.anexia.at</a><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#595959">Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#595959">Geschäftsführer: Alexander Windbichler<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#595959">Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"><u></u> <u></u></span></p>
</span><p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Von:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Tabi Tabe Tabi [mailto:<a href="mailto:tabi.tabe@gmail.com" target="_blank">tabi.tabe@gmail.com</a>]
<br>
<b>Gesendet:</b> Dienstag, 17. März 2015 18:49<br>
<b>An:</b> Alexander Griesser<br>
<b>Cc:</b> Daniel Grotti; <a href="mailto:spce-user@lists.sipwise.com" target="_blank">spce-user@lists.sipwise.com</a></span></p><div><div class="h5"><br>
<b>Betreff:</b> Re: [Spce-user] 500 Internal Server error<u></u><u></u></div></div><p></p><div><div class="h5">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Lol<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I am using 2049 concurrent connections, even when the server is idling.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Thanks. Will increase the number of concurrent connections. What is the recommended max connection?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Tabi<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Tue, Mar 17, 2015 at 7:40 PM, Alexander Griesser <<a href="mailto:ag@anexia.at" target="_blank">ag@anexia.at</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">Yah, you’re having too many open connections to your mysql database.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">The default config should be 2048 connections, so you’ve somehow exhausted them.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">Try to login to your mysql server from the CLI and examine the show processlist output:</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d"># mysql --defaults-file=/etc/mysql/debian.cnf</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">Welcome to the MySQL monitor. Commands end with ; or \g.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">Your MySQL connection id is 291683</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">Server version: 5.5.41-0+wheezy1-log (Debian)</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">Copyright (c) 2000, 2014, Oracle and/or its affiliates. All rights reserved.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">Oracle is a registered trademark of Oracle Corporation and/or its</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">affiliates. Other names may be trademarks of their respective</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">owners.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">mysql> show processlist;</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">+--------+------------------+-----------+----------+---------+------+-------+------------------+</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">| Id | User | Host | db | Command | Time | State | Info |</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">+--------+------------------+-----------+----------+---------+------+-------+------------------+</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">| 6 | kamailio | localhost | kamailio | Sleep | 7 | | NULL |</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">| 40 | kamailio | localhost | kamailio | Sleep | 9 | | NULL |</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">| 116 | nagios | localhost | NULL | Sleep | 5 | | NULL |</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">| 291683 | debian-sys-maint | localhost | NULL | Query | 0 | NULL | show processlist |</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">+--------+------------------+-----------+----------+---------+------+-------+------------------+</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">4 rows in set (0.00 sec)</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">You will probably have one query hanging at the top of this output which blocks all other queries from
going through, or there’s something else wrong, but this output will help you find out, what it is.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">As a quick fix, while still in the mysql console, you can try to increase the number of available connections
by entering the command:</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">mysql> set global max_connections = 3096;</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Courier New";color:#1f497d">Query OK, 0 rows affected (0.00 sec)</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d">best,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><b><span lang="DE-AT" style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">Alexander Griesser</span></b><u></u><u></u></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black">Head of Systems Operations</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">ANEXIA Internetdienstleistungs GmbH</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black">E-Mail:
<a href="mailto:ag@anexia.at" target="_blank">ag@anexia.at</a></span><u></u><u></u></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black">Web:
<a href="http://www.anexia.at/" target="_blank">http://www.anexia.at</a></span><u></u><u></u></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#595959">Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#595959">Geschäftsführer: Alexander Windbichler</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="DE-AT" style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#595959">Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d"> </span><u></u><u></u></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Von:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Tabi Tabe Tabi [mailto:<a href="mailto:tabi.tabe@gmail.com" target="_blank">tabi.tabe@gmail.com</a>]
<br>
<b>Gesendet:</b> Dienstag, 17. März 2015 18:37<br>
<b>An:</b> Daniel Grotti; Alexander Griesser<br>
<b>Cc:</b> <a href="mailto:spce-user@lists.sipwise.com" target="_blank">spce-user@lists.sipwise.com</a><br>
<b>Betreff:</b> Re: [Spce-user] 500 Internal Server error</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal">Thanks Alex/Daniel,<u></u><u></u></p>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">This is what I found:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Mar 17 18:55:27 sbc-1 ngcp-panel: ERROR: fatal error, id=13CC57719176611F, timestamp=2015-03-17T16:55:27.252979999Z, error=DBIx::Class::ResultSet::first(): DBI Connection failed:
DBI connect('database=provisioning;host=localhost;port=3306','soap',...) failed: Too many connections at /usr/share/perl5/DBIx/Class/Storage/DBI.pm line 1249 at /usr/share/perl5/Catalyst/Authentication/Store/DBIx/Class/User.pm line 77<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">I have noticed a other errors related to too many connections. It is also related to errors occurring when creating a new subscribers and failed drop calls with same 500 internal
error.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Tabi<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal">On Tue, Mar 17, 2015 at 7:14 PM, Daniel Grotti <<a href="mailto:dgrotti@sipwise.com" target="_blank">dgrotti@sipwise.com</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<p class="MsoNormal">Please grep the incident number in panel.log and panel-debig.log.<br>
<span style="color:#888888"><br>
Daniel</span><u></u><u></u></p>
<div>
<div>
<p class="MsoNormal">On 17 Mar 2015 18:04, Tabi Tabe Tabi <<a href="mailto:tabi.tabe@gmail.com" target="_blank">tabi.tabe@gmail.com</a>> wrote:<br>
><br>
> Hi,<br>
> I am running SPCE 3.7.1. I get 500 Internal server error when login to the admin web portal. After logging out and try to login again, still get the same error below. Any ideas on the cause and how to fix it? <br>
><br>
><br>
><br>
> 500 Internal server error<br>
><br>
> We are terribly sorry, an exceptional error has occured:<br>
><br>
> incident number: 13CC57719176611F<br>
> time of incident: 2015-03-17T16:55:27.252979999Z<br>
><br>
><br>
> If the login is successful, I get and NGINX bad gateway or timeout error.<br>
><br>
> The server is a VM and has 6GB or RAM, 4 Core processor and 80GB disk space. the resources are hardly being used up.<br>
><br>
><br>
> --<br>
> ...Tabi<br>
><u></u><u></u></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<p class="MsoNormal">--
<u></u><u></u></p>
<div>
<p class="MsoNormal">...Tabi<u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">-- <u></u><u></u></p>
<div>
<p class="MsoNormal">...Tabi<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</div>
</div></div></div>
</div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature">...Tabi<div><br></div></div>
</div>