[Spce-user] Cdr-exporter is not writting CDRs to files

Fri Sep 12 15:58:51 EDT 2014

Hi everybody, 

First of all, this is a followup on my previous post: [Spce-user] Rate-o-mat can't rate CDRs after terminating subscriber on SPCE mr3.2.1 

I have 4000k CDRs to rate and export. To speed things up, last night I tried to modify the 5000 limit set in the query cdr-exporter script uses to obtain its results: 

Before: 

my $limit = 5000; 

After: 

my $limit = 10000; 

Apparently it worked ok (notice the size and length of the last two files): 

-rw-r--r-- 1 cdrexport cdrexport 2502925 Sep 12 00:25 sipwise_007_20140912002501_0000007321.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2503036 Sep 12 00:25 sipwise_007_20140912002501_0000007322.cdr 
-rw-r--r-- 1 cdrexport cdrexport 1414621 Sep 12 00:25 sipwise_007_20140912002501_0000007323.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2502650 Sep 12 00:55 sipwise_007_20140912005501_0000007324.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2503513 Sep 12 00:55 sipwise_007_20140912005501_0000007325.cdr 
-rw-r--r-- 1 cdrexport cdrexport 1651536 Sep 12 00:55 sipwise_007_20140912005501_0000007326.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2504604 Sep 12 01:25 sipwise_007_20140912012501_0000007327.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2505834 Sep 12 01:25 sipwise_007_20140912012501_0000007328.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2333383 Sep 12 01:25 sipwise_007_20140912012501_0000007329.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2505978 Sep 12 01:55 sipwise_007_20140912015501_0000007330.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2504757 Sep 12 01:55 sipwise_007_20140912015501_0000007331.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2400073 Sep 12 01:55 sipwise_007_20140912015501_0000007332.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2505388 Sep 12 02:25 sipwise_007_20140912022501_0000007333.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2504018 Sep 12 02:25 sipwise_007_20140912022501_0000007334.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2361539 Sep 12 02:25 sipwise_007_20140912022501_0000007335.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2504660 Sep 12 02:55 sipwise_007_20140912025501_0000007336.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2503450 Sep 12 02:55 sipwise_007_20140912025501_0000007337.cdr 
-rw-r--r-- 1 cdrexport cdrexport 2380460 Sep 12 02:55 sipwise_007_20140912025501_0000007338.cdr 
-rw-r--r-- 1 cdrexport cdrexport 5006355 Sep 12 03:25 sipwise_007_20140912032501_0000007339.cdr 
-rw-r--r-- 1 cdrexport cdrexport 1853260 Sep 12 03:25 sipwise_007_20140912032501_0000007340.cdr 

5002 sipwise_007_20140912002501_0000007321.cdr 
5002 sipwise_007_20140912002501_0000007322.cdr 
2828 sipwise_007_20140912002501_0000007323.cdr 
5002 sipwise_007_20140912005501_0000007324.cdr 
5002 sipwise_007_20140912005501_0000007325.cdr 
3298 sipwise_007_20140912005501_0000007326.cdr 
5002 sipwise_007_20140912012501_0000007327.cdr 
5002 sipwise_007_20140912012501_0000007328.cdr 
4658 sipwise_007_20140912012501_0000007329.cdr 
5002 sipwise_007_20140912015501_0000007330.cdr 
5002 sipwise_007_20140912015501_0000007331.cdr 
4797 sipwise_007_20140912015501_0000007332.cdr 
5002 sipwise_007_20140912022501_0000007333.cdr 
5002 sipwise_007_20140912022501_0000007334.cdr 
4720 sipwise_007_20140912022501_0000007335.cdr 
5002 sipwise_007_20140912025501_0000007336.cdr 
5002 sipwise_007_20140912025501_0000007337.cdr 
4757 sipwise_007_20140912025501_0000007338.cdr 
10002 sipwise_007_20140912032501_0000007339.cdr 
3702 sipwise_007_20140912032501_0000007340.cdr 

After that one run, I set it back to 5000 and since then, every file is empty: (notice the size): 

-rw-r--r-- 1 cdrexport cdrexport 42 Sep 12 03:55 sipwise_007_20140912035501_0000007341.cdr 
-rw-r--r-- 1 cdrexport cdrexport 42 Sep 12 04:25 sipwise_007_20140912042502_0000007342.cdr 
-rw-r--r-- 1 cdrexport cdrexport 42 Sep 12 04:55 sipwise_007_20140912045501_0000007343.cdr 
-rw-r--r-- 1 cdrexport cdrexport 42 Sep 12 05:25 sipwise_007_20140912052501_0000007344.cdr 
-rw-r--r-- 1 cdrexport cdrexport 42 Sep 12 05:55 sipwise_007_20140912055501_0000007345.cdr 

2 sipwise_007_20140912035501_0000007341.cdr 
2 sipwise_007_20140912042502_0000007342.cdr 
2 sipwise_007_20140912045501_0000007343.cdr 
2 sipwise_007_20140912052501_0000007344.cdr 
2 sipwise_007_20140912055501_0000007345.cdr 

I don't know how but I've messed things up :( 

I can't get cdr-exporter to actually export any CDRs, it always writes 0 lines: 

# cdr-exporter 
+++ Start run with DB exporter at accounting to sipwise 
--- Starting CDR export 
### 0 data lines written to /home/jail/home/cdrexport/system/201409/12/sipwise_007_20140912211517_0000007382.cdr.24010, checksum is 9b8bd11538a55b017aab6b2ce9d7374f 
### successfully moved /home/jail/home/cdrexport/system/201409/12/sipwise_007_20140912211517_0000007382.cdr.24010 to /home/jail/home/cdrexport/system/201409/12/sipwise_007_20140912211517_0000007382.cdr 
::: Updated DB marks, all done. 

Database: 

mysql> select count(*) from accounting.cdr where export_status = "unexported"; 
+----------+ 
| count(*) | 
+----------+ 
| 4333587 | 
+----------+ 
1 row in set (1.22 sec) 

mysql> 

mysql> select count(*) from accounting.cdr where rating_status = "ok" and export_status = "unexported" ; 
+----------+ 
| count(*) | 
+----------+ 
| 1222721 | 
+----------+ 
1 row in set (2.53 sec) 

mysql> 

mysql> select max(id) from cdr; 
+---------+ 
| max(id) | 
+---------+ 
| 8939578 | 
+---------+ 
1 row in set (0.00 sec) 

mysql> 

My last correctly exported CDR id is: 5560563 

Since that one last correct execution (where I modified the limit from 5000 to 10000), every single CDR file is empty. 

I am again lost, I've tried to understand how cdr-exporter works but I don't know perl. 

The test I thought I could start with is try run the query that cdr-exporter runs, but I don't know from where It gets the cdr.id it filters with: 

[...] 

LEFT JOIN billing.billing_zones_history destination_customer_bbz ON cdr.destination_customer_billing_zone_id = destination_customer_bbz.id 
LEFT JOIN billing.voip_subscribers source_bvs ON cdr.source_user_id = source_bvs.uuid 
LEFT JOIN billing.voip_subscribers destination_bvs ON cdr.destination_user_id = destination_bvs.uuid 
where cdr.export_status = 'unexported' AND cdr.id > ? 
". ($EXPORT_INCOMING eq 'yes' ? '' : "and source_user_id != '0'") ." 
". ($EXPORT_FAILED eq 'yes' ? '' : "and call_status = 'ok'") ." 
order by 
cdr.id 

[...] 

How can I start troubleshooting this? 

Thanks in advanced. 

Best regards, 

Joel. 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.sipwise.com/mailman/private/spce-user_lists.sipwise.com/attachments/20140912/5fe0865e/attachment.html>