Printable View
I donīt need graph generated by rrdtool, i need only a simple webpage whit this:
................Today.......This week.......This month
wlan...........64MB...........564MB............2354MB
pc1............47MB...........345MB............1005MB
pc2............09MB...........123MB............0547MB
pc3............08MB...........096MB............0802MB
Modify the package on your own ?
Seems no one else is interrested in this at the moment.
For my own, i would like to see something like text stats inbuild to the web interface, but at the moment, no interrest to do it ;).
Greets
Hi,
I had some problems with rrdtool and updated uClibc. So what i am done.
1. Prepared my harddrive for extended packages.
2. Update ipkg as said on http://www.nslu2-linux.org/wiki/FAQ/Optware-uClibcBuild
3. Using tutorial on http://wl500g.info/showpost.php?p=18494&postcount=1 install rrdtool
All step done without errors. But when rrtool.sh script try create rrd data file it`s freezed down. I figure out that rrdtool.sh stopped on `rrdtool create "${1}" etc.`.
Anyone can help me with it or recommend some alternative programms for statistics collection?
rrdtool is the only one giving me a trouble. I am looking for a ways to resolve this issue, but it looks like that isnan() function is constantly called in a loop.
I supose there is a bug in rrdtools or some building info or maybe uclibc problem.
I have native compiled libpng, libart_lgpl, freetype, zlib and rrdtool but produced the same resulting lock up.
Strangely
rrdtool create load.rrd DS:sysload:GAUGE:600:U:U RRA:AVERAGE:0.5:1:48
works, while
rrdtool create loadavg.rrd --step 60 DS:load1:GAUGE:120:0:U \
DS:load5:GAUGE:120:0:U DS:load15:GAUGE:120:0:U RRA:AVERAGE:0.5:1:2160
locks up
oleo, thanks for reply.
But when call rrdtool with different params, it create a file.
For example.
rrdtool create temperature.rrd --step 300 \
DS:temp:GAUGE:600:-273:5000 \
RRA:AVERAGE:0.5:1:1200 \
RRA:MIN:0.5:12:2400 \
RRA:MAX:0.5:12:2400 \
RRA:AVERAGE:0.5:12:2400
Do you know some similar packages for collect statistic data?
Could you possibly find isolated example that fails. Currently I am creating debug version of rrdtools natively to be debuged on router. And I need minimal example.
What do you mean by isolated example?
Work
rrdtool create test.rrd \
DS:in:DERIVE:600:U:U \
RRA:AVERAGE:0.5:1:600
not work
rrdtool create test1.rrd \
DS:in:DERIVE:600:0:125000000 \
RRA:AVERAGE:0.5:1:600
May be some problems in min max value?
ps
it doesnt like MIN = 0
Both commands work for me (WL-500gx, OpenWrt Kamikaze, rrdtool 1.0.50-1).
If prefer rrdtool 1.0 over 1.2 because it's a lot faster generating graphs (2-3secs vs. 30secs) with cgi. I can do without the antialiasing features of rrdtool 1.2.
Is it possible that OpenWrt binaries do work on Olegs firmware?
It will depend on the runtime libaries used, I think...
Oleo:
...does work too.Quote:
rrdtool create loadavg.rrd --step 60 DS:load1:GAUGE:120:0:U \
DS:load5:GAUGE:120:0:U DS:load15:GAUGE:120:0:U RRA:AVERAGE:0.5:1:2160
my /usr/bin/rrdtool binary links with /lib/ld-uClibc.so.0 which is a symlink to /lib/ld-uClibc-0.9.28.so
It looks like this is not uClibc problem.
I've compiled 1.0.50 and it works :) while 1.2.15 does not.
Shall we downgrade (easy) or find a bug in 1.2.15 (hard)?
Everything in the nature takes easy way. :)
And as said MMCM rrdtool 1.0.50 is much faster in use.
Yes, downgrade to stable version. Newer does not always means better...
I like doing things hard way and started more research on the hang issue of the following one liner with rrdtool-1.2.5:Quote:
Originally Posted by Oleg
Here are results:Code:rrdtool create test1.rrd DS:in:DERIVE:600:0:125000000 RRA:AVERAGE:0.5:1:600
- nslu2 feed/nslu2 firmware - works
- oleg feed/oleg firmware - fail
- ddwrt feed/oleg firmware - fail
- ddwrt feed/Xwrt firmware - works
- oleg feed/Xwrt firmware - works
I was doing more research as I've hit to similar problem when upgraded gnuplot from 4.0.0 to 4.2rc2. On oleg firmware gnuplot hang on some plots,
while exactly the same gnuplot worked on OpenWRT (Xwrt).
ipkg-0.99.163 is more restrictive on packages that came from different package feeds! Removing gnuplot record from /opt/lib/ipkg/lists/optware is necessary!
Same results were obtained also for gnuplot 4.2rc2 hang problem. Downgrading to 4.0.0 on oleg firmware withCode:root@OpenWrt:/opt/tmp$ wget http://ipkg.nslu2-linux.org/feeds/optware/oleg/cross/stable/gnuplot_4.2.rc2-1_mipsel.ipk
Connecting to ipkg.nslu2-linux.org[140.211.166.82]:80
gnuplot_4.2.rc2-1_mi 100% |*****************************| 890 KB 00:00:00 ETA
root@OpenWrt:/opt/tmp$ /opt/bin/ipkg install gnuplot_4.2.rc2-1_mipsel.ipk
Installing gnuplot (4.2.rc2-1) to opt...
Nothing to be done
Successfully terminated.
Collected errors:
Package gnuplot md5sum mismatch. Either the ipkg or the package index are corrupt. Try 'ipkg update'.
root@OpenWrt:/opt/tmp$ vi /opt/lib/ipkg/lists/optware
root@OpenWrt:/opt/tmp$ /opt/bin/ipkg install gnuplot_4.2.rc2-1_mipsel.ipk
Installing gnuplot (4.2.rc2-1) to opt...
Configuring gnuplot
Successfully terminated.
restored normal gnuplot bahaviour.Quote:
wget http://ipkg.nslu2-linux.org/feeds/op...0-1_mipsel.ipk
ipkg install -force-downgrade gnuplot_4.0.0-1_mipsel.ipk
The difference between oleg and ddwrt is just in kernel headers. All packages are built upon exactly the same toolchain and config.
My conclusion is, that the problem is within Oleg firmware and not the packages itself. More precisely; I do not blame linux 2.4.20 kernel sources for this. I thing that the problem is that oleg firmware is built with old 0.9.19 uClibc built with old 3.2.3 toolchain.
Having all this in mind I must repeat the question:
Quote:
Shall we downgrade (easy), or find a bug (hard)?
That' strange: your apps are linked against your uclibc, so my firmware is not involved at all. Btw, have you tried using linux headers from the broadcom toolchain?
Headers were extracted from broadcom toolchain when I was creating buildroot toolchain.
They are located at http://www.wlan-sat.com/boleo/optware/
See http://trac.nslu2-linux.org/optware/...e/buildroot.mk
for details.
On Xwrt you can install either package (oleg|ddwrt) and it works. So the problem must be with firmware itself.
:) Does xwrt use 2.4.20 kernel?
Xwrt is OpenWRT whiterussian and uses 2.4.30 kernelQuote:
root@OpenWrt:/opt/share/torrent/work$ uname -a
Linux OpenWrt 2.4.30 #1 Fri Nov 24 23:16:54 EST 2006 mips unknown
As said before I've compiled natively rrdtool and 1.0.50 work while 1.2.15 hangs.
Now I've prepared cross-compiled version of the rrdtool 1.0.50 and realised that it does not work either. I've tried several options without a success :(
I have also compared both configure logs And I cannot find the difference.
See http://pastebin.ca/288738 or attached diff --side-by-side -d
On the left is cross-compiled config.log | right native compile.
Later I've remembered that I was using gcc-4.1.1 native buildroot toolchain on rrdtool-1.0.50 and cross-compiling was gcc-3.4.6 . See line 325 on my prevous post.
So I've tried also with gcc-4.1.1 cross toolchain and got positive result :) with several rrdtool create ...
rrdtool-1.2.15 does not work native nor cross.
Tried 4.1.1 cross compiling gnuplot-4.2.rc2 which hung on 3.4.6 on some plots. Compiled with 4.1.1 gnuplot works.
It seems that this 4.1.1 is a way to go. I've tried wild compile of the whole Optware repository before and found some old sources fail to build though.
Solved problem with rrdtool 1.2.5 by removing -std=gnu99 compiler option. Users should try to upgrade uclibc-opt package too.
There is also rrdcollect package for collecting system statistics. I need some useful examples.
Hi,Quote:
Originally Posted by oleo
yesterday I switch to "oleg/cross/stable" feed, I've installed the latest rrdtool and uclibc-opt. I have no problem with database creation nor update, the rrdtools hangs on graph creation. But only when the the rr database contains gaps or zero.
I'm monitoring three interfaces: wan, lan and wlan. I don't use the wlan interface, it is disabled. So the database is filled by zeros and the graph was always "blank". Yesterday, after update to "oleg/cross/stable", the rddtool always hangs on creation of wlan graph. So I disabled wlan graph creation. Other two graphs were created without problems.
But then I went sleep and I switch off my computer. So the lan interface was down and cron started to fill the rr database with zero values. And again, it causes hang of lan graph creation. So today morning was the router overloaded because of many "rrdtool graph" commands was still running :(
I had to comment to the lan graph creation and I expected that one small gap or zero in wan database will cause hang of the wlan graph creation.
Command for graph creation:
last lines in strace outputCode:rrdtool graph /opt/share/www/rrd//landay.png.new -a PNG -s -86400 -w 550 -h 240 -v bytes/s DEF:ds1=/opt/var/lib/rrd//vlan0.rrd:in:AVERAGE DEF:ds2=/opt/var/lib/rrd//vlan0.rrd:out:AVERAGE LINE1:ds1#00FF00:Incoming Traffic GPRINT:ds1:MAX:Max %6.2lf %s GPRINT:ds1:MIN:Min %6.2lf %s GPRINT:ds1:AVERAGE:Avg %6.2lf %s GPRINT:ds1:LAST:Curr %6.2lf %s\n LINE1:ds2#0000FF:Outgoing Traffic GPRINT:ds2:MAX:Max %6.2lf %s GPRINT:ds2:MIN:Min %6.2lf %s GPRINT:ds2:AVERAGE:Avg %6.2lf %s GPRINT:ds2:LAST:Curr %6.2lf %s -t LAN COMMENT:\n COMMENT: Vytvoreno\: 19.01.2007 07\:20\:18
Code:[maros@wl-500gp tmp]$ tail -n 30 strace.out
_llseek(3, 18444, [18444], SEEK_SET) = 0
_llseek(3, 18444, [18444], SEEK_SET) = 0
read(3, "\0\3\0\205\377\343\4L\5\360\0\v\0\27\0#\1\n@\32\3\245\t"..., 92) = 92
_llseek(3, 15212, [15212], SEEK_SET) = 0
_llseek(3, 18926, [18926], SEEK_SET) = 0
_llseek(3, 18926, [18926], SEEK_SET) = 0
read(3, "\0\3\0\205\377\343\4L\5\325\0\6\0005@\31\5%\2\3\2\3%\4"..., 66) = 66
_llseek(3, 15212, [15212], SEEK_SET) = 0
_llseek(3, 17792, [17792], SEEK_SET) = 0
_llseek(3, 17792, [17792], SEEK_SET) = 0
read(3, "\274\210\325*\274\210\325*\273\0\0\0H\4/\2{\1\0\0\300\0"..., 190) = 190
_llseek(3, 15212, [15212], SEEK_SET) = 0
_llseek(3, 18444, [18444], SEEK_SET) = 0
_llseek(3, 18444, [18444], SEEK_SET) = 0
read(3, "\200\1\0\0\0\0\0\0\5\325\0\6\0005@\31\5%\2\3\2\3%\4\0\0"..., 92) = 92
_llseek(3, 15212, [15212], SEEK_SET) = 0
_llseek(3, 18926, [18926], SEEK_SET) = 0
_llseek(3, 18926, [18926], SEEK_SET) = 0
read(3, "\200\1\0\0\0\0\0\0\4\'\0\3\0\7\0\33@\r\2\242\0\254\4\242"..., 66) = 66
_llseek(3, 15212, [15212], SEEK_SET) = 0
_llseek(3, 17530, [17530], SEEK_SET) = 0
_llseek(3, 17530, [17530], SEEK_SET) = 0
read(3, "\0\1\0\366\0\0\4F\5\325\0\n\0&@\24\0\0\0\0\0\0\0\0\0\0"..., 86) = 86
_llseek(3, 15212, [15212], SEEK_SET) = 0
_llseek(3, 17530, [17530], SEEK_SET) = 0
_llseek(3, 17530, [17530], SEEK_SET) = 0
read(3, "\0\1\0\366\0\0\4F\5\325\0\n\0&@\24\3\227\4\2\227\5\210"..., 86) = 86
close(3) = 0
************HANG HERE*********************
--- SIGINT (Interrupt) @ 0 (0) ---
+++ killed by SIGINT +++
Bonus :)
Nice graph shows growing load caused by graph creation process hangs.
There are some kernel fpemu bugs in Oleg's 7f. Try 7g-pre1 available
at http://wl500g.dyndns.org/7g
This should solve your problems.
I would also like to have your scripts to for creating graphs as samples to include with
rrdtool. And rrdcollect scripts also.
Thanks, it works now.Quote:
Originally Posted by oleo
The upgrade was a little bit complicated, first firmware flash failed and I spent two hours to fix it and I also lost my post-firewall script :( (Don't forget to backup your setting before flashing :cool: )
Sure. It is based on macsat rrdtool tutorialQuote:
Originally Posted by oleo
I added cpu load and memory usage graphs and archiving.
Script is run each minute from cron. Graphs are in /opt/share/www/rrd/ directory.
There are some architectural problems with this rrdtool.sh although I must admit it is nice to start with single script.
Could you please restructure this script to use rrdcollect instead of using cron for update.
- Running script every minute is not very wise think to do in when low CPU and mem is available
- rrdcollect overcomes most of collect problems and acts as daemon without stressing the system for spawning and opening files for update.
- creating daily graphs for archiving can be done by cron
- for current graphs rrdcgi should be used on demand.
- crontab file should be configurable so user can comment out unwanted graphs
- system dependent thing could be in separate /opt/etc/stats.conf
- database creation should be done by package postinst/prerm scripts
If you are able to provide this I could include this in default rrdcollect package.
OK,
I can try, rrdcollect looks interesting. It will took some time.
Quote:
Originally Posted by maros
i have replaced the rrdtool.sh with the 1 you provided, but is there more wqhat i must done before i see the cpu/mem usage?
Here are my minor changes to PATH in attached rrdtool.sh It runs from cron
with /opt/etc/cron.d/macsat
But as I said I don't like it. It could serve as example, though.Code:#minute hour mday month wday who command
* * * * * admin /opt/bin/rrdtool.sh >>/opt/var/log/macsat.log
Quote:
Originally Posted by oleo
1question the graph for mem/cpu is ok but the index.html only shows the 3 original graph wan/lan/wlan how can i add the other grapg mem/cpu?
Did you put it to crontab?Quote:
Originally Posted by Devil-Strike
(Note: "admin" is default user, must be changed if you are using different user)Code:*/1 * * * * admin nice /opt/bin/rrdtool.sh >> /opt/var/log/rrdtool.log 2>&1
Is there something interesting in log? (/opt/var/log/rrdtool.log)
Or you can try to run the script with command:
I'm working now on new, modular version, using rrdcollect program according to oleo comments. Maybe next week I will have first working version. Actually a module_cpuload is almost done and I need to made some nice cgi script and prepare other modules (memory, netload).Code:sh -x /opt/bin/rrdtool.sh
Just rename/remove the index.html file and it will be recreated.Quote:
Originally Posted by Devil-Strike
Maybe it should be mentioned again that rrdtool needs Oleg pre 7g firmware
http://wl500g.dyndns.org/7g/
I have noticed that PATH should be added for graphs in rrdtool.sh. That's whi I've included the file.
is the rrdlog, but the index.html wont change? graphs are createdCode:rddtool.sh started at Wed Jan 24 10:10:01 MET 2007
LOAD: 0.07
MEM -> USED: 11440128, CACHE: 16453632, FREE: 2936832
SWAP -> USED: 0, FREE: 345452544
Updating Network Load Databases...
WAN -> in: 3177309 out: 2832967
LAN -> in: 2743646 out: 4249893
WLAN -> in: 0 out: 419446
Network Daily Graphs creating.....
647x347
647x347
647x347
rddtool.sh finished at Wed Jan 24 10:10:51 MET 2007
<------------------------------------------------------------->
rddtool.sh started at Wed Jan 24 10:15:01 MET 2007
LOAD: 0.01
MEM -> USED: 11538432, CACHE: 16097280, FREE: 3194880
SWAP -> USED: 0, FREE: 345452544
Updating Network Load Databases...
WAN -> in: 3768712 out: 3398853
LAN -> in: 3272460 out: 4916136
WLAN -> in: 0 out: 493737
rddtool.sh finished at Wed Jan 24 10:15:04 MET 2007
<------------------------------------------------------------->
rddtool.sh started at Wed Jan 24 10:20:01 MET 2007
LOAD: 0.04
MEM -> USED: 11702272, CACHE: 16162816, FREE: 2965504
SWAP -> USED: 0, FREE: 345452544
Updating Network Load Databases...
WAN -> in: 4219600 out: 3968475
LAN -> in: 3835605 out: 5879429
WLAN -> in: 0 out: 568013
Network Daily Graphs creating.....
647x347
647x347
647x347
rddtool.sh finished at Wed Jan 24 10:20:51 MET 2007
<------------------------------------------------------------->
Edit// using the latest firmware from 7g
Edit2// deleted the html files and now it works, now waiting to see some graphs on the 2.
It should run every minute and not 5!
But as you see It tooks almost a minute to finish the script. This is bad. Cron ensures cardinality btu again the scripts could stackup on high load. So If you are not doing anithing on the router, the it works. Otherwise you could run in trouble if you run it every minute.
So i need to change it to 1min?Quote:
Originally Posted by oleo
btw whene it create the graph it wont slow down the router jet, whene i download @ fullspeed (20Mbit) i dont see any hickups.
Btw, must i use the latest rrdtool.sh from attached file?
Edit// i have also put this in cronjob */1 * * * * admin nice /opt/bin/rrdtool.sh >> /opt/var/log/rrdtool.log 2>&1
Edit2//ok i have waited about 2 hours but nu sing of life from the load/ram usage.
hmm ok, 4hours further and now my mem/load graphs are gone, it have worked 1 time after that only the lan/wan/wlan works.
the rrdlog say it works i think, but no graphs for load/mem.Code:rddtool.sh started at Wed Jan 24 15:50:01 MET 2007
LOAD: 0.06
MEM -> USED: 11976704, CACHE: 15892480, FREE: 2961408
SWAP -> USED: 0, FREE: 345452544
Updating Network Load Databases...
WAN -> in: 390863100 out: 192171190
LAN -> in: 188455985 out: 397968740
WLAN -> in: 0 out: 0
Network Daily Graphs creating.....
647x347
647x347
647x347
rddtool.sh finished at Wed Jan 24 15:50:58 MET 2007
Gone?Quote:
Originally Posted by Devil-Strike
Graphs are always replaced, not deleted. Note: Load and Mem graphs are generated each 7th and network graphs each 10th minute.
Could you post here a listing of /opt/share/www/rrd directory?
Code:ls -la /opt/share/www/rrd
Quote:
Originally Posted by maros
here the list.Code:drwxr-xr-x 3 root root 1024 Jan 24 18:30 .
drwxr-xr-x 4 root root 1024 Jan 23 15:20 ..
drwxr-xr-x 2 root root 1024 Jan 24 09:43 archive
-rw-r--r-- 1 root root 515 Jan 24 15:38 index.html
-rw-rw-rw- 1 root root 43874 Jan 24 18:20 landay.png
-rw-r--r-- 1 root root 27442 Jan 24 04:15 lanmonth.png
-rw-rw-rw- 1 root root 34629 Jan 24 18:01 lanweek.png
-rw-r--r-- 1 root root 23745 Jan 24 04:15 lanyear.png
-rw-rw-rw- 1 root root 26546 Jan 24 18:01 loadweek.png
-rw-rw-rw- 1 root root 34195 Jan 24 18:01 memweek.png
-rw-r--r-- 1 root root 527 Jan 24 15:38 month.html
-rw-rw-rw- 1 root root 46098 Jan 24 18:20 wanday.png
-rw-r--r-- 1 root root 0 Jan 24 18:30 wanday.png.new
-rw-r--r-- 1 root root 30124 Jan 24 04:15 wanmonth.png
-rw-rw-rw- 1 root root 34737 Jan 24 18:01 wanweek.png
-rw-r--r-- 1 root root 24093 Jan 24 04:15 wanyear.png
-rw-r--r-- 1 root root 521 Jan 24 15:38 week.html
-rw-rw-rw- 1 root root 38340 Jan 24 18:20 wlanday.png
-rw-r--r-- 1 root root 26410 Jan 24 04:15 wlanmonth.png
-rw-rw-rw- 1 root root 32385 Jan 24 18:01 wlanweek.png
-rw-r--r-- 1 root root 24062 Jan 24 04:15 wlanyear.png
-rw-r--r-- 1 root root 521 Jan 24 15:38 year.html
Interesting, the week graphs was created, but no day graphs. :confused:Quote:
Originally Posted by Devil-Strike
Could you check the log if there is any error at 17:57, 18:07, 18:17?
Quote:
Originally Posted by maros
Here is the rrdlog.Code:rddtool.sh started at Wed Jan 24 17:55:01 MET 2007
LOAD: 0.01
MEM -> USED: 11284480, CACHE: 15781888, FREE: 3764224
SWAP -> USED: 0, FREE: 345452544
Updating Network Load Databases...
WAN -> in: 11886919 out: 12441979
LAN -> in: 12365186 out: 15980145
WLAN -> in: 0 out: 0
rddtool.sh finished at Wed Jan 24 17:55:03 MET 2007
<------------------------------------------------------------->
rddtool.sh started at Wed Jan 24 18:00:01 MET 2007
LOAD: 0.00
MEM -> USED: 11284480, CACHE: 15790080, FREE: 3756032
SWAP -> USED: 0, FREE: 345452544
Updating Network Load Databases...
WAN -> in: 11998591 out: 12525933
LAN -> in: 12442683 out: 16127140
WLAN -> in: 0 out: 0
Network Daily Graphs creating.....
647x347
647x347
647x347
Weekly Graphs creating.....
647x347
647x347
647x347
647x333
647x389
rddtool.sh finished at Wed Jan 24 18:01:34 MET 2007
<------------------------------------------------------------->
rddtool.sh started at Wed Jan 24 18:05:01 MET 2007
LOAD: 0.02
MEM -> USED: 11284480, CACHE: 16125952, FREE: 3420160
SWAP -> USED: 0, FREE: 345452544
Updating Network Load Databases...
WAN -> in: 12081450 out: 12595282
LAN -> in: 12505927 out: 16260868
WLAN -> in: 0 out: 0
rddtool.sh finished at Wed Jan 24 18:05:03 MET 2007
<------------------------------------------------------------->
rddtool.sh started at Wed Jan 24 18:10:01 MET 2007
LOAD: 0.00
MEM -> USED: 11284480, CACHE: 16138240, FREE: 3407872
SWAP -> USED: 0, FREE: 345452544
Updating Network Load Databases...
WAN -> in: 12182532 out: 12657952
LAN -> in: 12564836 out: 16389288
WLAN -> in: 0 out: 0
Network Daily Graphs creating.....
647x347
647x347
647x347
rddtool.sh finished at Wed Jan 24 18:10:54 MET 2007
<------------------------------------------------------------->
rddtool.sh started at Wed Jan 24 18:15:02 MET 2007
LOAD: 0.01
MEM -> USED: 11284480, CACHE: 16187392, FREE: 3358720
SWAP -> USED: 0, FREE: 345452544
Updating Network Load Databases...
WAN -> in: 12267447 out: 12706014
LAN -> in: 12608775 out: 16503539
WLAN -> in: 0 out: 0
rddtool.sh finished at Wed Jan 24 18:15:04 MET 2007
<------------------------------------------------------------->
rddtool.sh started at Wed Jan 24 18:20:01 MET 2007
LOAD: 0.00
MEM -> USED: 11284480, CACHE: 16199680, FREE: 3346432
SWAP -> USED: 0, FREE: 345452544
Updating Network Load Databases...
WAN -> in: 12348664 out: 12740828
LAN -> in: 12641019 out: 16607806
WLAN -> in: 0 out: 0
Network Daily Graphs creating.....
647x347
647x347
647x347
rddtool.sh finished at Wed Jan 24 18:20:55 MET 2007
<------------------------------------------------------------->