Webtools - Configure installed Unslung and other packages

I've been kinda quiet on this forum for a few weeks now. This had a reason, I was working on a project called: WebTools. I think this tool can be useful for everyone who's using (or planning to use) the Unslung ipkg packages.

If you're getting interested -> read on! For Linksys NSLU2 users: WebTools is also being developed for your device. In fact WebTools is developed for all embedded devices!

Introduction
With the Unslung packages available for the Linksys NSLU2 and Asus WL-500g, the owner of one of these has the opportunity to expand the functionality to the fullest.

While the original firmwares offer a webinterface to configure all the functionality of the device, when a user wants to install or configure an Unslung package he or she needs quite some experience with Linux commands to perform all the actions needed to install and configure the extra packages.

This is where WebTools steps in. It allows the user to easilly install and manage installed packages through a uniform webinterface.

Goal
The goal of WebTools is mainly to become a website for configuring installed and installing Unslung ipkg packages. In the long run WebTools might also be used as the default websetup in custom firmwares for devices like the Asus WL-500g and Linksys NSLU2.

The basic idea is to couple Unslung ipkg packages with a plugin for WebTools and require/advise the user to install the WebTools framework. This way, when a user adds an Unslung package to it’s setup, the package will automatically add a plugin to the plugin directory of the WebTool website. The WebTool framework will then automatically recognise the plugin and enable it for the user.

In short: WebTools is essentially a lightweight pluginable framework to which (3rd party) plugins can easily be added.

Still interested? You can find the WebTools project website here: http://webtools.wl500g.info

Discussion:
This topic has been started to get a discussion going about WebTools. This includes:
- Questions
- Remarks
- Bugreports
- Performance
- Feature requests etc.

Please don't edit the WIKI pages on http://webtools.wl500g.info yet.

Warning: There are going to be a lot of changes on the code for WebTools for a while. This also means that I cannot guarantee that 3rd party plugins continue to work in my next releases (Although I'm trying not to break existing code). The main goal of these (developer) releases is to get feedback on the general idea. Perhaps some of you are willing to put some time in creating your own plugins and report how they progress.

Oh, and one more thing: Please don't judge me on the PHP code produced until now. I'm not a professional webdeveloper :o

Version 0.2b is officially out :)

(Also removed all pre-release posts and move the thread to 'Custom development')

GREAT WORK! The WL-500g is slowly but surely becoming one of the most powerful while still economical home routers available (well--its software is being vastly improved, anyway). And now, thanks to users like you, it's becoming user-friendly at the same time--something this router badly needs. Thanks for the hard work.

Well I'm enjoying the enormous amounts of feedback until now, LOL.

Seems like noone is using Unslung packages or has tried WebTools? C'mon folks talk to me; what do you think?

Maybe everybody is waiting for the 0.3 release? I'm interested in your project, but I don't need it right now, as I'm trying some other thinks like booting a PC over NFS on wl-hdd. I'll check with your next release, as I'll have more time for it. But don't worry, if you stop working on it, there will be complains :D

Quote:

---

Originally Posted by hugo

Maybe everybody is waiting for the 0.3 release? I'm interested in your project, but I don't need it right now, as I'm trying some other thinks like booting a PC over NFS on wl-hdd. I'll check with your next release, as I'll have more time for it. But don't worry, if you stop working on it, there will be complains :D

---

Well 0.3 release is a long way and will take quite some time as i'm only able to work on WebTools in the evenings and weekends. But if you (or anyone) want to support this project, just try it out and tell me what you think.

Edit: BTW, what interests you so much about 0.3 that you'll wait for that (I might change the order of implementation if required)?

Actually, this is the support for nvram variable, otherwise the package is not really different that for example a webmin interface that I did already setup on my debian chroot until it is adapted to wl modules.
I'm going to try it right now anyway, to tell you what I think.

This is a nice set of tools, and I really look forward some dedicated modules like the vsftpd one.

One think though is the fact the file is in zip form. I don't know if I'm missing something, but I cannot keep the user rights unziping it. Maybe it was supposed to a in tar format?

Quote:

---

Originally Posted by hugo

Actually, this is the support for nvram variable, otherwise the package is not really different that for example a webmin interface that I did already setup on my debian chroot until it is adapted to wl modules.
I'm going to try it right now anyway, to tell you what I think.

---

Ok, but I can't imagine webmin installed on the WL-500g... Perhaps if you run it from an usb device, but webmin is probably so heavy it won't run well on the router. Thats where webmin steps in, it may aim at similar functionality as webmin but is much lighter at the same time...

Have you tried running Webmin on the WL-500g? If yes, does it work well (I'm curious :) )?

Quote:

---

Originally Posted by hugo

This is a nice set of tools, and I really look forward some dedicated modules like the vsftpd one.

One think though is the fact the file is in zip form. I don't know if I'm missing something, but I cannot keep the user rights unziping it. Maybe it was supposed to a in tar format?

---

Yes, the zip file format was Jean-Fabrice' concern as well. I shall change it to tar.gz tonight. The zip file orignates from the fact that I develop WebTools on a Windows machine....

I'm also trying to get WebTools into Unslung package list tonigh, so you can just 'ipkg install webtools', but I doubt if this will succeed in one evening...

Hum this is maybe where my Wl-HDD choice brighten: Actually I can run webmin and many other think not at light speed, but fast enough to use it normally. Of course, a dedicated and lighter administration pack is welcome. But you would be surprised by the number of programs that can run out of a Wl-HDD with debian install (I even run X with a VNC server :rolleyes: )

Quote:

---

Originally Posted by hugo

Hum this is maybe where my Wl-HDD choice brighten: Actually I can run webmin and many other think not at light speed, but fast enough to use it normally. Of course, a dedicated and lighter administration pack is welcome. But you would be surprised by the number of programs that can run out of a Wl-HDD with debian install (I even run X with a VNC server :rolleyes: )

---

Hmm, that ain't 'good' news for WebTools... :o Do you have any idea how easy it is to create new content for Webmin?

About the tar files: I converted all the files in WebTools-0.2b to Unix and created tar.gz files for download. :)

I like the idea to be able to see if something is possible, then to use a specific tailored package for the device. You webtool falls in this category to replace webmin.

I just tested WebTools on my WL-500g (I had some problems with my HDD, thats why I didn't have the chance to test it earlier) and immediately ran into some bugs. :p But I've fixed them and now I have a Linux question:

The thttpdphp daemon is running with the nobody account. So WebTools is not allowed to write to a config file in /opt/etc because it doesn't have admin rights. I think there are 3 options here:
- Change to admin temporary while editing the config file
- Run the webserver using the admin account (security risk)
- Change the permissions of the config files in /opt/etc.

Which one should be the best solution for this problem?

Edit: And the answer is: Run the webserver with the admin account. :)

Just for your information...

The reason I don't use the web interface much on the router itself is because of the insecurity of it. The password, an extremely important item, is transferred unencrypted. That's... not good at all.

But this is a different topic--I know. Here's the interesting bit: Webtools seems like a tool for newbies to me (which is a good thing, of course!). However, the installation procedure may not be extremely user-friendly (even if it was, there's still the complex bit of setting up a flash device for some users!). This forum has very little information about installation procedure that must not be adapted in some way to fit a user's circumstances, and how often does a newbie even know his circumstances or how to manipulate linux commands to do this?

I cannot dismiss the fact that you have a nice installation procedure on the website, Styno. However, it's hard to keep into perspective how much else is going on there that newbies probably don't understand. I think one way to handle this could be to set up a new page on the generic web interface which allows users to do all of this simple stuff (set up their USB device, download and install the latest webtools).

I don't know. This is all stuff I probably would work more on if I knew how to compile the firmware for WL-500g. But I can't even figure out something so simple yet (I have limited experience with linux compilations but slightly more with actual programming; if I can get coLinux working correctly it will probably work).

ANYWAY--I'll repeat that I think Webtools is a definite step in the right direction. In my mind, the ultimate goal is for users to not, at all, have to use a shell--ever. And if that happens, you can bet this forum will pick up.

Thanks for your input Tomilius, I appreciate it.

Quote:

---

Originally Posted by tomilius

The reason I don't use the web interface much on the router itself is because of the insecurity of it. The password, an extremely important item, is transferred unencrypted. That's... not good at all.

---

Knowing that the Asus webinterfase (that's what you're talking about right?) is only reachable from within the LAN or WLAN area's, there's not much to fear from the password being unencrypted?

Quote:

---

Originally Posted by tomilius

But this is a different topic--I know. Here's the interesting bit: Webtools seems like a tool for newbies to me (which is a good thing, of course!). However, the installation procedure may not be extremely user-friendly (even if it was, there's still the complex bit of setting up a flash device for some users!). This forum has very little information about installation procedure that must not be adapted in some way to fit a user's circumstances, and how often does a newbie even know his circumstances or how to manipulate linux commands to do this?

I cannot dismiss the fact that you have a nice installation procedure on the website, Styno. However, it's hard to keep into perspective how much else is going on there that newbies probably don't understand. I think one way to handle this could be to set up a new page on the generic web interface which allows users to do all of this simple stuff (set up their USB device, download and install the latest webtools).

---

You are absolutely right, compiling a complete list of command to be executed until you have working WebTools (Or other Unslung package for that matter) would be an absolute must and the list would be long, very long.

On the other hand: Unslung packages and WebTools are both new to the Asus WL-500g, think back to the days that Oleg brought us Samba: No webinterface, lots of commands to execute to get things running. But now, after a few more firmware releases you can configure it, partly, through the webinterface.

When WebTools is mature enough to actually be used by newbies, I'll think of having a chat with Oleg to see what can be done to integrate WebTools into the firmware. This could greatly reduce the barrier for using WebTools AND Unslung packages. This stage is IMHO some distance away and until then the only thing I can do is make the HOWTO on as complete as possible, so there probably is a need to add info about enabling flash etc.

Quote:

---

Originally Posted by tomilius

ANYWAY--I'll repeat that I think Webtools is a definite step in the right direction. In my mind, the ultimate goal is for users to not, at all, have to use a shell--ever. And if that happens, you can bet this forum will pick up.

---

Well, as the Goal on webtools states, this is something I'm trying to accomplish with it.

Can anyone tell me how much space the Asus webserver and website requires in the firmware?

Code:

---

[root@wl500gx root]$ du /www -s
1356    /www

---

so, 1356k uncompressed.

The thttpdphp package is unavailable to me - even after updating ipkg.

Im getting this respond:

Code:

---

[admin@dhcppc0 bin]$ ipkg install thttpdphp
Cannot find package thttpdphp.
Check the spelling or perhaps run 'ipkg update'
Nothing to be done
An error ocurred, return value: 4.

---

Am i doing something wrong?


EoniX

Check here for thttpdphp:
http://wl500g.info/showthread.php?t=2167 ;)

yeah saw it - have it working here as well.... now all i want to get working is my samba - but have another thread open for my questions about that.

Still cant get it working :(

This topic ain't about thttpdphp, it's about WebTools :rolleyes:

Is there anyone who actually tried WebTools with suggestions, complaints, bugs, ideas around? There are nearly 80 downloads now, so the lack of feedback could mean two things: Either it sucks so badly it's not worth any comments or its perfect allready (both which I honestly do not believe).

So...?

Well, I don't use vsftpd and most-likely never will. I have a bit of advice... Maybe you can classify certain configuration parameters as advanced and then have a button similar to "Show Advanced" so that it won't be overwhelming for new users (there's a lot of options there that I doubt new users would look at). Stuff like presets or wizards would probably be neat.

Other than that, I think it's alright. It's not that it sucks... it's just that there's not all that much there to practically test yet. I think it's kind of tricky and not automated enough yet, but other than that nice work.

Now, using the vsftpd plugin as an example, it's OK in that it's a fairly easier to understand representation but truth be told you might as well just serve out the configuration file with some comments within and then put a "submit" button at the bottom and the effect would be fairly similar--but I realize that's only because it was a quick test and still has newbie-confusing variable names and such.

Pretty good, but again, I probably wouldn't use it--at least not yet. Nice work.

Wow, this is the kind of feedback i was hoping for. Thanks!

Quote:

---

Originally Posted by tomilius

Maybe you can classify certain configuration parameters as advanced and then have a button similar to "Show Advanced" so that it won't be overwhelming for new users (there's a lot of options there that I doubt new users would look at).

---

That's a good idea and it seems to me that this could be easilly incorporated.

Quote:

---

Originally Posted by tomilius

Stuff like presets or wizards would probably be neat.

---

Presets are allready working. When you run the plugin for the first time it will configure the settings to default.

Wizards seem like a neat feature. I'm going to have a look at that, but it seems it could be a lot of work.

Quote:

---

Originally Posted by tomilius

it's just that there's not all that much there to practically test yet. I think it's kind of tricky and not automated enough yet, but other than that nice work.

---

Well, it seemed better to me that I would start with only one plugin. This is because it would cost me too much time to maintain a bunch of plugins while lots of code is still changing every release.

Quote:

---

Originally Posted by tomilius

Now, using the vsftpd plugin as an example, it's OK in that it's a fairly easier to understand representation but truth be told you might as well just serve out the configuration file with some comments within and then put a "submit" button at the bottom and the effect would be fairly similar

---

Well, that's indeed practically what WebTools is doing :o

Quote:

---

Originally Posted by tomilius

but I realize that's only because it was a quick test and still has newbie-confusing variable names and such.

---

Yes, I've got some more comments on the confusing variable names thing. I suggest it would be a nice option to be able to show a short description instead of the variable name. Like "allow_anon_ssl" might become: "Allow secure annonymous connections" and then show the variable name using a tooltip.

Conclusion: There's a lot to be done on the presentation and to lower the accessability to newbies.