Start with disabeling some services via the webinterface.

You just could kill a few services.

e.g. waveserver, mysql, smbd, nmbd, rcamdmain, php

and then watch for a while if things improve. If it does you know that you are short of memory.