You have opened file on usb-hdd (swap partition/file, stupid-ftpd, samba, etc)
Remove this and try umount. If you have 2 ext3/fat32 partition, umount /tmp/harddisk/part1 before use umount /tmp/harddisk
check: $ mount - this create list mounted vols
George