When it comes to controlling the volume of apps separately, you need to right-click on the volume icon on the taskbar, then choose Open volume mixer (you can get to this from System > Sound in ...

I'm home on my XP machine now- go to Control Panel, Sound and Audio Device Properties and on the first tab you see- Volume, there's a check box for Place Volume Icon in Taskbar.