Do I need to switch off the VBox if I am not watching it?

No, you do not need to switch off the box when you are not watching. Make sure you do not leave the video playing as it will consume your bandwidth.