The process in which a cell becomes capable of differentiating autonomously into a vascular smooth muscle cell regardless of its environment; upon determination, the cell fate cannot be reversed. A vascular smooth muscle cell is a non-striated, elongated, spindle-shaped cell found lining the blood vessels.