Body movement is a key element of the golf swing and the position of the spine at set up dictates how the body will move throughout the swing
If your divot is pointing straight and your ball is going right or left then your shots are off target because your clubface is opened or closed at impact
Establish a routine and look at the target when taking your practice swings