When you select the reference box in the image window, the timeline automatically goes to the frame where you set the reference. For example, if you move to frame 1 and select the reference box, if the reference is set in frame 10, frame 10 appears automatically in the image window.
To move the reference, you can: