I was not able to drag the start point to the right, it only made the stopwatch clip shorter at the end.
I had to pickup the whole clip and move it to the right. After that I could drag the staring position to the position I wanted.
This behaviour was a bit odd.