Follow Mode Losing track at slow speeds

For ‘Heading Mode: Course’ to work, the subject must be moving with a speed of at least 1 m/s.

In your case you should set ‘Heading Mode: North’

You can find all information here:

And some explanotary here: