is a reference point ever needed to calculate speed
Yes. Speed does not exist without first having a reference point
A reference point is ALWAYS needed when a speed is described.