Prime lenses?

This is a total beginners type of questions: Can someone explain to me about the point of prime lenses?  Especially in the setting of telephoto or macro uses.

I assume that when using telephoto or macro lenses the photographer would want to get as close to the subject as possible. So why would a fixed focal length be useful in these situations? Hence, why do they make prime telephoto/macro lenses?