How to move navy base

can someone tell me how can i move my navy base to a different position

You can't move them unfortunately.

Mine keeps jumping from one place to another.

They all do that. Must be the rough seas pushing them around

How do you defend them?

They cannot be attacked so there is no need to.