Alternate entrance method which is way more easy is the
corner glitch next to the jewelry shop on the other side of
the island then just swim around to the back of the Fort
Charles Door and then do whatever you want from there.
You can get anywhere from that glitch around the outside of
Port Royal. No one is mad when you share, they just get
mad when don't.