Before the last patch, I walked the streets and did some exploring - not a sole was there, no buildings could be entered - a Town, a Market, a Castle/Fort with not a single guard. I never found it, but on another visit when I was under the town (in Davy Jones locker looking up), I did see a Cave as well with a back entrance to a second dock - Cave looked to be under the Castle/Fort.
