I had to spend a couple of days leveling up for this one.
I suggest you mainly just level up your cutlass. Or any other weapon you choose.
And when you get to the hollows, take out your pistol and stand at shooting distance. Or you can use some throwing daggers. Knock off the weak ones, and shoot the brigands to get their attention. Then switch over to the cutlass and work your way through. Obviously, if you have some others with you it'll be easier.
But that's just a suggestion.
