I'm going to vote for Rayleigh. I believe the Pirate King's second in command was more powerful than Xebec's second or third in command.

Shiki was stated to be equal to Roger and 2v1'd Prime Garp & Sengoku. Definitely him.