Mexico is a very popular destination for cave diving. A majority of divers focalize on mainland in the Yucatan Peninsula but Cozumel has also a lot of pristine and beautiful spots to visit. The caves were dry a long time ago which explains the numerous speleothems that one can encounter. 
The Bahamas are famous for the beautiful beaches but the underground offers cave diving locations among the best if not the best in the world.