The northernmost island, Grand Bahama Island (Freeport/Lucaya/West End) is approx 48-miles east of West Palm Beach, Florida... and, yes; all 700+ islands/cays are located within the Atlantic Ocean...
JB