A rare 3.8-magnitude earthquake happened in the Atlantic Ocean 9.7 miles from Portsmouth at 10:22 a.m., according to the U.S.