In 1852, one of these whalers, Thomas Bowlby, Bolby, or Bowling, took Joe and his partner Taqulittuq, known as "Hannah," and another young Inuk with him to the English whaling port of Hull.
In 1860, Ipirvik and Taqulittuq met Charles Francis Hall, and worked closely with him as he sought to trace Inuit oral traditions about the 16th-century expedition of Martin Frobisher.
Having located the original site of Frobisher's attempted settlement, Hall returned to the United States in 1862, bringing Ipirvik, Taqulittuq and their infant son Tukerliktu along with him.
He and Taqulittuq accompanied Hall on his final voyage, the Polaris expedition, in search of the North Pole.
After Hall's death, he was among the party left behind, when the ship broke loose of the ice and failed to return.