Joshua Boyle - who arrived at Toronto's Pearson International Airport with his wife Caitlan Coleman and their children - told reporters inside the Air Canada terminal that the Haqqani network killed a fourth child born in captivity, an infant daughter, and raped his wife, claims denied by the Taliban.
"It will be of incredible importance to my family that we are able to build a secure sanctuary for our three surviving children to call a home, to focus on edification and to try to regain some portion of the childhood that they have lost", he said.
In the summer of 2012, the couple embarked on a journey that took them to Russian Federation and the central Asian countries of Kazakhstan, Tajikistan and Kyrgyzstan and, ultimately, Afghanistan.
Pakistani Foreign Ministry spokesman Nafees Zakaria said the Pakistani special forces that rescued the family on October 11 acted on a tip from USA intelligence, showing that Islamabad will act against a "common enemy" when Washington shares information.
The operation came after years of US pressure on Pakistan for assistance.
Ms Coleman was pregnant at the time and had four children in captivity. "Did we not put bullets in those bastards?'" Boyle recalled, appearing beside his wife and children in the video.
He added that one of his children is in poor health and had to be force-fed by their Pakistani rescuers.
In a video released by Pakistan's military that was filmed before he left that country for home, Boyle said Pakistani security forces positioned themselves between the hostages and their Haqqani network captors to keep the family safe amid the gunfire.
The couple was supposed to return to the U.S.so that Coleman, then pregnant, could deliver her baby.
"What I can say is taking your pregnant wife to a very unsafe place is to me and the kind of person I am, is unconscionable", Jim Coleman told ABC News on Wednesday.
USA officials said Pakistan secured the release of Coleman of Stewartstown, Pa.Caitlan Coleman of Stewartstown, Penn., and her Canadian husband Joshua Boyle seen in a video filmed by their captors and released in 2016. "I can not confirm that", state department spokesperson Heather Nauert told reporters when asked to confirm reports that "Pakistani officials say that the family was rescued".
The Pakistani statement said the family had been held in Afghanistan but that "U.S. intelligence agencies has been tracking them" and shared that they had crossed the border on Wednesday.
Meantime, Boyle's parents say they're waiting to find out precisely when their son and his family will be returning to Canada.
Boyle said it was his hope "this litany of stupidity", would be the "epitaph" of the Haqqani network.
"God has given me and my family unparalleled resilience and determination, and to allow that to stagnate, to pursue personal pleasure or comfort while there is still deliberate and organised injustice in the world would be a betrayal of all I believe, and tantamount to sacrilege", he wrote.
Boyle was once married to Zaynab Khadr, the older sister of former Guantanamo Bay detainee Omar Khadr and the daughter of a late senior al-Qaida financier.
The AP reported in June 2014 about the existence of videos received by Coleman's father in which the couple - Coleman, in a conservative black garment and Boyle with a long, untrimmed beard - implored the US government to help free them.
Washington considers the Haqqani group a terrorist organization and has targeted its leaders with drone strikes. Unlike the Islamic State group, it typically does not execute Western hostages, preferring to ransom them for cash.
Another US official said Mr Boyle was nervous about being in "custody" given his family ties.
Put on notice by Trump, who has said the United States will not be "silent" any more about Pakistan providing safe havens to terrorists, Islamabad is desperately seeking to salvage its reputation and fortunes with an erstwhile benefactor and ally that has run out of patience.
Omar Khadr was 15 when he was captured, and was the youngest inmate held at Gitmo.