The Catholic Church was left “stupefied” yesterday as Belgium reacted with revulsion to new child sex abuse horrors admitted by an ex-bishop that the Vatican placed in exile rather than face earthly justice.

Roger Vangheluwe told Belgian television that he abused one nephew for 13 years and another for nearly 12 months – but that there was “no penetration” and that he didn’t “in the slightest” think he was a paedophile.

Days after church bosses ordered Bishop Vangheluwe to undergo “spiritual and psychological treatment” in a French hide-out, identified by media as La Ferte-Imbault in the wine-rich Loire Valley, Belgian Prime Minister Yves Leterme laid into remarks he said “go beyond the boundary of what is acceptable.”

“The Church must assume its responsibilities – this cannot go on,” Mr Leterme insisted.

Belgium’s bishops likewise expressed collective “shock” at comments “playing down” and “offering excuses” for years spent sexually abusing boys while preaching from a pulpit – and a Thursday night media appearance they said contravened strict orders from Rome.