How Wrong Is It to Hold Hands During the Our Father?

The rubrics do not call for the holding of hands during the Our Father. No one, not even the celebrant, is permitted to add things to the Mass that are not in the approved liturgical books. However, holding hands during the Our Father (while illicit) does not rise to the level of a mortal sin.