The idea that the priest and people should stare at one another....
The idea that the priest and people should stare at one another during prayer was born only in modern Christianity, and is completely alien to the ancient Church. The priest and people most certainly do not pray one to the other, but to the one Lord. Therefore, they stare in the same direction during prayer: either towards the east as a cosmic symbol of the Lord who comes, or, where this is not possible, towards the image of Christ in the apse, towards a crucifix, or simply towards the heavens, as our Lord Himself did in his priestly prayer the night before His Passion (cf. John 17.1).
-Pope Benedict XVI
via Fr. Heilman