It is not without reason or by chance that we worship towards the East…
Since, therefore, God is spiritual light, and Christ is called in the Scriptures Sun of Righteousness, and Dayspring, the East is the direction that must be assigned to His worship.
Moreover the Scripture also says, And God planted a garden eastward in Eden; and there He put the man whom He had formed, and when he had transgressed His command He expelled him and made him to dwell over against the delights of Paradise, which clearly is the West. So, then, we worship God seeking and striving after our old fatherland.
Moreover the tent of Moses had its veil and mercy seat towards the East. Also the tribe of Judah as the most precious pitched their camp on the East. Also in the celebrated temple of Solomon the Gate of the Lord was placed eastward.
Moreover Christ, when He hung on the Cross, had His face turned towards the West, and so we worship, striving after Him.
And when He was received again into Heaven He was borne towards the East, and thus His apostles worship Him, and thus He will come again in the way in which they beheld Him going towards Heaven; as the Lord Himself said, As the lightning comes out of the East and shines even unto the West, so also shall the coming of the Son of Man be.
So, then, in expectation of His coming we worship towards the East. But this tradition of the apostles is unwritten. For much that has been handed down to us by tradition is unwritten. (St. John Damascene: Orthodox Faith)