You use both lenses at once.
You look through the telescope in close up so you can see which color is in the back, farthest away from you. It isn't always the door on the left or the door on the right that is in the back.
You set the doors so the blue door is in the back.
If you have any of the doors set wrong, the portal at the end of the walkway will not open.