What I did to get through the memory puzzle was to draw the star map on paper first. Every time the puzzle gave me a new star, I marked the stars on my paper map - 1,2,3,4, etc. There's no time limit and the game waited on me while I marked each new star down on paper. It was much easier for me that way. Perhaps it can work for you, too.