Take years before they explain a lot of it.
I personally believe that the ones that think they were left are actually the ones that were taken and what they believe is reality is actually some sort of afterlife.

Still a very interesting show with a plot line that keeps me coming back.