Between the towers and the Hudson was created partially with the fill from the dig of the towers.

For many years that land was flat and vacant. I'm guessing these pictures from NJ compress the view and since the land is flat, it makes it look like it's not there.

Eventually they built Battery Park city.

Here is a different angle