Lower Egypt had its counterpart: Upper Egypt. Egypt was divided into those two regions with respect to the main river flowing through Egypt: the Nile.
Rivers flow from higher to lower regions, so Upper region is where Nile originated, and it's actually located higher, while Lower Egypt is lower with respect to sea level.