It is determined by the chromosome given to the egg by the sperm. Since the egg carries 2 X chromosomes, it always gives an X. Since the sperm cell carries an X and a Y, then whichever chromosome it gives determines the sex of the offspring. XY is a boy, and XX a girl.
