Adam Smith noticed this in the 1780s and ascribed it to an expanding market for labour and according wealth for the labouring classes: he figured people in long settled areas wouldn't be able to support extra kids so their families wouldn't grow, while frontiers offered opportunities for labour expansion so families were larger.

I'm not sure how he figured the biology would follow his economic imperatives.