My daughter lost her first tooth right after she turned 5, but son didn’t lose his first tooth until he was 7 1/2.  The dentist said that everyone is different.  Ashley got her teeth late and started losing early, AJ got his teeth early and started losing them late.  I wouldn’t be concerned.  4 1/2 is not too soon to start losing teeth.