When these charts say "births per 1,000", is that actually "births per 1,000 per year"? Just wondering about the conventions and labels, here. Demographic statistics isn't anywhere near any area of expertise of mine, but it seems like there must be an unspoken time interval

Yes, it's (number of births in year) / (population in year).