I have firearms that I have not shot yet - one cost over $3000.
I recently sold a NIB rifle that I bought 4 or 5 years ago and I never shot it.
I don't feel weird about it, but I do recognize that I have a problem.
My name is The Heretic and I am a gunoholic.
Seriously, if you are getting a decent price on the ammo, then you are fine.
But if you paid an inflated price, which isn't hard to do today, then I would advise you to not panic buy - the prices will come down on the ammo that has inflated prices. Most of that is .22 rimfire, and I would bet you are buying low cost surplus cheap ammo for military rifles, so you are probably okay. For most of this ammo the price will probably increase over time.
The other advice I would give, is to not just get inexpensive FMJ ammo. IMO it is okay for practice and pleasure shooting, but I would slowly purchase ammo intended for hunting and/or self-defense - e.g., soft point expanding ammo. And I wouldn't buy cheap chinese or russian hollow point ammo thinking that because it is hollow point it is expanding ammo - it isn't.