Yes, rockets do make a noise! The public viewing areas for space shuttle takeoffs is, I believe, about 5 miles away yet still shattering.
Years ago, a US navy instructor told me he was present at the launch of one of the first Harpoon ship to ship missiles.
At the designated time, he waited on the ship’s deck with his own expensive camera to his eye and, when the launch took place, he was so shocked he dropped the camera on deck and broke it!
Bri 😀