Air14/2076 has some interesting reports of rocket phenomena seen over Germany in the winter of 1943/44, but nothing about objects seen over the U.K.

I found this one on the net years ago (can’t recall what I was searching for at the time, honest!). Over the Channel, so a bit closer to home?

http://www.daves-world.co.uk/ufo/text/pages051-075/page72.html