I have just added this to the map of places to fly your drone at Drone Scene:
Land owner permission not required.
Although this is English Heritage if you are flying sub 250 you can take off in the street outside.
although it is a small village there are a few places to park and walk to the castle. and the castle does have a tea room but there are others along with pubs in the village.
disclaimer here, i was there at 07.20 in the morning having left home at 5.45. so it was quiet.
The originator declared that this location was not inside a Flight Restriction Zone at the time of being flown on 04/06/2023. It remains the responsibility of any pilot to check for any changes before flying at the same location.