From a legal stand point. If your drone is sub 250 and you take off from your land, and you keep vlos, don’t invade his privacy there is nothing he can do. However if you were on numerous occasions did hover over his garden for example, he could possibly claim alarm harassment and distress which could be construde as an offence. But if you hover in your garden zooming in to his with the camera what would his attitude be.