The issue of privacy when vlogging. (I forgot to put on the wide lens 😁)

Twice in one week, I have been asked to not take videos which could include other people other than myself or my wife. First time on board the flight going back home and the second at an hotel in Amsterdam while having breakfast. There may be good reason nowadays to protect the privacy but how far should that protection go? I don't really know but I find difficult also to limit the freedom of taking videos (of pictures) of general travel moments or amily time just because there are other people around.