Has nothing to do with sieging, a siege takes actual effort. Which it should, you should not be able to simply walk into someones town and block their doors leaving them with no way to do anything or defend themselves, its not logical, its not fun, and its bad design.
Name a single sandbox game...