Every policeman`s darling

Walking from my house to the nearest train station, I have to cross just one street. It`s a quiet area and there is hardly any traffic on there. Still, it seems that the traffic light for pedestrians is usually red. Not that I am in a particular hurry right now, but waiting for no obvious reason is annoying.
While I would just cross the street at red light when there was no car in sight, other pedestrians would just wait. I attributed it to people`s desire to always obey the rules, even if the rule makes little sense.
Well, lately I noticed that I may have been wrong...There is a police box RIGHT in front of the crossing. And those police boxes are ubiquitous and overstaffed and their "inhabitants" probably bored to death, so it may not be a smart idea to annoy them. And I have noticed since that I do get dirty looks from that corner when I cross the street at red light...
What shall I do? Comply and nicely wait? Or risk a confrontation and shout at them that they obviously prefer to harass pedestrians instead of going after the Yakuza (Japanese mafia)? Hm, ok, I don`t want to be expelled from this beautiful island, so let`s be patient...