Policing is mostly different from fighting a war, so I don't think it makes sense to have similar training. Rather, police should be better trained in non-combat roles so that when a problem arises, the solution is not always "shoot the problem".
If you actually need urban combat expertise, then that's what a SWAT team can be for. But, like the military itself, the ideal would be that it never gets used.