I'd like to see a philosophical justification of that.
How is it an offense against me that some guy in teh otehr end of the country pickpockets someone.
And don't use hipotheticals, as they are worthless.
It is not a philosophical argument, but an assumption of the law. The entity in which ultimate sovereignty and power is vested is the one against whom the crime is committed. Under the common law, for instance, a crime is an offense against The Crown, the ultimate repository of power. Similarly, in the U.S., a crime is assumed to be an offense against the People. The issue is not philosophical, but legal.
Actually, no. in primitive anglo-saxon common law, there were no offenses against magican entities like "The People" or "The Crown", as suits, even criminal, were among several parts, and the punishment was usually restitution.
What happened was when the Norman kings started to change the saxonic laws.