Now we begin to see the true reason for all the AI push.
>You had to live – did live, from habit that became instinct – in the assumption that every sound you made was overheard, and, except in darkness, every moment scrutinized.
Let me play a devil's advocate. Are you (and Orwell) unhappy that people breaking the law get punished? Even if you merely cross the road in the wrong place, you deserve a punishment to the maximum extent specified by the law, don't you? It doesn't matter if you break the law in the darkness or not.
The whole point of 1984 is to show how perfect surveillance allows the perfect enforcement of unjust laws, allowing complete control of Big Brother over every aspect of the lives of the country's citizens. The same cameras that can be used to fine you for illegally crossing the street can be used to find and punish you for illegally speaking out against the regime.
This is the danger of surveillance tech: you install it for purportedly good reasons, but once the power to monitor everyone to this level exists, it becomes very easy to start pushing towards more control, both legally and illegally.
There's plenty of laws that aren't fit for purpose and are immoral, so any kind of automatic system that enforces punishments without any oversight (e.g. by jury) is going to lead to abuse. (It used to be illegal to help an escaping slave, so just imagine if a system determined that you didn't do enough to help with re-capturing a slave and sent you into slavery as punishment)
> Even if you merely cross the road in the wrong place, you deserve a punishment to the maximum extent specified by the law, don't you?
It depends _why_ you did it. This is the precise reason why we have courts and juries. Jury nullification exists for a reason. Laws are not meant to be a rote set of rules and punishments to dole out mechanically.
This went _just great_ in East Germany, which was the last place to seriously try this approach (fortunately the Stasi didn't have modern surveillance tech, but they did quite enough damage with what they had).
>You had to live – did live, from habit that became instinct – in the assumption that every sound you made was overheard, and, except in darkness, every moment scrutinized.
– George Orwell, 1984