When the community is the LLM
The norm forming says AI gets to speak for the humans AI was supposed to be asking. Five norms crystallized in NormSense this week showing the same substitution playing out across sectors.
A city wants to know what residents think of a proposed housing policy. A traditional community consultation involves a meeting, a flyer in three languages, folding chairs in a school cafeteria, and someone from public works getting yelled at for two hours. It is slow, contentious, and expensive. It is also the thing democracy claims to be.
A newer approach skips most of that. The city contracts with a PropTech platform that has built a “synthetic population” using interview data from previous residents. The platform runs the proposed policy past the synthetic population. The synthetic population produces feedback. The city marks the consultation step complete and moves on.
Cluster 6a91bbc4-Governance platforms substitute LLM-simulated resident input for actual community consultation in policy decisions crystallized in NormSense with one of the lowest procedural integrity scores in the entire corpus. The synthesis identifies two parallel mechanisms. Academic proposals license pre-deployment policy testing via synthetic populations derived from interview data. Housing platforms automate tenant-facing decisions without disclosed oversight mechanisms. Both replace the resident with a model of the resident.
The structural argument from the academic side is that synthetic populations can be cheaper, faster, and more inclusive than live consultation, because the model can be queried at scale without travel costs or scheduling conflicts. The structural argument from the PropTech side is that automation is just operational efficiency. The structural reality is that the residents whose policy this is are not in the room.
The pattern is broader than housing
Five other norms crystallized recently with the same operational signature. Different domains, same substitution.
Cluster 709fc8fd-AI developers deploy synthetic personas and voice clones without obtaining identity rights from depicted individuals documents AI systems appropriating personal voices, identities, and creative personas without consent. The synthesis names the consequence directly. People are being forced into defensive withdrawal from public sharing because their voice can be cloned and made to say things they did not say. The voice is the substitute. The person is gone.
Cluster 72f6399c-Social media platforms authorize AI agent automation via official APIs without requiring audience disclosure documents platforms providing official API access for AI-driven account automation. The account exists. The person whose name is on the account is not necessarily producing the content. The audience reading the posts is interacting with a substitute. The norm does not require the platform to mention this.
Cluster b6d983b6-Commercial AI platforms conceal synthetic origin of automated outreach from recipients documents AI sales and marketing platforms masking AI authorship of outbound communications. When you get an email from a salesperson, the salesperson is now sometimes a model. The norm forming says the recipient does not need to be told.
Cluster e678c2bc-Government agencies deploy automated decision systems to replace human judgment in high-stakes public determinations documents the same mechanism at the institutional decision layer. Benefits eligibility, residency verification, regulatory determinations. The human judgment was supposed to be the protection. The norm forming substitutes algorithmic output for that judgment, with PI 0.15.
Cluster 5efdbd61-Healthcare organizations deploy ambient AI scribes and agentic clinical tools without standardized patient consent or opt-out mechanisms documents the same substitution in medical encounters. The doctor is in the room. So is an AI scribe transcribing, summarizing, and increasingly drafting clinical decisions. The patient was not asked whether they consented to that third party.
What the substitution actually does
The thing being routed around is consent. Residents do not consent to being modeled instead of asked. Voice actors do not consent to being cloned. Audiences do not consent to interacting with synthetic personas. Recipients do not consent to AI authoring the email. Patients do not consent to the AI scribe.
The norm forming says consent is not required because the affected human is being represented rather than impersonated. The model is supposedly speaking for the resident. The clone is supposedly inspired by the voice. The AI agent is supposedly operating an account, not pretending to be the person who owns it.
The distinction collapses on contact. What reaches you is the substitute regardless of which category the institution files it under.
The protective response is forming
A few norms in the corpus are pushing back at the architectural level rather than the disclosure level.
Cluster 57a01eab-Grant Citizens Visibility into Municipal AI Systems via Public Registries documents municipal algorithm registries that mandate public documentation of AI systems used in government services. The norm forming says citizens have a right to know which decisions affecting them are being made by which algorithmic systems. PI 0.59. Quiet, structural, building real infrastructure.
Cluster 518751f9-Establish Disability Community Documentation as Primary AI Harm Evidence documents disability rights organizations creating evidentiary infrastructure that treats community testimony and ADA complaint records as primary legal documentation of AI harm. The mechanism is significant. The affected community is being established as the authoritative witness to its own experience. PI 0.50.
Cluster a95031a9-ML practitioners treat objective functions and fairness criteria as political decisions requiring stakeholder input rather than technical specifications documents researchers naming the choices encoded in AI systems as political rather than purely technical. The implication is that affected stakeholders get to weigh in on what the system is optimizing for. PI 0.50.
These three norms share an underlying claim. The affected population is the authoritative source of input about decisions affecting them. The model is not.
The decision underneath
The substitution norm reveals what the institution thought the human was for. If the resident could be replaced by a synthetic population, the institution was treating the consultation as a procedural checkpoint rather than a democratic input. If the voice can be cloned without consent, the artist was treated as a source of training data rather than a person. If the patient can be transcribed by AI scribes without disclosure, the patient was a record-generating event rather than a participant.
Each substitution is a vote about what the affected human was contributing in the first place. The institution that substitutes the human reveals that it valued the artifact the human produced.
The protective response is the human reasserting that the artifact and the human were never separable. Municipal registries say citizens get to see the model and contest it. Disability community testimony says the affected population is the authoritative source. ML stakeholder consultation says the people on the receiving end of optimization decisions get to weigh in on what is being optimized.
Watch which substitution gets contested first. The substitutions that pass quietly tell you what the affected human was already considered expendable for.
— Zach, see you in the cluster pages.