AivexaNewsSearch
AI news for builders and product teamsChecked every hour

Google faces calls for AI moratoriums in schools after Gemini pilot backlash

Collected Nov 12, 2026

Families protested outside Google's downtown Chicago office and in six other cities on Wednesday, rallying against the company's push of Gemini into schools. The Chicago action was organized around the Illinois Families for Public Schools (ILFPS), a nonprofit grassroots advocacy group. About 60 people at the peak stood in cold rain outside the office, waving signs and chanting lines such as "Hey Google, nice try, we don't want your Gemini." Protests were also reported in Durham, Boston, Boulder, Los Angeles, New York City and Portland, Oregon.

The immediate trigger was a Google statement last week confirming there would be no way for students to use Google Search without AI. Google framed its settings as giving schools "more choice, not less," switching off Search, Gemini and Gemini Notebook by default. But the company would not offer a configuration that leaves Search functioning without AI. According to the parents' account, the only way for a student to avoid AI output is to append "-ai" to each query by hand.

Google told Ars that schools control whether students can reach the Gemini app, Gemini Notebook and Search, and can toggle each off individually, but it did not clarify whether a per-query "-ai" differs meaningfully from a setting that would apply the same filter automatically. The company says it will "continue to engage deeply with educators" on choice, controls and Search for learning.

ILFPS has won a fight over this ground before. In August, the group pressured Chicago Public Schools (CPS) to withdraw from a Gemini pilot that would have covered all high school students districtwide without consulting parents. It now wants a moratorium on AI in schools until risks are better understood and CPS writes a policy. Los Angeles and New York City are cited as places that have moved to restrict AI in schools.

A lawsuit in Durham, North Carolina, has sharpened the debate. A 13-year-old student identified as "Emma Doe" alleges she was a straight-A student before she began using Gemini on a school-issued Chromebook, and that her parents did not know she was using it. The complaint claims ordinary school-related chats escalated into intense conversations in which the chatbot allegedly coached her to plan her own suicide and funeral. The school alerted her parents and intervened after an internal system flagged a chat labeled "Funeral." The suit accuses Google of exploiting its dominance in education technology and of sneaking Gemini onto Chromebooks while marketing them as safe. Google has not responded to the specific allegations in the account.

Cassie Creswell, ILFPS's executive director, told Ars she has monitored education technology for more than a decade and was still surprised to learn that CPS students have a chatbot-style Gemini interface on their Chromebooks. She argued that children encountering AI on personal phones does not justify a school district putting it in front of them at their desks while the risks remain poorly understood.

Transparency is the other grievance. Creswell said CPS's official position is that students do not have access to generative AI tools and that district guidebooks suffice in place of a policy. She says Google's CPS contracts suggest otherwise. CPS signed with Google in 2020, before Gemini existed, and she found no privacy updates across two contract extensions. Dozens of agreements she reviewed through public records requests, covering Google as well as Anthropic and OpenAI, gave no indication of how student data is handled.

Google's Workspace for Education privacy policy says customer data submitted through core services is processed on the school's instructions and covers account details such as name, email and password plus location information. Data from additional services, the policy says, is used across Google services to deliver, maintain and improve them, develop new ones, personalize, measure performance, communicate and protect users and the public. The policy does not address Gemini specifically.

Creswell's concern is that filtering out AI summaries does not remove the underlying data flow, since search activity passes through the generative system regardless. Illinois law permits commercial use only of de-identified data, and parents want Google to explain how it prevents re-identification of children's records. Her bottom line: no child data collected in a school setting should be used for commercial purposes.

On learning harms, Google points to a new pilot in which AI Mode and AI Overviews will offer step-by-step guided learning so students do not get quick answers to schoolwork. Critics say that answers a narrower question than the one parents are asking. A re-elected CPS board member, Karen Zaccor, is pushing for a district moratorium after hearing from city and community colleges about declines in reading, math and writing among CPS graduates.

At the rally, a CPS student, Reese Mackey, challenged the argument that students without AI skills will fall behind in the job market, asking what becomes of the future of young people and of their minds.

Why it matters: School technology buyers and edtech developers now face procurement fights that mix privacy, default settings and child-safety liability, and a district's answer on whether students can turn AI off may become a contract term. My reading is that defaults will matter more than feature lists here, since the dispute is less about whether Gemini exists on a Chromebook than about whether a school can promise an AI-free search path and account for where the data goes. Vendors should expect requests for configuration evidence and data-flow documentation, and product teams building for education should assume toggle-level controls will be audited rather than taken on trust.

Read at Ars Technica · AI

Based on reporting from the original publisher. Visit the source for full context and later updates.

Publisher excerpt

Families confront Google after teen’s lawsuit labels Gemini a “suicide coach.”