Waymo's AI cameras are now calling police on riders—raising urgent questions about robotaxi surveillance

When two teenagers rode in a Waymo this September, they didn't expect the vehicle itself to flag them to police. Yet that's exactly what happened: Waymo's interior camera system detected what it believed to be a firearm, initiated a stop, and called emergency services. The teenagers were arrested after officers allegedly found a loaded ghost gun in the vehicle—marking an unprecedented moment where an AI-equipped robotaxi took direct action against its passengers rather than merely capturing footage for later police review.

The incident has thrown into sharp relief a troubling gap between what riders assume happens inside driverless cars and the reality of how these vehicles surveil and respond to behavior.

How Waymo's Monitoring Works#

Waymo uses internal cameras and AI-powered pattern recognition to enforce its terms of service, according to company spokesperson Julia Ilina. The system flags potential violations—including the presence of firearms—and can escalate situations to law enforcement without human driver intervention.

However, critical details remain murky. Waymo has not disclosed:

• How its automated system distinguishes between a real weapon and something that merely resembles one
• What confidence threshold the AI must reach before flagging something
• What role human reviewers play between an automated alert and police contact
• Which other terms-of-service violations might trigger a police response

Bob Somers, a former engineer at autonomous vehicle company Zoox, suggested Waymo's system likely flags objects that resemble weapons for review by a remote operator. Carnegie Mellon professor Phil Koopman noted that "if you can train a computer to look at the road and decide how to drive, you can train a computer to decide if somebody's holding a gun"—but cautioned that such systems are never entirely accurate.

The Opacity Problem#

Waymo's terms of service explicitly prohibit weapons and items resembling weapons, but they don't clearly state that the company may initiate police contact based on what it observes inside the vehicle. The camera policy describes using footage to "check that in-car rules are being followed" and "promote safety and security"—language vague enough that most riders wouldn't infer direct police escalation.

Hayley Tsukayama, director of state affairs at the Electronic Frontier Foundation, called these disclosures "very broad" and argued that Waymo should explicitly tell passengers: "If we see something we deem a violation, we may call police." As it stands, she said, the practice is "outside of the expectations of consumers."