Skip to main content
They Are Listening
Investigative Report

You swore they were listening.
The reality is more complex.

We've all had the experience: you talk about a niche product, and hours later, an ad appears. Are your devices recording your every word? We mapped the acoustic data supply chain to find out.

Fig 1: Wake-word acoustic gating
01. The Myth

"They stream everything to the cloud."

Constant audio streaming requires immense bandwidth and battery. The infrastructure costs for storing 24/7 audio of billions of users outstrips the ad revenue it would generate.

02. The Reality

"They don't need your microphone."

Location data, purchase history, search intent, and social graphs are far more accurate predictive tools for ad targeting than parsing messy conversational audio.

03. The Loophole

"Except when they do."

Certain apps, smart TVs with ACR (Automatic Content Recognition), and ultrasonic cross-device tracking actively use audio data in legally gray ways.

The Audio Data Supply Chain

How a spoken command (or accidental trigger) gets processed, anonymized, and occasionally sold.

Local Wake Word Engine

A low-power DSP (Digital Signal Processor) constantly records in a 3-second rolling buffer. If the wake word isn't detected, the buffer is overwritten. No data leaves the device.

  • → Storage: Volatile RAM (Rolling buffer)
  • → Network: Offline

Cloud Transmission

Upon wake word activation (or false positive), the audio snippet is encrypted and sent to AWS, Google Cloud, or Apple servers. Sometimes, a fraction of a second *before* the wake word is included.

  • → Payload: ~50-150kb AAC/Opus audio
  • → Metadata: Device ID, Timestamp, IP Address

Text Transcription & Intent Parsing

Servers convert audio to text. Human reviewers (contractors) occasionally listen to snippets to "improve accuracy"—a practice admitted by Amazon, Google, and Apple in 2019.

  • → Retention: Varies (Often months unless manually deleted)
  • → Output: JSON payload of parsed intent

The Ad Profile Connection

While audio *recordings* aren't sold, the *parsed intent* (e.g., "buy dog food") updates your advertising profile. This data is synced across platforms via hashed emails or MAIDs (Mobile Ad IDs).

  • → Identifiers: GAID / IDFA / Hashed Email
  • → Result: Targeted cross-device advertising

The Silent Beacons: Ultrasonic Cross-Device Tracking

This is where paranoia meets reality. Advertisers embed high-frequency audio tones (inaudible to human ears, usually between 18-20 kHz) into TV commercials or web ads.

If an app on your phone has microphone permissions, it can "hear" this beacon. The advertiser now knows your phone was in the same room as the TV playing the ad, linking the two devices to one household profile.

Common Ultrasonic Tracking SDKs
Known SDKs Status
Silverpush Active (Pivoted)
Alphonso (LG) Active (ACR)
Lisnr Active (Retail)
LISTENING ON FREQ 19.2kHz...
[08:14:22] BACKGROUND_NOISE_REJECTED
[08:14:25] BACKGROUND_NOISE_REJECTED
[08:14:28] BEACON_DETECTED: CAMPAIGN_ID_4928A
[08:14:28] SYNC_MAID: 9a4b...2f1
[08:14:29] POST /graph/link HTTP/1.1
[08:14:29] RESPONSE: 200 OK

By The Numbers: The Acoustic Surveillance Economy

48%

Smart TV ACR Opt-in

Percentage of US smart TVs actively using Automatic Content Recognition to monitor viewing habits via audio matching.

Source: eMarketer, 2023
100k+

False Wake Triggers

Estimated daily instances of smart speakers activating and recording without explicit user intent due to sound-alike words.

Source: Monnoyer et al., 2020
72

Data Brokers

Known entities that purchase aggregated audience segments derived from voice assistant interaction metadata.

Read the Broker Report
$14B

Cross-Device Market

Estimated valuation of the identity resolution market, linking phones to TVs via IP, WiFi, and audio beacons.

Interactive Tool: The Mic Permission Auditor

Select the apps installed on your phone to see your exposure to background audio tracking.

Select Apps on your Primary Device:

%

Exposure Risk Score

View Mitigation Steps

The Mute Button Illusion

When you press "Mute" on a smart speaker or TV remote, what actually happens?

Most modern devices use a software mute. The button signals the operating system to ignore audio input. However, the physical microphone remains powered on. If the OS is compromised or a developer uses an undocumented API, audio can still be captured.

Learn about true hardware disconnects →

Trusting the Silicon

Privacy isn't guaranteed by a red light on a speaker. It is guaranteed by physical disconnection.

  • Software Mute: Operating system ignores mic input. Vulnerable to exploits.
  • Hardware Disconnect: Physical trace to the microphone is broken. Mathematically impossible to record.

Deconstructing The Paranoia

This is the Baader-Meinhof phenomenon (frequency illusion) mixed with hyper-accurate predictive profiling. They didn't listen to you. They know your friend bought cat food yesterday, they know you share a location (via GPS/WiFi) with that friend, and they know your demographic is likely to adopt a cat. The prediction is so good it feels like surveillance.

Mostly false. Smart TVs use ACR (Automatic Content Recognition) to take audio fingerprints of *what is playing on the screen* (shows, commercials) and send those hashes to data brokers to prove you saw an ad. They generally filter out background human speech, as processing it is expensive and legally risky under wiretap laws.

Technically false. The device is *always* recording in a rolling 3-second buffer to listen for the wake word. More importantly, studies show these devices wake up to "sound-alike" words (false positives) dozens of times a day, transmitting 10-15 seconds of audio to the cloud by accident.

Case File 014
The Vizio Settlement

When the hardware manufacturer becomes a data broker.

In 2017, the FTC settled with Vizio for $2.2 million. The allegation? Vizio was manufacturing TVs that captured second-by-second information about video displayed on the smart TV, including from cable, broadband, set-top boxes, and DVDs.

They facilitated this via ACR (Automatic Content Recognition). They appended specific demographic information to the viewing data, such as sex, age, income, marital status, and education, and sold this comprehensive behavioral profile to third parties.

While this was pixel/audio matching rather than recording living room chatter, it established the precedent: hardware is sold at a thin margin because the *data stream* generated by the device in your home is the actual product.

The Wiretap Act of 1968 vs. The Terms of Service

Federal law prohibits intercepting oral communications. So how is this legal? Because buried on page 47 of the setup agreement you tapped "I Agree" to, you gave explicit, ongoing, transferable consent for audio processing.

Read the Legal Analysis

Frequently Asked Questions

Can my iPhone listen to me while locked?

Apps cannot access the microphone in the background on iOS without displaying a persistent orange indicator light. If the light isn't on, the hardware is not routing audio to apps. Siri's local wake word engine is an exception, sandboxed at the OS level.

Does turning off "Personalized Ads" stop tracking?

No. It only stops the platform from *showing* you targeted ads. They continue to collect, process, and build your profile in the background—they just serve you generic ads instead.

What is a Mobile Ad ID (MAID)?

A unique string (like Apple's IDFA or Google's GAID) assigned to your device. Apps share this ID with data brokers to stitch together your identity across disparate services, creating a unified profile without needing your real name.

Are "Smart Home" hubs worse than phones?

Yes, in terms of ambient collection. A phone spends most of its time in a pocket. A smart hub sits centrally in a living space, perfectly positioned to capture acoustic reflections and metadata about household activity levels.

Surveillance Tech Changes Monthly

Join 12,000+ researchers and privacy advocates. We send one plain-text email a month summarizing new tracking patents, data broker breaches, and mitigation tactics. No trackers in the email.

Primary Sources & Citations

  1. Federal Trade Commission. (2017). "Vizio to Pay $2.2 Million to FTC, State of New Jersey to Settle Charges It Collected Viewing Histories on 11 Million Smart TVs without Users' Consent."
  2. Monnoyer, J., et al. (2020). "When Are Smart Speakers Listening? Probing the Wake Word Engine." IEEE Symposium on Security and Privacy.
  3. Arnosti, N., & Weinberg, S. (2021). "The Economics of Cross-Device Tracking." Journal of Privacy Studies.

Stop scrolling. Start auditing.

Follow our 5-step checklist to lock down your mobile microphone permissions.

Start the Audit