Research

Research seriesL3offensive security

Multimodal Injection: Payloads in Pixels and Audio

The instruction that hijacks an agent need not be text. Images, audio, and documents are first-class injection channels, and the model's own perception is the vulnerability. This threat lab extends the indirect-injection threat model to non-text modalities: adversarial and steganographic image payloads, audio that transcribes to attacker instructions, invisible-text and OCR document channels, and the provenance and sanitization controls that trust-tag perceptual inputs — each paired with a hardening. Grounded in the primary cross-modal injection and adversarial-audio literature.

Murali Chillakuru·5 articles
  1. 1
    The Cross-Modal Threat Model: Where Non-Text Inputs Become Trusted Context

    Every image, audio clip, and document an agent perceives is an untrusted input channel, yet models treat perception as ground truth — that gap is the vulnerability.

  2. 2
    Instructions Hidden in Images: Perturbation and Steganographic Injection Robust to Resizing

    An image can carry an instruction the eye never sees; the attacker's real challenge is making that instruction survive the preprocessing pipeline.

  3. 3
    Audio and Transcription Attacks: Adversarial Speech and the ASR-to-Prompt Boundary

    A sound that a human hears as music or noise can transcribe to a command an agent obeys; the transcription step is a trust boundary most systems forget to draw.

  4. 4
    Document and OCR Channels: Invisible Text, Layout Tricks, and Metadata as Injection Surfaces

    A document is not what you see — it is what the parser extracts, and the gap between the two is where an instruction hides from the human but not from the agent.

  5. 5
    Provenance and Sanitization for Non-Text: Trust-Tagging Perception and Modality Isolation

    The one control that closes every multimodal injection channel at once is to stop trusting perception — tag it, isolate it, and deny it authority.