Images and video in traces
Your Agent can send images and video with its messages. Mibo shows them in the trace view, checks them with a procedural media check, and can send images to an AI judge. This page covers what Mibo accepts and what it does with each kind of media.
Send media as message parts
Section titled “Send media as message parts”Mibo reads media from the parts array of each message in gen_ai.input.messages or gen_ai.output.messages. A media part has one of these types:
blob: the bytes are inline, as base64 text incontent.uri: a link to the media, inuri.file: a file reference.
Each part declares a modality (image, video, audio or document) and, optionally, a mime_type. Mibo uses the bytes to decide what to show and check. A declared modality or mime_type that does not match the bytes does not change the result.
{ "spans": [ { "span_id": "root", "name": "Chart Agent", "attributes": { "gen_ai.output.messages": [ { "role": "assistant", "parts": [ { "type": "text", "content": "Here is the revenue chart." }, { "type": "blob", "modality": "image", "mime_type": "image/png", "content": "iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAYAAAAfFcSJAAAADUlEQVR42mNkYPhfDwAChwGA60e6kgAAAABJRU5ErkJggg==" } ] } ] }, "status": { "code": 1 } } ]}Text parts keep their order around the media. Mibo also accepts inline bytes as a byte array.
Instrumentation that maps to media parts
Section titled “Instrumentation that maps to media parts”Mibo maps these sources to media parts:
- Native GenAI message parts, and OpenInference media on messages.
- Vercel AI SDK image and file parts. Inline content becomes a
blob, and a URL becomes auri. - LangChain image blocks, mapped the same way.
Mibo does not show media in OpenLLMetry’s legacy JSON-string format, or in OpenInference span-level image attributes.
When the same bytes also appear in a source attribute, Mibo stores them once and keeps the source attribute as a reference. The trace view restores the original value. Your assertions see the original value too.
What Mibo accepts
Section titled “What Mibo accepts”Mibo recognizes a media format by its bytes. The declared type does not matter.
| Type | Shown in the trace |
|---|---|
| PNG, JPEG, GIF, WebP | Yes |
| MP4, WebM | Yes |
| SVG | No. Shown as a placeholder. |
| AVIF, HEIC, and other unknown formats | No. Shown as a placeholder. |
Mibo shows inline images up to 5 MB after decoding. It shows inline video up to 10 MB. Larger media shows a placeholder with its size and the limit. Media size does not add a new ingest limit. The request size limits still apply to the whole trace.
Audio and documents are identified by type. Mibo does not display or judge them.
How media appears in the trace
Section titled “How media appears in the trace”Media appears in message order, next to the text it belongs to.
- The customer message shows media from the user messages up to the first user message with text.
- The agent reply shows media from its last assistant message.
- When no message carries text, the first input span with media supplies the customer media, and the last output span with media supplies the agent reply media.
- A step that has media shows its own message text beside it.
Animated images have a pause and play control. If your browser or the OS asks for reduced motion, an animated image starts paused on its first frame. Video loads when you play it. If the browser cannot play the file, the trace says so.
Placeholders
Section titled “Placeholders”A placeholder replaces media that Mibo does not render. It shows the modality, the declared type, and the size, followed by the reason:
| Reason | Message |
|---|---|
| Bytes missing | Bytes not included in the trace. |
| Unsupported format | Not a supported image or video format. Mibo shows PNG, JPEG, GIF, WebP, MP4 and WebM. |
| Too large | Larger than the display limit for that type. |
| Audio | Audio isn’t displayed. |
| Document | Documents aren’t displayed. |
External links and references
Section titled “External links and references”Mibo never loads, renders or opens external media.
- A
uripart with anhttpslink shows the host and the full URL as text. It includes this notice: “External link from the trace. Mibo doesn’t open or load it.” - A
uripart with any other scheme, a data URL inside auripart, and afilepart show as a reference only. The media is not stored in the trace.
Redaction and media
Section titled “Redaction and media”Redaction does not change inline images or video. Mibo still redacts secrets and personal data in the text parts of the same messages. See Data handling.
Check media
Section titled “Check media”A Media check tests the presence, count, declared type, size and URI syntax of media parts. It runs without an AI evaluation. Create one in the test editor under Does, or let the Test Architect propose one when the trace has media. See Media.
Judge images with AI
Section titled “Judge images with AI”A semantic check can send images from the final reply to the AI judge. This is off by default. In the test editor, open a Says check and turn on Judge output images.
When it is on, Mibo sends:
- up to four PNG or JPEG images from the final assistant message,
- each up to 5 MB,
- at full resolution, without resizing.
Mibo drops extra images and notes that in the prompt. A check that cannot use its images is skipped with a reason. It is never judged on text alone. See Image judging for the skip reasons.
Each judged check uses one AI evaluation, plus one for each image it sends. A check that sends four images uses five. Failed and skipped checks use none. Procedural checks do not use AI evaluations. See Sending traces for your plan’s allowance.