OSS + ELC EU 2026

Camera sensors are evolving beyond single-stream models to generate multiple concurrent streams like RGB+IR video and embedded metadata alongside image data. Supporting these sensors in Linux introduces new challenges for the V4L2 and media controller subsystem, particularly around per-stream configuration and stream identification.

This talk presents two practical use cases for enabling multi-stream cameras in Linux. First, RGB+IR sensor support through V4L2 control framework extensions using array-based controls, enabling independent per-stream configuration while preserving a unified sensor model. Second, sensors transmitting embedded metadata, leveraging RAW sensor model proposed by Sakari Ailus, internal pads for metadata propagation, and data-type filtering in V4L2 bridge drivers to separate and route metadata and image streams.

Ref (lkml) : [PATCH v11 00/66] Generic line based metadata support, internal pads

These concepts are demonstrated through POC implementations on TI AM62A platform using OV2312 and IMX219 sensors, with integration into GStreamer and libcamera.

Attendees will gain practical insight into Linux multi-stream camera sensor implementation