Give the robot a reliable picture of the cell

Cameras, calibration and models that tell the arm where each part is and which way it faces: in clutter, under changing light, and on parts that shine or are see-through.

Published accuracy of a Zivid 2+ structured-light camera at 1 m. A wrist RealSense D405 is ±2% at 50 cm.
±0.2 mmPublished accuracy of a Zivid 2+ structured-light camera at 1 m. A wrist RealSense D405 is ±2% at 50 cm.
The licence of Ultralytics YOLO. For client products we default to permissive detectors such as RF-DETR.
AGPL-3.0The licence of Ultralytics YOLO. For client products we default to permissive detectors such as RF-DETR.
The licence of FoundationPose. When you intend to ship, we use BSD-licensed HappyPose / MegaPose instead.
Non-commercialThe licence of FoundationPose. When you intend to ship, we use BSD-licensed HappyPose / MegaPose instead.

What we do

  • Robot perception and vision

    From choosing the camera to the model that reads it.

    • Depth cameras chosen on measured accuracy
    • Hand-eye calibration
    • Detection and segmentation with RF-DETR, YOLO and SAM 2
    • 6-DoF pose estimation for known and new objects
    • Point clouds for bins, shelves and trays
    • Transparent and reflective parts

Model or no model

Where is the part, and which way is it facing?

Programmed approach

  • Fixed camera poses and fiducial markers (AprilTag, ArUco)
  • Color and depth thresholds
  • Template matching against CAD models

Learned approach

  • Detection and segmentation models (RF-DETR, YOLO, SAM 2)
  • 6-DoF pose estimation
  • Trained on synthetic images plus a small real set

How we choose

If parts, fixtures and lighting are controlled, classical vision is cheaper and easier to certify. With many part types, clutter, or shiny and transparent parts, learned perception usually wins. Borrowed weights rarely work as downloaded, so we fine-tune on your cell and prove it on a held-out test set.

Choosing a depth camera

Published accuracy, read from each maker’s datasheet. The right camera depends on distance, parts and budget.

CameraHow it worksPublished accuracy
Intel RealSense D405Passive stereo, close range±2% at 50 cm; good on the wrist
Intel RealSense D435iActive stereo, general purposeRMS about 2 mm at 1 m
Orbbec Gemini 335LActive stereo0.8% at 2 m
Zivid 2+Structured light±0.2 mm at 1 m
Photoneo PhoXi LStructured light0.524 mm point to point

Tools we use

  • RF-DETR
  • YOLO
  • SAM 2
  • HappyPose / MegaPose
  • FoundationPose
  • Open3D
  • easy_handeye2
  • RealSense / Zivid / Orbbec

What you get

  • A camera and lighting plan
  • Calibrated cameras
  • Trained perception models with a held-out test report

Read more in our notes

Tell us what you want a robot arm to do.

Send a short description or a phone video of the task. We will reply with what we would simulate first, and whether a learned model belongs in it.