Egocentric video datasets
Egocentric video of hands at work, captured to a brief: the task, the environment and the device are fixed before anyone records.
What happens to a Recording
-
Capture
A Capture Partner records against the brief.
The consent receipt's SHA-256 is written into a hash-chained ledger.
-
Redact
Faces the detector finds are blurred before any human review.
-
Segment
The Recording is cut into usable Clips in one pass.
Each Clip id carries the first eight characters of its SHA-256.
-
Annotate
A model estimates 3D hand pose and confidence, both derived.
-
Deliver
The annotated data ships in the container the brief names.
The package manifest lists each file's SHA-256.
Recompute them with
shasum -a 256.
The public egocentric datasets
Three public egocentric datasets, as their papers describe them:
- Ego4D: 3,670 hours of daily-life video from 931 camera wearers in 9 countries, built for perception research (Grauman et al., arXiv:2110.07058).
- EPIC-KITCHENS-100: 100 hours of unscripted kitchen activity from head-mounted cameras, in 45 environments (Damen et al., arXiv:2006.13256).
- EgoDex: 829 hours of dexterous tabletop manipulation with paired 3D hand and finger tracking, made with Apple Vision Pro (Hoque et al., arXiv:2505.11709).
Each dataset has its own terms. EPIC-KITCHENS is published under CC BY-NC 4.0, with commercial licences arranged by email (EPIC-KITCHENS). The EgoDex dataset is released under CC BY-NC-ND (EgoDex). Ego4D asks every user to accept its licence agreement before download (Ego4D). For a commissioned brief, the terms a delivery may be used under are agreed in the engagement.
What an egocentric brief pins down
Each row is agreed before the first Recording exists.
| What the brief pins down | How it is set |
|---|---|
| Task and environment | Named in the brief. The catalogue lists each brief with its availability |
| Device | Named in the brief, from Ray-Ban Meta glasses to a stereo global-shutter head rig |
| Consent | Given by the Capture Partner before recording starts, as a receipt in the hash-chained consent ledger. A withdrawal is appended to the same ledger |
| Capture Partner pay | From ₹229/hr of accepted capture, paid directly by UPI. Pay terms |
| Delivery | A directory named by a hash of its contents, with a manifest of every file's SHA-256 and a compliance log covering every Clip. How a delivery is checked |
Scope an egocentric brief
Send the task and the environment your policy needs footage of. We scope the brief with you, from the device to the delivery format.