Evaluation Pack

Anonymous Dataset #7 Primary pack

Primary dataset evaluation pack for public utility battles.

All eligible public clips, capped at 200 with uniform task-tag sampling when necessary.

Dataset: Anonymous Dataset #7

Clips

Scorecards

Model

HaWoR

Trackability

88.9

Hygiene

79.5

Hand Signal

42.6

Interaction Density

52.1

Scorecards

Pack-level category scores

Overall QualityProvisional

63.5

19 clips · 0 votes · 0 raters

Training Utility

50.0

Trackability

83.6

Annotation Fidelity

50.0

Hygiene

83.1

Hand Signal

54.4

Interaction Density

47.5

Training UtilityProvisional

50.0

19 clips · 0 votes · 0 raters

Elo

1000.0

Both bad rate

0.0%

TrackabilityProvisional

83.6

19 clips · 0 votes · 0 raters

Lost-track rate

10.0%

Relocalizations / min

1.5

IMU-only fraction

10.0%

Median feature count

126

Static pose jitter

0.50 cm

Annotation FidelityProvisional

50.0

19 clips · 0 votes · 0 raters

Elo

1000.0

Both bad rate

0.0%

HygieneProvisional

83.1

19 clips · 0 votes · 0 raters

Blur score

80.0%

Exposure score

90.0%

Dropped frame rate

0.0%

Sync offset

31 ms

Calibration completeness

80.0%

Hand SignalProvisional

54.4

19 clips · 0 votes · 0 raters

Visible-hand fraction

50.0%

Mean joint confidence

60.0%

Hand temporal stability

70.0%

Interaction DensityProvisional

47.5

19 clips · 0 votes · 0 raters

Hand-object co-presence

50.0%

Near-contact fraction

40.0%

Public previews

Redacted battle clips

6sNo face blur applied

Tannery - Toggling Dry Leather

Right hand removes the attached metal clip from the leather, while left hand reaches for a metal clip that is holding the leather to the perforated frame.

6sNo face blur applied

Rubber - Operating Rubber Molding Press

Left hand places the sheet of freshly molded rubber parts on the wooden table.

6sNo face blur applied

Machine Shop - Operating a Metal Lathe for Shaft Turning

Left hand touches the cross-slide handwheel handle of the lathe machine. Right hand reaches for the spindle control lever of the lathe machine.

6sNo face blur applied

VLM Annotation - sample

The operator reaches up with the left hand to touch and inspect the metal guide rail positioned above the moving bottles.

6sNo face blur applied

Shrimp Factory - Testing Sulfite Levels in Raw Shrimp

Right hand picks up the knife from the cutting board, while left hand holds the shrimp.

6sNo face blur applied

Automotive - Powder Coating Automotive Fuel Tank

Right hand picks up an automotive fuel tank from the side handle bar while left hand is idle at operator's side.

6sNo face blur applied

Spice Factory - Sorting Dried Chilies on Conveyor Belt

Right hand spreads red dried chilies to the right on the vibrating roller sorting machine.

6sNo face blur applied

Pottery - Using Jiggering Machine to Create Claypot

Both hands pick up the plaster mold with clay from the table, each hand grabbing the plaster mold with clay on each side.

6sNo face blur applied

Chemicals - Filling Cellulose Ether into Hopper

Right hand touches and squeezes the corner of the Cellulose Ether chemical bag.

6sNo face blur applied

Furniture - Sticking Laminate to Plywood Board

Right hand places the long-handled ladle into the bucket of white latex glue.

6sNo face blur applied

Lab - Transferring Frozen Cells Vial

Both hands place the green coolbox on the stainless steel platform, while the operator turns left.

6sNo face blur applied

Textile - Sewing Suit Jacket

Both hands place the black fabric piece at the needle plate of the industrial sewing machine.

6sNo face blur applied

Jewelry - Assembling Silver Tiger Brooch

Right hand places the rotary tool on the right side of the workbench.

6sNo face blur applied

Pharma - Sifting Dried Granules from Vibratory Sifter

Right hand grasps the inner spinner lock of the tray dryer, while left hand rotates the inner spinner lock of the tray dryer counterclockwise.

6sNo face blur applied

Printing Press - Trimming Prayer Sheet

Right hand picks up the prayer sheet from the table while holding the scissors.

6sNo face blur applied

Shoes Making - Molding Shoes

Right hand picks up the molded shoe sole from right rotary molding machine while left hand pushes the left injection mold of the left rotary molding machine to the left.

6sNo face blur applied

Medical - Assembling a Medical Tubing Set

Left hand places the clear blue plastic tube in front of the heat gun, while right hand holds the y-shaped connector.

6sNo face blur applied

Medical - Air Leak Test on a Breathalyzer Mouthpiece

Right hand picks up the pen from on top of the data collection worksheet, while left hand rests on top of the work table.

6sNo face blur applied

Electronics - Soldering Wire to Push Button Switch

Left hand picks up the pre-stripped black wire on the right side of the table, while right hand holds the soldering iron.