Diff

datasetlint diff compares two datasets and classifies changes, regressions, and improvements.

datasetlint diff old_dataset new_dataset
datasetlint diff old_dataset new_dataset --format json
datasetlint diff old_dataset new_dataset --fail-on-regression

Python:

from datasetlint.diff import compare_datasets

report = compare_datasets("old_dataset", "new_dataset")
print(report.summary)

The diff covers:

  • Metadata changes
  • Sensors added or removed
  • Duration changes
  • Frame count changes
  • Frequency changes
  • Calibration changes
  • Label class distribution changes
  • Issue count changes
  • Trajectory speed and acceleration summary changes

Regressions include removed sensors, significant frame-count or duration drops, calibration changes, disappeared label classes, and increased warning/error issue counts. Use --fail-on-regression in CI to exit non-zero when regressions are found.

Diff reports are printed to stdout. Redirect JSON or Markdown output when you want an artifact:

datasetlint diff old_dataset new_dataset --format json > datasetlint-diff.json

Relevant thresholds:

frame_count_drop_ratio_warning: 0.1
duration_drop_ratio_warning: 0.1
issue_regression_severity: warning