Usability Testing Notes

[Shoeboxam]

Dataverse Usability Testing notes from Jayshree and Sophia

Recommendations

Overall

• "disable" -> "x" similar to browser window with minimize/close
• disable numeric epsilon/delta in the startup window or make more hidden
• a user misinterpreted more error to be better (use color to indicate if it is a useful release, but don't scare them about leaking data)

Users hesitant to use privacy budget

• (provide a public demo dataset anyone can access)
• embedded tutorial videos

MIKE IDEA: replace left panel variable list with collapsible box for each variable

Budgeter

• Privacy gains for population size not clearly shown to user/emphasized
  (maybe move to its own step in the popup)
• include one regular and one multivariate statistic on center panel on load
• preset workspaces
• for missing values: add a drop option (listwise deletion)
  IDEA: similar barchart to interactive, but break up by statistic/release

Explain drawbacks of range (include in prompt), assurance on DP regardless of range

• too small of a range is biased
• too large is high variance

Interactive

• ranges and variable types should be set by depositor (should be visible, not editable)
• show starting epsilon (no longer visible after a release)
• "title" html attribute for sections of the bar graph thing, showing the epsilon of the section
• lots of bugs