Applied various evaluation methods to identify usability problems and recommend improvements
Highlights
Methods: Interviews, Usability Testing, Personas, Scenarios, Comparative Evaluation, Heuristic Evaluation, Generalized Transition Network, and Surveys
Findings
Deliverables
Sitemap (GTN)
Usability Test Report
Final Presentation
Instructor: Mark Newman
Course: SI622 – Evaluation of Systems & Services (Winter’2009)
Teammates: Kate H., Jonathan S., & Dale M.
Client: Ann Arbor Ultimate League
Web Site Overview
a2ultimate.org is an important resource to organize the Ann Arbor Ultimate Frisbee league. The website is maintained by volunteers and the league organizing group. Our team studied the needs of the website and evaluated how well it met the goals of league members.
Process
On the sidelines of league games, we interviewed players to understand their goals and challenges. Using the data from the interviews, we created three personas that represented the main user categories. To get the perspective of the whole community we collected data using an online survey. The survey responses showed that users were genrally satisfied with the site, but communication features and search functionality were not very usable.
Equipped with basic understanding about the users, our team conducted a heuristic evaluation and comparative evaluation to study the league website and contrast it with the features and usability of other league websites. Next, we conducted formal usability tests to closely observe users working with the site. Both existing players and potential players were recruited for the study.
We found that overall, the users were satisfied with the website. However, our heuristic evaluation and usability tests showed that the website was not optimized for its critical workflows like league registration and finding pickup game information.
Result
Our team prepared a final report and presented the league organizing body with five specific actionable recommendations for improving the site.