Evaluation Process

Evaluation Process for Best Usability

Stage 1: Pre-screening
After nominations close, the nominated Informational Websites will be pre-screened based on GovTech’s Digital Services Standards: Principles 1 and 2, to ensure nominees fulfil baseline standards of intuitivity, usability, accessibility, and inclusivity. The Top 10 nominees that fulfil all or the most standards will proceed to the next round and be included in the Most Popular Informational Website award.

Stage 2: Top 10 Evaluation by Judges
The panel of judges will evaluate the Top 10 nominees based on Nielsen Norman’s Group 10 Usability Heuristics for User Interface Design, Web Content Accessibility Guidelines (WCAG) 2.2, and their own expert domain knowledge. The Top 3 nominees that achieve the best scores will move on to the next round.

Stage 3: Top 3 Evaluation by Citizens
A minimum of 100 Citizen Evaluators including Persons with Disabilities (PwDs) will assess the Top 3 nominees based on the System Usability Scale (SUS). The nominee that receives the highest combined score from the Judges and Citizen Evaluation will be announced as the winner of Best Usability during the award ceremony.

Evaluation Process for Most Popular Informational Website

Stage 1: Pre-screening
After nominations close, the Top 10 nominations for the Best Usability Award will automatically be included in the Most Popular Informational Website award category. The nominated Informational Websites will be pre-screened based on GovTech’s Digital Services Standards: Principles 1 and 2, to ensure nominees fulfil baseline standards of intuitivity, usability, accessibility, and inclusivity. The Top 10 nominees that fulfil all or the most standards will proceed to the next round.

Stage 2: Top 10 Evaluation by Live Voting during Award Ceremony
Only registered event attendees will be able to vote for the Most Popular Informational Website during the award ceremony, and the results will be revealed live during the event.

Evaluation Process for Most Mobile Optimised Website

Stage 1: Pre-screening
After nominations close, the nominated Informational Websites will be pre-screened based on 3 Google Lighthouse mobile scores: Performance, SEO, and Accessibility.

Stage 2: Top 10 Evaluation by Judges
The panel of judges will evaluate the Top 10 nominees based on page load speed, user interface, navigation, mobile responsiveness, and accessibility. Bonus points will be awarded for innovative or unique mobile optimisations that enhance the user experience.

Evaluation Process for Most User-Centric Website (Government)

Stage 1: Pre-screening
After nominations close, the nominated Informational Websites will be pre-screened based on whether they have onboarded WOGAA sentiments and leveraged at least one citizen community, such as CrowdTask, Tech Kaki, or the SNA Citizen Co-creation Group, or equivalent for feedback collection.

Stage 2: Top 10 Evaluation by Judges
The panel of judges will evaluate the Top 10 nominees based on several criteria including customer feedback collection methods, consistency, frequency, feedback analysis, feedback implementation, and enhancements to user experience. Bonus points will be awarded for innovations in feedback collection methods, adaptability to changing user needs, and proactiveness in anticipating user needs.

Evaluation Process for Outstanding Citizen Contributor

Whole-of-Government
Stage 1: Pre-screening
After nominations close, an internal pre-screening will be conducted to sieve out nominations that do not meet the criteria.

Stage 2: Top 3 Evaluation by Judges
The panel of judges will evaluate the nominees to select the Top 3 nominations based on a matrix consisting of several criteria like impact, scale, participation, and contribution.

Tech Kaki
The Top 3 Tech Kaki community members with the highest participation rate in Tech Kaki engagements for the year will be selected as the winners.

CrowdTaskSG
The Top 3 most active CrowdTaskSG users during the year will be selected as the winners.

Evaluation Process for Remaining Award Categories

Winners for the following categories will be selected based on technical scores:
The categories “Best Accessibility”, “Best Search Engine Optimisation”, “Best Customer Satisfaction for Transactional Services”, “Best Functionality” and “Best Improvement” are evaluated using the Whole-of-Government Application Analytics (WOGAA) platform.