Last year, the government of Quebec asked Cognitive Group to do a heuristic evaluation (expert evaluating usability with a list of usability heuristics) and usability testing of their web portal. First, heuristic evaluation is not reliable because:
A few years ago, I was in a group that got lost during a hiking trip. One member of the group said “I know the way out. We just have to turn right and walk in that direction for 10 minutes; we will see a little farmhouse and the road to civilization”. He was sure of himself. We followed his lead but after 15 minutes of walking, no sign of the little farmhouse. The group began questioning the direction. After a while, it became obvious that we were led in the wrong direction. This leader failed and the magnitude of his failure was greater because of the high degree of confidence he expressed.
This graph shows the evolution of George W. Bush’s approval rating over time. His approval rating rose to 68% in March 2003, at Continue reading
The levels at which impacts of change are major are not understood while the levels at which impacts are minor are easily understood.