Showing posts with label usability study. Show all posts
Showing posts with label usability study. Show all posts

Friday, March 02, 2007

Usability for Children - Lessons Learned

Recently at Enquiro, we performed a Usability Study on a children's website for kids between the ages of 8 and 11. The study itself was a success, and there was enough valuable information to keep the site owners busy for some time to come, though it did open our eyes to working with children.

Below I've listed a few of the things that you should consider if you plan on performing a Usability Study with a younger demographic.

  1. Assure them that this is not a test, especially if they just came from school. Kids are so used to being tested at school, but not really used to people asking for their opinion on, well, anything, so this is foreign to them.

  2. Ensure that the study isn't too long. If what you're studying is not a cartoon, then make sure you're not forcing them to sit still for too long. A half hour was pushing it for some of the children we had participating in the study.

  3. Be accommodating with your time. Children are on much more of a schedule than you are, especially younger ones, so be flexible to when the children are available, they are, after all, the most important part of your study.

  4. Realize that recruiting a target sample of children is not an exact science. Your target may be fairly specific (for instance, 8-11 year olds), but realize that there are very young 8 year olds as well as very old 11 year olds out there.

  5. Don't compensate them like adults. Instead of handing over a $50 bill, which to you might seem adequate, consider the example of the Dentist you had as a child. For me the best part, and only reason I agreed to go to the Dentist, was that at the end of it all, i got to open up the drawer with all the toys in it. I'm not suggesting a toy drawer, but consider how to adequately compensate a 10 year old.
Anyways, these are simply a few things to keep in mind when considering a study with a younger demographic. All things considered though, I would really recommend doing a study like this because there's nothing like seeing children's sites through the eyes of a child.

This is the first generation to really have had computers in their life since the time that they were born. While many of us learned about and grew into the internet, almost every decision that these 8-11 year olds have had to make is in some way influenced by the internet. Even a number of social activities are centered around communities on the internet, there are neopets and penguins to take care of after all.

Friday, November 17, 2006

Engagement vs. Recall - Small Eye-Tracking Usability Study

Recently at Enquiro, I performed a private study for one of our clients who services both B2C and B2B customers with a fairly short consideration process. Because it was a private study, I am not at liberty to share the name of the organization, but I did want to share some of the findings, as I thought they might be of interest to you.

This was a fairly small usability study, consisting of 2 groups of 5 users. These users were prompted with either (1) a stripped back text based page with a selection of information, one text based and one simple graphical call-to-action or (2) a graphic intensive page, including engaging imagery, much more visual calls-to-action integrated into that imagery, and the same selection of information as the text based page and a video element.

Where we found the biggest difference, as indicated by the title of the article, was between the engagement on the page and the recall of information. It was expected that participants would be able to recall more of the information from the text oriented page, and this expectation was met, recalling 3 times as much specific information as those viewing the alternate graphic page.

But this appeared to be where the benefits of the text based page ceased. As mentioned above, there was one simple graphical call-to-action on this page that, according to our eye-tracking of each of the participants, appeared to have performed like a fish out of water. This is indicated by the white box in the heatmap on the left. Instead of an attractant, this element acted to deflect the eyes of the participants, causing a banner blindness effect, even though the call-to-action fit well into the organization's look and feel.

What this shows is that each page has its own momentum, if you're going to give the user a primarily text based page, then design accordingly, by placing the calls-to-action inline and be sure that they are mainly text based themselves.

As for the Graphic based page, participants found it difficult to recall specific information after viewing the graphic based page, however, they did have a considerably higher impression and comfort level with it. They were more willing to visually explore each of the page areas, more willing to take it all in.

By reviewing actions on the page during the sessions as well as responses from an exit survey that were collected there was a considerable variation in the level of impression between both types of pages. When converting the likert scale to numerical values, the Graphic page scored a 29 out of a possible 35 when participants were asked to rate their level of comfort with submitting a quote on this site, as compared to a score of 23 for the Text based page. And when comparing how quickly and easily they felt they could have submitted a quote, the variation widened further, with the participants from the Graphic session scoring 30 out of 35 compared to 22 by the Text based participants.

The elements on the Graphic page struck a level of comfort with the participants, which, depending on who you talk to, is worth more to you than your customer remembering specific information. The participants from the Graphic page session took a feeling away with them, a feeling that they will associate with the brand going forward.

Specifically those participants who viewed the video embedded into the page. Which was a 30 second commercial spot, allowing the blend of offline and online marketing efforts to engage the potential customer. One of those participants even made a point of expressing specifically that she "felt they really care about me" after watching the spot. Not only that, but after viewing, she was far more willing to spend much more time on the site.

All in all, you can learn a little bit from everyone. In this case it really showed that, by beginning with the end in mind, your customer or potential customer can always leave with what's important to them. If it's facts, then display it like facts, if it's a feeling, then generate a feeling, just know what it is you want them to leave with, otherwise you might both be empty handed.

Wednesday, October 11, 2006

Usability and Omniture Analytics in the B2B Field

Qualitative and Quantitative, Yin and Yang… There is not enough talk between the two worlds. In most Usability studies, professionals are tasked with improving the user experience, including the reduction of errors, time on task and subjective impression of a site without consideration for measuring quantifiable metrics. Site improvement recommendations, user feedback and observations are gathered, poured over and delivered to the client for the improvement of the site in question. Though the majority of usability professionals are not currently using any type of quantifiable metrics (as documented by the Usability Professionals Association in a survey from the summer of 2005), it is widely agreed upon that there should be standardized metrics in place for tracking the ROI for user-centered design processes. But with the business-to-business field, this can be a long cycle before any improvement is seen, as it is understood that the purchasing funnel is far more diverse and considerably longer than any business-to-consumer transaction.

Just recently, Omniture released a paper discussing the 5 Most Critical Steps to Track in B2B Online Marketing, which is a powerful piece that simply outlines ways to track some of the most important metrics in the B2B field. Not only does it outline these steps in a simple and tactical way, it inadvertently acknowledges, at least in a couple of areas, the best ways to track the success of usability improvements. In this document, they discuss the fact that the "B2B Buying Cycle encompasses a series of micro-conversions as prospects progress through different phases," and that these micro-conversions can act as "leading indicators of offline sales," allowing you to see improvement online and assume improvement offline, depending on the integration of your offline sales metrics to your analytics. Now, with any Usability Study, you will need a problem to fix, whether it’s known and you have some hypotheses about what to expect and how to approach the issue, or it’s unknown and is flushed out during the process of testing; but if these are being performed on a B2B type site, then the known issue can likely be tagged to any one or combination of these types of micro-conversions, or if the issue arises through testing, then creating a dashboard to measure the improvement historically as well as after the fact should be a simple process. These micro-conversions can be something as simple as video views, product comparison tools or case study downloads, depending on the target you are testing against and the issue you have on the site.

This brings up the point that, if you do not have any type of analytics in place like Omniture Sitecatalyst, or Hitbox, then ROI or online measurement are terms that you should put out of your mind. Keep things relatively qualitative and measure your offline successes and customer feedback. But if you do have an analytics solution, then you have an immediate way to quantify the success of your qualitative usability study.