UsabilityWorks is Dana Chisnell

User experience research, workshops, and recruiting.

Dana Chisnell

We all pretend that these bios are written by someone else. We write them in the third person, and everything. But we all know that the person who the bio is about writes the bio.So, here I am.

What’s important about user research is understanding how best to answer the question you have. Getting the question right is tricky. I’m not an academic purist – I like to play with methods and techniques. I’ve come up with some weird approaches to answering research questions. Sometimes they even work.

Factoids:

  • I co-authored one of the seminal books about usability testing with Jeff Rubin, Handbook of Usability Testing Second Edition. It came out in 2008, and it’s still pretty relevant.
  • I like teaching non-practitioners like designers, developers, and product managers how to do user research and usability testing because I believe that you can’t make a great design without experiencing what your user is experiencing.
  • My first usability test was in 1983 (for IBM on the Professional Office System).

Slides

Rethinking user research for the social web

While the Web has evolved from flat documents to being fluidly ambient, we’re using user research methods from 1994. In this session, Dana presents 5 major issues confronting UXers working in the social web, challenges you to creative solutions, and shares experiences from pioneering researchers.

Watch the video of this talk from ConveyUX in 2013 in Seattle.

Or, check out the slides, below.


Slides

Gaining design insights from your research recruiting process

I gave a virtual seminar for UIE in October 2013 about how to look at recruiting participants for studies as bonus user research.

You can get the archived seminar from UIE.

Or, have a look at the slides.


Crowd-sourced research: trusting a network of co-researchers

In the fall of 2012, I seized the opportunity to do some research I’ve wanted to do for a long time. Millions of users would be available and motivated to take part. But I needed to figure out how to do a very large study in a short time. By large, I’m talking about reviewing hundreds of websites. How could we make that happen within a couple of months?

Do election officials and voters talk about elections the same way?

I had BIG questions. What were local governments offering on their websites, and how did they talk about it? And, what questions did voters have?  Finally, if voters went to local government websites, were they able to find out what they needed to know? Continue reading.


Testing

Just follow the script: Working with pro and proto-pro co-researchers

She wrote to me to ask if she could give me some feedback about the protocol for a usability test. “Absolutely,” I emailed back, “I’d love that.”

By this point, we’d had 20 sessions with individual users, conducted by 5 different researchers. Contrary to what I’d said, I was not in love with the idea of getting feedback at that moment, but I decided I needed to be a grown-up about it. Maybe there really was something wrong and we’d need to start over.

That would have been pretty disappointing – starting over – because we had piloted the hell out of this protocol. Even my mother could do it and get us the data we needed. I was deeply curious about what the feedback would be, but it would be a couple of days before the concerned researcher and I could talk. Continue reading.


Pocket Guide!

Coming soon…

There’s a usability testing revival going on. I don’t know if you know that.

This new testing is leaner, faster, smarter, more collaborative, and covers more ground in less time. How does that happen? Everyone on the team is empowered to go do usability testing themselves. This isn’t science, it’s sensible design research. At it’s essence, usability testing is a simple thing: something to test, somewhere that makes sense, with someone who would be a real user.

But not everyone has time to get a Ph.D. in Human Computer Interaction or cognitive or behavioral psychology. Most of the teams I work with don’t even have time to attend a 2-day workshop or read a 400-page manual. These people are brave and experimental, anyway. Why not give them a tiny, sweet tool to guide them, and just let them have at it? Let us not hold them back. Continue reading.


Article: Older adults

Heuristics for understanding older adults as web users

In 2004, Ginny Redish and I, along with Amy Lee, conducted a review of the relevant literature — research by other people — about designing for older adults (people over age 50). Doing this changed my thinking about universal design.

 

It wasn’t enough to generate design heuristics. We also came up with ways to operationalize them. That is, you can actually test to see if you have implemented these design practices by answering several questions about each heuristic.

 

Here’s an article from Technical Communication (which, by the way, was the runner-up for best article of the year for that publication) in which we describe the project, list the heuristics, and talk about some of our results in using them.

 


Report: Older adults

Designing for older adults: Reviewing 50 websites

 

AARP, an American organization for people over age 50, commissioned Ginny Redish and me to give them a scorecard of how well the Web was supporting older people in terms of design. We weren’t to evaluated sites only directed at older adults, but do conduct a broad review of sites that regular people might encounter on any given day, regardless of age.

Ginny and I came up with an unusual method to do this review: persona-based, task-driven heuristic evaluation. Very simply, we tried to take on the personalities of one of two personas, Matthew and Edith, as we did tasks they would do on sites they would normally visit. And then we rated those interactions against a set of heuristics for good design for older people.

See the results. Though this report was published several years ago (2005), the findings are pretty solid.


Analysis

Ending the opinion wars: fast, collaborative design direction

I’ve seen it dozens of times. The team meets after observing people use their design, and they’re excited and energized by what they saw and heard during the sessions. They’re all charged up about fixing the design. Everyone comes in with ideas, certain they have the right solution to the remedy frustrations users had. Then what happens?

On a super collaborative team everyone is in the design together, just with different skills. Splendid! Everyone was involved in the design of the usability test, they all watched most of the sessions, they participated in debriefs between sessions. They took detailed, copious notes. And now the “what ifs” begin:

What if we just changed the color of the icon? What if we made the type bigger? What if we moved the icon to the other side of the screen? Or a couple of pixels? What if? Continue reading.


Preparing

The importance of rehearsing

Sports teams drill endlessly. They walk through plays, they run plays, they practice plays in scrimmages. They tweak and prompt in between drills and practice. And when the game happens, the ball just knows where to go.

This seems like such an obvious thing, but we researchers often poo-poo dry runs and rehearsals. In big studies, it is common to run large pilot studies to get the kinks out of an experiment design before running the experiment with a large number of participants.

But I’ve been getting the feeling that we general research practitioners are afraid of rehearsals. One researcher I know told me that he doesn’t do dry runs or pilot sessions because he fears that makes it look to his team like he doesn’t know what he is doing. Well, guess what. The first “real” session ends up being your rehearsal, whether you like it or not. Because you actually don’t know exactly what you’re doing — yet. If it goes well, you were lucky and you have good, valid, reliable data. But if it didn’t go well, you just wasted a lot of time and probably some money. Continue reading.


Flash testing

Wilder than testing in the wild: usability testing by flash mob

It was a spectacularly beautiful Saturday in San Francisco. Exactly the perfect day to do some field usability testing. But this was no ordinary field usability test. Sure, there’d been plenty of planning and organizing ahead of time. And there would be data analysis afterward. What made this test different from most usability tests?

  • 16 people gathered to make 6 research teams
  • Most of the people on the teams had never met
  • Some of the research teams had people who had never taken part in usability
    testing before
  • The teams were going to intercept people on the street, at libraries, in farmers’
  • markets Continue reading.