How to conduct user research

UX for beginners

Joel Marsh Chapter 1. What Is User Research?

Ah, users. The sun in the UX solar system and the thorn in your side. One of the Sacred Laws of UX is “never blame the user,” even though—let’s be honest—sometimes it is really fucking tempting. However if you feel that way, you probably don’t understand your users well enough. Research is how we fix that.

Different People Will Say That User Research Happens at Different Stages in the Process

Some say you should do it first. Some say you make some drawings and do it then. Some say you do it after building a working product.

They are all right. There is never a bad time to do user research. Do it early, do it often. The important question isn’t when. It’s what. As in “what are you trying to learn about your users?”

There are two main types of information that you can get from research that involves people: subjective and objective.

Subjective Research

The word “subjective” means that it is an opinion, or a memory, or your impression of something. The feeling it gives you. The expectations it creates. Not a fact.

“What is your favorite color?”

“Do you trust this company?”

“Does my ass look fat in these pants?”

(i.e., There is no right answer.) To get subjective information you have to ask people questions.

Objective Research

The word “objective” means a fact. Something true. Something you can prove. Your opinion doesn’t change it, no matter how hard you wish.

“How long did you spend using our app?”

“Where did you find the link to our site?”

“What size are those pants?”

If people had perfect memories and never lied (especially to themselves), you could ask them about this stuff. If you find someone like that, let me know.

Objective data comes in the form of measurements and statistics. But, just because you can count something doesn’t make it objective or “data.”

The plural of “anecdote” is not “evidence.”

A wise person.

For example, if 102 people vote that something is good and 50 people vote that it’s bad, the only objective information you have is the number of people that voted. Whether it is “good” or “bad” is still a subjective opinion.

With me so far?

(If not, I will blame myself for explaining badly, not you for reading badly.)

Sample Size

As a general rule, more people makes for more reliable information, even if it is subjective. One opinion could be completely wrong. If a million people agree, it is a good representation of the crowd’s beliefs (but could still be false, objectively). So collect as much info as possible for your research.

Lots of subjective opinions can become... almost objective?! WTF

If you ask a crowd of people to guess the answer to something objective—like jelly beans in a jar—the average guess will often be pretty close to the real, objective, answer. But “wisdom of the crowd” about something subjective can also cause riots and get George W. Bush elected, so... yeah. Be careful. Subjective things can never be true; only more or less popular.

Chapter 2. What Isn’t User Research?

User research is very important and you should do it. But make sure you are asking users about what they think and feel, not what you should do next.

You Are Not Testing the Users; They Are Testing You

As the designer, you will be in a position of authority when you do user testing, but don’t let it go to your head. The users are testing your design. If they don’t do what you want them to do or if they don’t understand, that’s your fault, not theirs.

And if you lead them to the right answers by asking leading questions or giving them tips that normal users won’t get, the test is ruined. You ain’t proved nothin’. So when users are doing tests or giving answers, shut up and observe.