Nielsen responds to mobile criticism

Nielsen responds to mobile criticism

The usability pro answers critics who have described his recent mobile recommendations as "backward"

Jakob Nielsen's recent post outlining his recommendations for mobile sites based on large-scale usability testing has come under fire from others in the industry. Here he responds to some of the main criticisms.

.net: The strategy of forking content for separate sites has been described as "a content strategy nightmare" – it's too hard to maintain and will result in inferior experience for users.
JN: I would assume that most industrial-scale sites would be generated from a single back-end product database and content management system, with the different designs represented by templates and rules about what information goes into what version.

Yes, this will still be more work to maintain than a simpler situation with a single set of templates. But the multi-site strategy should only be pursued by those companies that do substantial business with both desktop and mobile users. Many companies and government agencies have products and information that don't speak much to the mobile use case, and they can usually get away with having a single website that's optimised for desktop use but with some adaptations to make it reasonably accessible on mobile devices. Conversely, there may also be services such as Instagram that only really cater to mobile users and which don't make much sense on a desktop computer: such sites could have a single site optimised for mobile users and offer a substandard user experience to their few desktop users.

All of this is really a matter of budgets relative to the expected profits from serving customers better by optimising the user interface to their specific circumstances. Small organisations can't do so. Companies that make lots of money from each user should do so. In the extreme case, a company might need six different designs: feature phone, touch phone, mid-sized tablet, full-sized tablet, desktop computer, interactive TV. (See my article on transmedia design) Very few companies would actually deliver six designs. This would only be done by services like the weather forecast, sports scores, and stock quotes that are extremely widely used. The vast majority of companies that come to our training courses on mobile usability don't bother with feature phones anymore, even though they still account for the largest share of the world's users.

.net: Cutting out content for the mobile use case is problematic because for about 25 per cent of those who use the mobile web, it's their only use case they don't ever use a desktop browser. Aren't you treating those users as second class citizens if you cut mobile content?
JN: No, to treat users well, you should optimise their ability to do tasks with the device at hand. If somebody only has a mobile phone, they are ill served by a design that's awkward to use on mobiles. When you actually observe people attempting tasks on websites, you see a huge number of painful failures when the poor users are given full desktop sites.

Studies show that content is harder to comprehend when viewed through a small viewport with less context than what's visible on a bigger screen. Thus, we can enhance mobile users' understanding of the information by writing shorter content that's easier to understand. What matters is the amount of information in the user's brain, not the word count on the screen. And people understand more with content that's optimised for their device.

If users do want the longer and more complex information, they are always able to click through to the full site.

.net: When mobile users tap search engine results that refer to content on the full site, they're often redirected to the mobile URL. But if the content doesn't exist on mobile they get dumped on the homepage.
JN: This is a good point, and presumably the redirect should only happen for material that's actually available in a mobile format.

.net: Multiple URLs for a single piece of content is often thought of as a bad idea.
JN:There are at least three different ways of implementing different user interfaces for different devices:

  1. Each version lives at a different URL.
  2. The same URL serves up different versions, depending on the device used to request the page.
  3. The same code is transmitted to all devices, and the client side transforms this into the different designs, using responsive design.


As long as each user sees the appropriate design, the choice between these implementation options should be an engineering decision and not a usability decision.

.net: Why have you made no mention of using Responsive Design?
JN: Because I was writing about user experience, not implementation. As mentioned above, responsive design is one of the ways to achieve different user interfaces for different devices. It should be up to the engineers to determine the most efficient way of achieving the user experience goals. All we usability people should decide is how the site should work for users, not how this is implemented.

However, I do see some potential downsides of responsive design, compared to the other two solutions I mentioned above:

  • If all the code for all the different user interface designs are included in a single file, that becomes a lot of stuff to transmit to the user. This overhead wouldn't matter much to desktop users with broadband connections, but to mobile users on slow connections that are charged by the megabyte there are benefits to only having to download the exact code needed for their device.
  • The ideal design for mobile users involves splitting off secondary content and placing it on a secondary page, thus making the primary page shorter. Because desktop users have a bigger screen, you can present more content in the primary view. For sure, responsive design could hide the secondary content if it senses that it's working with a mobile device, and it could also make sure that the link to the secondary page is only shown to mobile users. But this does seem somewhat convoluted.

19 comments

Comment: 1

"responsive design could hide the secondary content if it senses that it's working with a mobile device"
Yuk. I don't think you've grasped what responsive design is all about.
This sounds like creating a desktop site and then adding lots of 'display:none' in the CSS for mobile (presumably using UA detection).
I'm so glad Josh Clark was there to provide a rebuttal.

Comment: 2

Neilsen completely breezes over the concept of serving scripts and styles in a granular way, based on the presence of corresponding client-side features. If I didn’t know better, I’d say it could almost be read as him saying “I have no idea how we could do this well, so I suppose it’s impossible.”

In fact: reading the above, one would almost think he doesn’t have a single responsive design to his name, and is pontificating in a total experiential vacuum here—coasting on the authority of being “an authority,” rather than practical experience, and peddling assumptions as fact.

_Weird_.

Comment: 3

Whilst I don't agree entirely with Nielsen, he does make some perfectly valid points. For our legacy, template based ecommerce solution it made much more sense to generate a specific set of mobile templates (effectively a mobile site) that don't provide all the secondary content you'd see on the desktop version of the site. Not only does this reduce the load on the client in terms of HTTP requests and page load size, but it also allows us to reduce the amount of processing we have to do on the server.

By utilising seperate templates to serve up the same content we can also leverage the SEO benefits established by the desktop site - particularly important if the desktop site has been around a while. We have discussed cutting the content on the mobile version (forking), but belive it would be better to ensure the content is streamlined in the first place (mobile first approach).

Nielsens point about allowing the user to achieve their goals based on the device they are using is perfectly understandable - this may mean reducing the content provided to the user, but the effect could certainly be an enhanced user experience and higher converion rates (whatever your goals maybe). I dont think this in anyway means mobile users are treated as second class.

Responsive design is a valid approach to many sites (and I personally love what you can achieve with this approach), but for content heavy sites a more streamlined, considered mobile approach is certainly a valid option.

Regardless of your views, this sort of discussion is required to move us all forwards.

Comment: 4

"All we usability people should decide is how the site should work for users, not how this is implemented."

That sure sounds a lot like "not my problem".

It seems to me, as a "usability person" you should be well versed in all the possible ways to implement your concepts, and their limitations, as they have direct bearing on the concept's success or failure.

Comment: 6

To wilto:

Yes, one could use the approach of sending a script down to the client that would then determine what files to retrieve from the server. Again, that's an engineering decision which would be fine with me as long as the goal of showing different designs to different devices is achieved. I suppose the choice might depend on whether one can send these multiple objects back and forth fast enough to avoid delays compared with the approach of just sending the correct file to begin with.

Actually I do use a bit of responsive design in my email newsletter (http://www.useit.com/alertbox/subscribe.html), because I picked up a template that includes a spot for the company logo. Nice as the NN/g logo is, it shouldn’t take up the top inch of the screen on mobile, so it's gone. I also removed some other prettifying elements that look nice on the desktop but aren't worth the space on mobile screens where I wanted the text to fill the entire screen. (And yes, I am sure much more could be done, but I just wanted a simple newsletter.)

To ChristianBoyle:

It is true that engineering decisions have usability consequences, just as usability decisions have engineering consequences. Even so, they are each the domain of the experts within the specific fields. In a real project, these experts should obviously work together, while leaving each person in charge of their specialty. To pick different examples: yes, the programmer should certainly be allowed to comment on the color scheme, but that's ultimately the graphic designer's job. And the graphic designer should certainly alert the writer to any typos spotted, but the content is ultimately the writer's job.

I happen to focus on user behavior, and sites do succeed in business by better matching users' needs. Setting users up to fail in the name of design purity is a sure way to lose money, as we have seen again and again ever since the dot-com bubble.

Comment: 7

'If all the code for all the different user interface designs are included in a single file, that becomes a lot of stuff to transmit to the user. This overhead...'

This is simply wrong. In a responsive design approach the html file is the only file which is always the same. The rest of the files, the css, the images can all be different, and the content which isn't needed on the mobile is not downloaded. There is no 'overhead'

Chris.

Comment: 8

I do not understand the anger towards Nielsen for pointing out the obvious. We should consider the user first when designing/developing, not our egos and abilities to cram as many large background images, sliders and javascript goodies into a site. We went through that stage before and it was not pleasant for the users. Personally, I, as a designer/developer, am getting more frustrated every day when I fire up my desktop and go to bloated sites. I should stress those bloated and slow sites are typically web news and tech community info sites. If we are designing sites like that for people in the field, I can only imagine the bloat in typical consumer sites. Nielsen is also correct that we should eliminate unneeded content "fluff" and make true content the priority. This does not mean we should make the design boring or lifeless, but instead view this as an opportunity to flex our design muscles. Lastly, responsive design has been brought up time and time again in the response to Nielsen's recommendations. I too like responsive design, but it is not appropriate in many situations because the info and features for mobile are often very different than for the desktop - ie, maps, forms that must be filled by a tiny keyboard, etc. Also, the mobile customer is not willing to wait for a site to download - 100 kb sites already push the patience level of mobile users. Imagine how long many responsive sites will take when delivered over wifi. People are accustomed to speed and will move on before it ever opens. Why remind them of their days on dial-up? Of course we can pretend the viewer's patience and usability is secondary to our designs and jquery tricks, but we will be proven wrong and more will opt for a native app over a responsive site "optimized" for mobile. Maybe now we can move on to a more serious issue that is headed our way - voice and its potential affect on websites.

Comment: 9

The domain of experts is constantly shifting.

It seems Nielsen's response highlights the issue of design and front-end development being a two man job.

The recent blurring between the front-end developer and designer over the last couple of years represents a a new wave of designers that take responsibility for the creation of the technology that drives their craft.

The criticism surrounding Neilsen's recent blog post stems deeper than responsive interfaces. Industry is crying out for designers that have a solid understanding of the front-end technologies that drive these decisions.

Comment: 11

The bottom line for me is that we are all going to have to accept that our jobs have become longer, harder and bigger than before because instead of designing just for desktop, we are now designing for a seemingly unlimited plethora of unending devices of various sizes with various different browsers.

My worry is this assumption people make that mobile devices are incapable of displaying desktop websites for a variety of reasons. First of all, connection speed. Here in the UK we have 3G coverage of around the 85% mark. Most of the time, unless you're half way up Ben Nevis, you are going to have a decent connection well into the several M'bit. A 3G dongle a colleague uses records speeds of up to 7.5m'bit - faster than a lot of peoples desktop connections. Therefore, whilst we should always keep weight down, it should be regardless of device and connection. If you're going to cut down page size for mobiles, why are you not already for desktops? If you correctly optimise for page speed, then mobile browsers shouldn't find your website to be slow.

Secondly, rendering and readability. Shock horror, smart phone browser have a feature that allows you to pinch to zoom in on a page. Most devices do this. This allows you to concentrate your viewing on the section of the page relevant to you. This means well structured desktop sites will almost always be perfectly readable and perfectly usable on a mobile browser. I run a music website, and it just so happens the normal desktop site works wonderfully on mobiles. Even fully zoomed out, I can easily read all of the text, and my pinch to zoom allows me to choose which areas of content I concentrate on. And yes, it's fast enough too, even without 3G.

Additionally, I find many "mobile optimized" or, indeed, separate mobile sites, extremely infuriating to use on my mobile. They are dumbed down. There's a distinct lack of content and function. The images are gone, the videos are gone. Everything about the web that makes it so rich and engaging is removed or dumbed down or simplified - and I'm thinking, but my phone is 100%, perfectly capable of displaying and working with images, videos and content. So why are you removing it all?

I'm not saying all mobile sites should be desktop sites. A lot of, a huge number of, desktop sites work very badly on mobiles. But it shouldn't be an assumption, because some desktop sites actually work perfectly via mobile, and further, this whole notion that mobile sites should lack content, rich media, engaging functions, is completely ridiculous and false.

Yes, make it fast. Yes, make it user friendly. Yes, make it work. But don't just assume that I don't want to watch a video, or see your slideshow, or play your game, just because I'm on a mobile device.

Comment: 12

"JN: Because I was writing about user experience, not implementation"

This is *exactly* why so many people took issue with Dr. Nielsen's statements: he did speak about implementation.

Some examples, straight from the alert box:

1. "Build a separate mobile-optimized site"

The fact that the mobile-optimized site needs to be separate is clearly about implementation. If the argument was made that there needs to be a separate experience for mobile users, I think nobody would have disagreed, but this is not what it says: it says there need to be two completely distinct sites.

2. "If mobile users arrive at your full site's URL, auto-redirect them to your mobile site"

Again, redirection is an implementation detail. Why does the URL for the mobile-optimized site need to be different from the regular site? Why not serve different content to different users at the same URL? Why not do this using CSS or JavaScript? How is having a separate URL beneficial for the user experience? This is not mentioned.

As it turns out, there *are* usability issues in having separate URLs for mobile and regular sites. For example, if I email or bookmark a link from my phone and later open it on a desktop computer, I get the wrong site. That's not to say that there is no place for separate mobile sites (especially when the mobile use case is clearly different from the desktop use case), but this an entirely different story.

There is plenty of wisdom in Nielsen's words, but the Mobile Site vs. Full Site is a moot point. The argument should have been "create a separate mobile-optimized experience" instead.

Comment: 13

Nielsen,

You are avoiding talking about responsive implementations claiming implementation and usability are separate yet you recommend implementing redirects. There are serious usability flaws with redirects because it involves maintaining lists of supported devices and introducing false positives (or negatives) when unknown device n arrives on the market. Also separating sites will create problems when linking and different sites. m.example.com can be shared from a phone to a desktop user who might want www.example.com. Why fracture your users when one link can do that job.

Leave page weight to us who implement websites. It is quickly becoming a non-issue with many people working on responsive images. I managed to get responsive CSS down to 4KB without gzip (not very styled, but responsive on a grid).

You just can’t argue for an implementation and then avoid talking about responsive web design because it is an implementation. Responsive web design is an implementation built around solving the usability issues of redirects.

Comment: 14

Sure, Mr. Nielsen, the usability guy, LITERALLY said "Build a separate mobile-optimized site." HE FRIGGIN' MENTIONED IMPLEMENTATION. He even slipped up (again) and said he didn't.

I know, I know.

But, let's try not to get tripped up in semantics or arguing the merits of RWD and miss the meaning of his research, which I find quite useful: mobile users require mobile-optimized content within a mobile-optimized experience.

Comment: 15

Mobile first - yes.
Contextual experiences - yes.
Redirection - no.

Comment: 16

I, like many others, am having a serious problem with Nielsen's idea that mobile users somehow use the web differently than those sitting behind a larger screen.

I am an avid mobile web user, and one only needs to stand in line for coffee here in Los Angeles to see that I am very much not alone. I use my phone, tablet and laptop all the time, and for very similar things. It is incredibly frustrating to find a site that truncates my experience simply because I am on a small screen.

Yes - show me a site that's laid out differently because it's on a smaller screen, that takes into account my current viewing window, but don't think I come to the web with different intentions just because I happen to be on my phone rather than my desktop.

Comment: 17

"If all the code for all the different user interface designs are included in a single file, that becomes a lot of stuff to transmit to the user. This overhead wouldn't matter much to desktop users with broadband connections, but to mobile users on slow connections that are charged by the megabyte there are benefits to only having to download the exact code needed for their device."

LOL.

Comment: 18

...am i missing something here? Responsive design also contributes to an improved user experience during the transition between optimal view points. Regardless of the platform, as long as the user has the ability to control the size of the view port on-the-fly, how could responsive content ever be detremental. It's the best thing to user experience since the fall of the loading screen.

I honestly beleive if you sat the top 100 web developers and UX experts in front of a random browser and web site, from their experience whilst on the site, they couldnt tell me if the page had 1 CSS file or 20. And the average visitor to a web site couldnt tell me what a server call was if it fell out the bottom of their monitor. Pedantic nonsense.

Video didn't kill the radio star!. And mobile phones will not kill the desktop. It simply won't happen. But while we're all still finding this out, what better way to cater for the lack of standardisation than a responsive solution.

Comment: 19

After extensively considering Jakob's article and numerous conversations with many of the vocal and outspoken industry figures who disagree, here's what I believe is the crux of the disagreement with Jakob. At a fundamental level, here are two recommendations that are mutually exclusive: 

1) Aim for content and feature parity between a mobile and a desktop web experience. Do the best you can to provide as much content parity as possible, in a presentation that is optimized to view all the same content on a mobile device. If, for some practical reason, you are unable to achieve content parity, provide a link to view the rest of the content in a presentation that is not optimized for mobile; a desktop site for example.

2) Do not aim for content and feature parity. Trim content so that you think you have provided all of the information a user might actually care about, and provide that content in a presentation that is optimized for view on a mobile device. For the rest of the content, provide a link to view the content in a presentation that is not optimized for mobile; a desktop site for example.

While, functionally, many businesses will ultimately find themselves unable to provide content parity, the differences in these two recommendations is that one recommends to provide access to all content and optimize the presentation of all of that content, and the other recommends to provide access to all content, and do not optimize the presentation of all content.

As a researcher and a source of usability recommendations, Nielsen should be *recommending* the optimal presentation, and should not be making a blanket recommendation for a likely but less desirable pragmatic fallback. 

Nielsen himself says in the article, "True, we've seen some underpowered and poorly designed mobile sites that would hardly satisfy anybody's mobile needs. But bad design that misinterprets a guideline is no reason to throw the baby out with the bathwater." 

However, he makes this exact mistake, throwing the baby out with the bathwater, when he says the simple truism, "The design challenge is to place the cut between mobile and full-site features in such a way that the mobile site satisfies almost all the mobile users' needs. If this goal is achieved, the extra interaction cost of following the link to the full site will be incurred fairly rarely." Of course if you do it right, you will have done it right. But he provides no argument for why it's better to cut content and hope no one will notice over including all content and knowing no one will notice. 

The unspoken premise in the original article seems to be the argument or claim that there is content that cannot be optimized for mobile, an entirely different argument than any Nielsen makes. He touches on it here talking about content length and content optimization, and these are valid points. But they point toward another issue, which is considering why, if content can be reduced and optimized for mobile, it shouldn't receive this optimization on all platforms.
June issue on sale now!

The Week in Web Design

Sign up to our 'Week in Web Design' newsletter!

Hosting Directory
.net digital edition
Treat yourself to our geeky merchandise!
site stat collection