Brave NUI World: Designing Natural User Interfaces for Touch and Gesture

Paperback (Print)
Used and New from Other Sellers
Used and New from Other Sellers
from $11.20
Usually ships in 1-2 business days
(Save 73%)
Other sellers (Paperback)
  • All (11) from $11.20   
  • New (5) from $23.07   
  • Used (6) from $11.20   


Touch and gesturaldeviceshave been hailed as next evolutionary step in human-computer interaction. As software companies struggle to catch up with one another in terms of developing the next great touch-based interface, designers are charged with the daunting task of keeping up with the advances innew technology and this new aspect to user experience design.

Product and interaction designers, developers and managers are already well versed in UI design, but touch-based interfaces have added a new level of complexity. They need quick references and real-world examples in order to make informed decisions when designing for these particular interfaces. Brave NUI World is the first practical book for product and interaction developers and designing touch and gesture interfaces. Written by developers of industry-first, multi-touch, multi-user products, this book gives you the necessary tools and information to integrate touch and gesture practices into your daily work, presenting scenarios, problem solving, metaphors, and techniques intended to avoid making mistakes.

• Provides easy-to-apply design guidance for the unique challenge of creating touch- and gesture-based user interfaces

• Considers diverse user needs and context, real world successes and failures, and a look into the future of NUI

• Presents thirty scenarios, giving practitioners a multitude of considerations for making informed design decisions and helping to ensure that missteps are never made again

Read More Show Less

Editorial Reviews

From the Publisher
"Brave Nui World by Daniel Wigdor and Dennis Wixon is a must read for anyone involved in creating compelling user interfaces using modern technology and who, after testing, say ‘Why didn’t that design work the way it was intended?’ To novices in the field, it will read as a how-to guide. For seasoned designers, it reads like a novel where you suspect the outcome but there is usually a twist in the plot, giving you that extra idea to think again. I genuinely enjoyed it and I am not likely to put it away soon."-Paul Neervoort, Lead User Experience Design, Philips Design

"A good grounding framework that immediately kindles ideas of how best to use NUI. Based on the developments of the past few decades, it provides solid foundations of NUI and develops these with the use of specific examples. While this isn't a cookbook, it does provide clear thematic guidance on how to make your NUI experience excel. The book covers basic through to advanced concepts in a very clear way. Good for reference, but even better if you read it cover to cover - you will grow immeasurably."—Dylan Evans, Principal Usability Consultant, Veluuria

"Interfaces are moving beyond our usual computers and into many facets of our lives. The way we design these interfaces is changing too.Brave NUI Worldhelps highlight the new considerations you will need when designing for NUIs."—Daniel Naumann, User Experience Designer

Read More Show Less

Product Details

  • ISBN-13: 9780123822314
  • Publisher: Elsevier Science
  • Publication date: 4/27/2011
  • Pages: 264
  • Sales rank: 1,037,744
  • Product dimensions: 7.50 (w) x 9.20 (h) x 0.70 (d)

Meet the Author

Daniel Wigdor is an Assistant Professor of computer science at the University of Toronto. Before joining U of T, he worked at Microsoft in nearly a dozen different roles, among them serving as the User Experience Architect of the Microsoft Surface product, and as a cross company expert in the creation of Natural User Interfaces. Before joining Microsoft, he previously conducted research in advanced user interfaces and devices at Mitsubishi Electric Research Labs, and at the Initiative in Innovative Computing at Harvard University. He is also co-founder of Iota Wireless, a company dedicated to the commercialization of NUI technologies for mobile phones. Daniel’s work has been described in dozens of publications in leading international conferences, journals, and books. His is the recipient of a Wolfond Fellowship and an ACM Best Paper Award.

Dennis Wixon is currently Discipline Lead for Microsoft US BPD. Prior to this role he was the head of research for Microsoft Surface, and has also managed research teams at Microsoft Game Studies, and MSN/Home Products. Before joining Microsoft, Dennis managed the usability team at Digital Equipment Corporation, where a number of important usability methods such as Usability Engineering and Contextual Inquiry were developed. Dennis has been an active member of the user-research community for over 25 years. He co-chaired CHI 2002 served as Vice President for Conferences for ACM SIGCHI. Dennis has co-authored over sixty articles, book chapters and presentations on research methods and theory. He is an adjunct Full Professor in the Human Centered Design and Engineering Department at University of Washington and co-edited with Dr. Judy Ramey the book Field Methods Case Book for Software Design. Dennis holds a Ph.D. in Social Psychology from Clark University.

Read More Show Less

Read an Excerpt

Brave NUI World

Designing Natural User Interfaces for Touch and Gesture
By Daniel Wigdor Dennis Wixon

Morgan Kaufmann

Copyright © 2011 Elsevier Inc.
All right reserved.

ISBN: 978-0-12-382232-1

Chapter One


All things will be produced in superior quantity and quality, and with greater ease, when each man works at a single occupation, in accordance with his natural gifts, and at the right moment, without meddling with anything else.Plato

In the decades since the first digital computers were programmed using mechanical switches and plug boards, computing and the ways in which people interface with computers have evolved significantly. Some aspects of this evolution have both been anticipated and withstood the test of time. Moore's law is an example. The law states that the number of transistors that can be placed inexpensively on an integrated circuit will double approximately every two years. The trend that this law describes has created opportunities for the growth of computing and its adoption into many aspects of our lives. As computers have increased in power and decreased in size and cost, new form factors have been created (e.g., smart phones, PDAs, and digital cameras), new platforms have evolved (e.g., the Internet), new infrastructures have become widely available (e.g., GPS), new industries have arisen (e.g., computer games), and new application families (e.g., spreadsheets, document processing, image creation, modification and sharing) have flourished. All of these trends have resulted in the democratization of computing as the number of people directly interacting with computers has steadily increased. This proliferation of computing has transcended national boundaries and permeated nearly all economic classes. It has changed the way people work, play, and interact with one another.

While the increase in computing power has been more or less continuous, the interfaces between human and computers have evolved more discontinuously. A widely held perspective is that interfaces have passed through phases. These phases are loosely defined but can be thought of as the phase of typing commands (the command line), followed by the graphical user interface (GUI). More specifically, most computers with which people interact regularly are based on the desktop metaphor (so called because windows are allowed to overlap, like paper atop a desk) and rely on a known set of user interface elements, commonly referred to as WIMP: windows, icons, menus, and pointers.

During that evolution some other contenders for the predominant interface, such as menu-only systems, did not attain dominance or widespread use. Instead, they were limited to niche applications, such as ATMs and televisions. A deeper analysis would show that many popular applications contain elements of each style. In effect, they are hybrids. For example, typical GUIs make use of menus (pull-down menus) and forms (dialog boxes and property sheets). In some cases, such as spreadsheets, the interaction style includes command-like elements, that is, complex formulas and sophisticated functions. Similarly, another class of successful applications, document processing, also introduces new concepts such as "what you see is what you get," (WYSIWYG) that is, what is on the screen is a reasonably faithful rendition of what will be printed. In both cases, the elements of the GUI are accompanied by particularly useful and appealing aspects that propelled these applications to wide adoption. It is important to be cognizant of the fact that these approaches are neither preordained nor task neutral. WYSIWYG, for example, fundamentally shapes the way people spend their time composing text—simultaneously focusing on both form and content.

While a thoughtful interpretation of the history of human-computer interaction is complex and nuanced, certain generalizations are evident. The way in which humans interact with computers has evolved. That evolution has enabled more people to do more things with computers. It has led to a vast and rapid increase of the volume, scope, and diversity of the computer business.

There are many perspectives from which we could view this evolution. Some are merely tautological. For example, a common view is that more people use more computation because the barriers have been reduced and the functionality of the machines has increased. While true, that characterization provides precious little insight. To provide it some intellectual weight, we need to be clearer with respect to what barriers have been reduced and which functions have been provided. It is also useful to examine closely the development of certain computing "niches," which thrive in limited but well-defined contexts.

Some of the early analysis of the GUI provided just this kind of deeper insight. Analysts pointed out that recognizing and choosing were easier than remembering then typing. In other words, with its menus, dialog boxes, icons, and familiar work spaces, the WIMP GUI represented a lower barrier for users than a command line interface. This difference becomes clearer if we consider specific applications. By and large, it is easier to learn and use a word processor to create simple documents than to edit in a markup language. In addition, the often-overlooked advantage of the computer, that is, that it produces revisable work products, was fully realized with a word processing system.

Functionality gains are also apparent for most users. Before the computer, a skilled typesetter could produce formatted documents, but the average citizen was confined to typing final work products in a mono-spaced font, with cumbersome correction tools. The combination of reduced thresholds for learning, easier recall, increased functionality for the average user, the reduced cost promised by Moore's law, and the widespread capability to revise one's work without redoing it signaled the explosive growth of a number of well-featured and -designed applications that adopted the desktop computer and the subsequent consignment of more traditional approaches to specialized niches.

When the desktop GUI was first created and made widely available, its ultimate fate was unclear. It was derided by many experts who coined its current name: the WIMP interface. Although WIMP stood for windows, icons, menus, and a pointer, it implied that the users of the GUI were not the manly men who had mastered the previous, more arcane ways of interacting with computers. Ultimately, those supposedly more manly folks were consigned to the social position of specialists or hobbyists. We can see this pattern in many other domains: personal transport, cooking, penmanship, and CB radio operators.

Now we stand at the brink of another potential evolution in computing. Natural user interfaces (NUIs) seem to be in a position similar to that occupied by the GUI in the early 1980s. Like the desktop GUIs, NUIs promise to reduce the barriers to computing still further, while simultaneously increasing the power of the user, and enabling computing to access still further niches of use. But just as GUIs did not simply make command systems easier, NUIs are not simply a natural veneer over a GUI. Instead, like GUIs, NUIs have a set of strengths based on what they make easier, how they make those things easier, how they shape the user's interaction with technology, which niches they fit in, and whether or not these niches expand to dwarf the space occupied by traditional GUIs.

When examining this history and anticipating the future, we should not be distracted by single instances. Many of these will be failures and will not represent any overall trend. The failure of makes and models of some cars did not end the phase of personal transport. The failure of many GUI products and the inevitable consolidation of the marketplace did not impede the overall growth of personal computing or prevent GUIs from pre-eminence. It is as dangerous to generalize to the future based on a few examples as it is hard to anticipate the future when looking from our current perspective.

In this book we do not aim to provide an exhaustive overview of the NUI. We do not predict the future of human-computer interaction. We do not assume the predominance of NUI-based designs. We do not provide a complete set of rules for creating a successful NUI, because NUI is not yet at a state of evolution or standardization to allow for such a definition.

We can make some relatively safe predictions. NUIs are here to stay. They either will find a successful niche, like menu system ATMs, or will come to dominate the computer landscape. If the latter comes to pass, we can still expect GUIs to persist in specialized environments. The ultimate evolution of the NUI will be determined not by the analysts and the critics, but by those who step forward and take the risk to build true NUI applications. Here we offer a way to think about NUIs that is counter to the predominant metaphor. This perspective on the NUI suggests that NUIs provide an enjoyable way for novices to move quickly and seemingly effortlessly to skilled practitioners. This approach involves more than being "natural" or intuitive. It means that the domain of use and the requirements of context are carefully assessed. It also means that the conventions of the GUI should be studiously ignored. It requires careful design and rigorous research. We give some guidance on how to do those things and how to re-conceptualize the NUI.

We offer a number of essays on the NUI and on methods that can be utilized to achieve it, written from the perspective of two journeyman user experience experts who have had the opportunity to immerse themselves in the nitty-gritty of designing, engineering, building, testing, researching, and shipping multiple products that have come to define the category. Overall, the essays are intended to provide a nuanced set of perspectives on NUI systems. These perspectives range from specific descriptions of the syntax and semantics of the NUI to broad analyses of the NUI in terms of the history of computing. Each essay is composed of the same essential elements. Each concludes with specific, concrete design guidelines meant to help take words into action. Those guidelines are divided into three types: must, those that we believe are necessary conditions to achieving a natural-feeling experience; should, those elements that, while nonessential, have been found to add greatly to achieving such an experience; and could, those guidelines that may apply only to certain contexts or situations.

To frame our collection, we offer a framework that we have evolved for the general process of the creation of a gesture-based natural user interface. The sections of this book reflect the phases of this process, and individual chapters provide thoughts, tools, and methods for implementing it. This framework is an evolution of classic methods for designing interactive systems, with the addition of elements unique to the creation of a fundamentally new way of interacting (Figure 1.1).


Excerpted from Brave NUI World by Daniel Wigdor Dennis Wixon Copyright © 2011 by Elsevier Inc. . Excerpted by permission of Morgan Kaufmann. All rights reserved. No part of this excerpt may be reproduced or reprinted without permission in writing from the publisher.
Excerpts are provided by Dial-A-Book Inc. solely for the personal use of visitors to this web site.

Read More Show Less

Table of Contents

Part I: Introduction

  1. Introduction
  2. The Natural User Interface
  3. Ecological Niche: Computing and the Social Environment & Ways of Working
  4. Part II: Design Ethos of NUI

  5. Less is More
  6. Contextual Environments
  7. Spatial
  8. Social
  9. Seamless
  10. Super Real
  11. Scaffolding
  12. User Differentiation
  13. Part III: New Technologies: Understanding & Technological Artefacts

  14. The State-Model of Input Devices
  15. Fat Fingers
  16. No Touch Left Behind
  17. Touch vs. In-Air Gestures
  18. Part IV: Creating an Interaction Language

  19. MDA Revisited
  20. New Primitives
  21. Anatomy of a Gesture
  22. Makes a good Gesture Language
  23. Self-Revealing Gestures
  24. Mode and Flow of a Gesture System
  25. Part V: No such thing as Touch

  26. Know your platform: Vision, Resistive, Capacitive, etc.
  27. The Fundamentals Have to Work
  28. Number of Contacts
  29. Contact Data: Shape, Pressure, and Hover
  30. Vertical/Horizontal/Mobile
  31. Part VI: Process: How do You Get There?

  32. NUI UDI (User Defined Interface) and the Myth of the ‘Natural Gesture Set’.
  33. False Recognition
  34. RITE With a Purpose

Part VII: Conclusion

30. Conclusion: A word About Engineering

Read More Show Less

Customer Reviews

Be the first to write a review
( 0 )
Rating Distribution

5 Star


4 Star


3 Star


2 Star


1 Star


Your Rating:

Your Name: Create a Pen Name or

Barnes & Review Rules

Our reader reviews allow you to share your comments on titles you liked, or didn't, with others. By submitting an online review, you are representing to Barnes & that all information contained in your review is original and accurate in all respects, and that the submission of such content by you and the posting of such content by Barnes & does not and will not violate the rights of any third party. Please follow the rules below to help ensure that your review can be posted.

Reviews by Our Customers Under the Age of 13

We highly value and respect everyone's opinion concerning the titles we offer. However, we cannot allow persons under the age of 13 to have accounts at or to post customer reviews. Please see our Terms of Use for more details.

What to exclude from your review:

Please do not write about reviews, commentary, or information posted on the product page. If you see any errors in the information on the product page, please send us an email.

Reviews should not contain any of the following:

  • - HTML tags, profanity, obscenities, vulgarities, or comments that defame anyone
  • - Time-sensitive information such as tour dates, signings, lectures, etc.
  • - Single-word reviews. Other people will read your review to discover why you liked or didn't like the title. Be descriptive.
  • - Comments focusing on the author or that may ruin the ending for others
  • - Phone numbers, addresses, URLs
  • - Pricing and availability information or alternative ordering information
  • - Advertisements or commercial solicitation


  • - By submitting a review, you grant to Barnes & and its sublicensees the royalty-free, perpetual, irrevocable right and license to use the review in accordance with the Barnes & Terms of Use.
  • - Barnes & reserves the right not to post any review -- particularly those that do not follow the terms and conditions of these Rules. Barnes & also reserves the right to remove any review at any time without notice.
  • - See Terms of Use for other conditions and disclaimers.
Search for Products You'd Like to Recommend

Recommend other products that relate to your review. Just search for them below and share!

Create a Pen Name

Your Pen Name is your unique identity on It will appear on the reviews you write and other website activities. Your Pen Name cannot be edited, changed or deleted once submitted.

Your Pen Name can be any combination of alphanumeric characters (plus - and _), and must be at least two characters long.

Continue Anonymously
Sort by: Showing 1 Customer Reviews
  • Posted August 27, 2011


    Are you planning on building an application or platform for the next generation input hardware? If you are, then this book is for you! Authors Daniel Wigdor and Dennis Wixon, have done an outstanding job of writing a book that hopefully will convince you of the necessity; as well as, the opportunity and challenge of creating fundamentally new user interfaces for that hardware. Wigdor and Wixon, begin by explaining why NUI is not a natural user interface, but rather an interface that males your user act and feel like a natural. In addition, the authors describe why the NUI will evolve into subspecies that will be well adapted to given social and business niches. They then explain why creating successful NUI applications requires attention to the mechanics of interaction and the constraints of the domain. The authors then, consider the relationship of environmental context to a gestural NUI. The authors continue by showing you why the use of effective 3-D space can significantly enhance the experience with a NUI. In addition, the authors explain why seamlessness is one of the necessary characteristics of the NUI. They then show you why one part of the promise of the NUI is to make interaction with technology seem like magic. The authors then discuss why scaffolding is a powerful approach for creating rich NUI applications that are a pleasure to learn and use. Then, the authors discuss the challenge of identifying users in the NUI. They continue by showing you why the state-transition model of input devices provides an extremely useful tool to help you to understand the true utility of your input device, how it is the same as a mouse, and how it's different from a mouse. Next, the authors show you how designing your UI in such a way, allows users to reliably select content to ensure that they will always feel successful, like natural users of your interface. They then discuss why there are great advantages to direct-touch software; and, the tendency to reduce abstraction and allow direct interaction. In addition, the authors explain while touch and in-air gesturing may at first seem quite different from one another, there is only one significant subtlety that differentiates them: the live mic problem. They then explicate the MDA framework and apply it to the NUI. The authors then discuss why primitives make up the basic language of your interaction. Next, they show you why gesture registration is perhaps the most important step to design. In addition, the authors show you how thy have applied some of the concepts from Piaget's concepts of genetic epistomology to the design of a touch-based system. Finally, they explain why they hope and expect that NUIs will become the dominant form of human-computer interaction over the next few years . In this most excellent book, the authors did not aim to provide an exhaustive overview of the NUI. Perhaps more importantly, their broader goal was to move both the consideration of the NUI and the implementation of NUI systems forward.

    Was this review helpful? Yes  No   Report this review
Sort by: Showing 1 Customer Reviews

If you find inappropriate content, please report it to Barnes & Noble
Why is this product inappropriate?
Comments (optional)