Every day, we are bombarded with a range of stimulus we must review in order to engage with the world around us. To this end, communication materials are often designed to either catch our attention (i.e., make us use them) and convey an idea (i.e., foster comprehension). To date, however, little research has examined both the abilities for a given visual design to catch our attention and foster effective comprehension. This proposed project would use a three part method to gather the qualitative and the quantitative data needed to asses how well different approaches to design address aspects of both attention and comprehension within the context of the same document. By researching this topic, this project can contribute to a number of fields – medical communication, technical communication, document design, etc. – that focus on conveying specialized/technical information to lay audiences.
Impetus for the project
As technical communication scholars and practitioners, our research is concerned with how information is delivered to potential readers. Complex information from technical subjects, such as medicine, science, and the environment, creates additional challenges. Because our lives are filled with a continual flow of information we must interpret to understand our world, sometimes the best — or even the only — way to communicate is visually. But how can we leverage the visual (the way the page/screen looks and also the use of charts and graphs) to communicate complex ideas to non-expert audiences? To better understand this situation, let us start with three concepts:
Data visualization is using visuals to present large amounts of data according to certain parameters or categories (e.g., the collection of data into charts, graphs, or scatter plots).
Information design is the overall appearance of the page (or screen) that includes data visualization, accompanying explanatory text, headings, and other layout features to present a more comprehensive message.
Attention Comprehension Gap is the gap between a communiqué’s ability to draw an individual’s attention to information and the reader’s ability to comprehend that information. In a well-designed artifact, the gap between attracting a person’s attention and the individual’s ability to comprehend ideas is small to non-existent. The bigger the gap, the more likely it is the reader will not comprehend the information (St.Amant & Meloncon, 2015).
Currently, information design research is dispersed across a range of fields making it difficult to build a coherent body of scholarship that could lead to best practices. Much research either focuses on attention or on comprehension (see Lipkus, 2007; Neuner-Jehle, et. al., 2011; Sha & Freedman, 2011). Communication researchers (Houts, 2006) have, in turn, examined improving the visual nature of health communication, but they, too, do not address attention and comprehension simultaneously. Though theorists have posited ways to create visualizations of complex information (see Hegarty, 2011; Schriver, 1999; Tufte, 2001) researchers have failed to empirically test these theories with potential users of the data (Kimball, 2013).
This research project intends to empirically examine the attention comprehension gap in information design by answering two questions:
- What types of documents gain readers’ attention?
- How do we assess participants’ comprehension of the information in a document?
What will we be doing?
While visuals help draw attention and aid in comprehension, “inappropriate information formats are often used” (Gigerenzer, et. al., 2008, p. 52-53), which led us to the notion of usability, or “the degree to which something – software, hardware or anything else – is easy to use and a good fit for the people who use it.” One way to determine if something is usable is to “test” it with the intended audience. For this project, a research team comprised of three principal investigators, will use a triangulated research methodology to test/compare a typical, text-based document (Figure 1), a visually enhanced version of the text-based document (Figure 2), and an information graphic of the same information (Figure 3) to determine how well each attracts reader attention and fosters reader’s comprehension of the information.
Method 1: Document review with interviews
We will ask a larger number of users (e.g.,100+ individuals) to
- Review the same data displayed using the three different formats of information design (Figures 1-3).
- Summarize the information conveyed via each format to determine comprehension and readability levels of each sample.
Through one-on-one interviews with subjects, the research team will gather qualitative data about which visual representation was the most comprehensible and why.
Method 2: Eye tracking technology
We will use an Eyeguide mobile tracker eye-tracking device to monitor how readers review the same three kinds of documents to gather quantitative data about where users actually look on a page or a screen. This quantitative data helps us understand how individuals locate information, how long they stay on a certain feature, and what features draw the most visual attention. This data will also help us understand best ways to produce visual representations and how to incorporate those representations into documents for lay audiences.
Methods 1 and 2 would be done simultaneously. The central idea is technical communicators need to simultaneously collect quantitative data on attention and qualitative data on comprehension for the same item (St.Amant & Meloncon, 2015) to test the ability of an item to attract the user’s attention and determine how well users comprehend the information being presented.
Method 3: Focus groups
We will conduct focus groups to further identify what information design features best-enabled comprehension of the data. This allows us to gather additional qualitative information on perceptions, preferences, and expectations related to the readability of documents.
This triangulated approach using both quantitative and qualitative methods ensures the rigor, validity and reliability of the study, and it also lays the groundwork for replication studies to continue to test and modify the attention-comprehension gap theory.
Research participants will be recruited from existing relationships with community based projects in Ohio and Southeast Texas. What is unique about these community based projects is that each represents a specific under served population, which will hopefully lead us to answers about solving issues around health disparities and information delivery.
Note: Figures 1-3 are samples and are not meant to represent the actual data that will be used. They are meant to show the different types of information design that will be used.
What’s the significance of this project?
My primary field, technical communication, has long been concerned with issues of information design, but what the field lacks is empirically tested best practices that can then be shared in other disciplines. It’s like an evidence-based methodology to gain insights into the comprehension of health information. Thus, the significance is
- Create best practices in information design, which provides multiple fields (such as technical communication, psychology, health promotion and education), a way to present complex information to non-expert audiences
- Develop ethical standards for reporting complex information to non-expert audiences
- Provide evidence on the most effective and comprehensible data visualizations for non-expert audiences
- Advance a new theory in the field of technical communication
- Offer sound methodological framework for research study design in the field of technical communication