Chapter Seven: Presenting Your Results
This chapter serves as the culmination of the previous chapters, in that it focuses on how to present the results of one's study, regardless of the choice made among the three methods. Writing in academics has a form and style that you will want to apply not only to report your own research, but also to enhance your skills at reading original research published in academic journals. Beyond the basic academic style of report writing, there are specific, often unwritten assumptions about how quantitative, qualitative, and critical/rhetorical studies should be organized and the information they should contain. This chapter discusses how to present your results in writing, how to write accessibly, how to visualize data, and how to present your results in person.
Written Presentation of Results
Once you've gone through the process of doing communication research – using a quantitative, qualitative, or critical/rhetorical methodological approach – the final step is to communicate it.
The major style manuals (the APA Manual, the MLA Handbook, and Turabian) are very helpful in documenting the structure of writing a study, and are highly recommended for consultation. But, no matter what style manual you may use, there are some common elements to the structure of an academic communication research paper.
Title Page:
This is simple: Your Paper's Title, Your Name, Your Institutional Affiliation (e.g., University), and the Date, each on separate lines, centered on the page. Try to make your title both descriptive (i.e., it gives the reader an idea what the study is about) and interesting (i.e., it is catchy enough to get one's attention).
For example, the title, "The uncritical idealization of a compensated psychopath character in a popular book series," would not be an inaccurate title for a published study, but it is rather vague and exceedingly boring. That study's author fortunately chose the title, "A boyfriend to die for: Edward Cullen as compensated psychopath in Stephanie Meyer's Twilight," which is more precisely descriptive, and much more interesting (Merskin, 2011). The use of the colon in academic titles can help authors accomplish both objectives: a catchy but relevant phrase, followed by a more clear explanation of the article's topic.
Abstract:
In some instances, you might be asked to write an abstract, which is a summary of your paper that can range in length from 75 to 250 words. If it is a published paper, it is useful to include key search terms in this brief description of the paper (the title may already have a few of these terms as well). Although this may be the last thing your write, make it one of the best things you write, because this may be the first thing your audience reads about the paper (and may be the only thing read if it is written badly). Summarize the problem/research question, your methodological approach, your results and conclusions, and the significance of the paper in the abstract.
Quantitative and qualitative studies will most typically use the rest of the section titles noted below. Critical/rhetorical studies will include many of the same steps, but will often have different headings. For example, a critical/rhetorical paper will have an introduction, definition of terms, and literature review, followed by an analysis (often divided into sections by areas of investigation) and ending with a conclusion/implications section. Because critical/rhetorical research is much more descriptive, the subheadings in such a paper are often times not generic subheads like "literature review," but instead descriptive subheadings that apply to the topic at hand, as seen in the schematic below. Because many journals expect the article to follow typical research paper headings of introduction, literature review, methods, results, and discussion, we discuss these sections briefly next.
Introduction:
As you read social scientific journals (see chapter 1 for examples), you will find that they tend to get into the research question quickly and succinctly. Journal articles from the humanities tradition tend to be more descriptive in the introduction. But, in either case, it is good to begin with some kind of brief anecdote that gets the reader engaged in your work and lets the reader understand why this is an interesting topic. From that point, state your research question, define the problem (see Chapter One) with an overview of what we do and don't know, and finally state what you will do, or what you want to find out. The introduction thus builds the case for your topic, and is the beginning of building your argument, as we noted in chapter 1.
By the end of the Introduction, the reader should know what your topic is, why it is a significant communication topic, and why it is necessary that you investigate it (e.g., it could be there is gap in literature, you will conduct valuable exploratory research, or you will provide a new model for solving some professional or social problem).
Literature Review:
The literature review summarizes and organizes the relevant books, articles, and other research in this area. It sets up both quantitative and qualitative studies, showing the need for the study. For critical/rhetorical research, the literature review often incorporates the description of the historical context and heuristic vocabulary, with key terms defined in this section of the paper. For more detail on writing a literature review, see Appendix 1.
Methods:
The methods of your paper are the processes that govern your research, where the researcher explains what s/he did to solve the problem. As you have seen throughout this book, in communication studies, there are a number of different types of research methods. For example, in quantitative research, one might conduct surveys, experiments, or content analysis. In qualitative research, one might instead use interviews and observations. Critical/rhetorical studies methods are more about the interpretation of texts or the study of popular culture as communication. In creative communication research, the method may be an interpretive performance studies or filmmaking. Other methods used sometimes alone, or in combination with other methods, include legal research, historical research, and political economy research.
In quantitative and qualitative research papers, the methods will be most likely described according to the APA manual standards. At the very least, the methods will include a description of participants, data collection, and data analysis, with specific details on each of these elements. For example, in an experiment, the researcher will describe the number of participants, the materials used, the design of the experiment, the procedure of the experiment, and what statistics will be used to address the hypotheses/research questions.
Critical/rhetorical researchers rarely have a specific section called "methods," as opposed to quantitative and qualitative researchers, but rather demonstrate the method they use for analysis throughout the writing of their piece.
Helping your reader understand the methods you used for your study is important not only for your own study's credibility, but also for possible replication of your study by other researchers. A good guideline to keep in mind is transparency. You want to be as clear as possible in describing the decisions you made in designing your study, gathering and analyzing your data so that the reader can retrace your steps and understand how you came to the conclusions you formed. A research study can be very good, but if it is not clearly described so that others can see how the results were determined or obtained, then the quality of the study and its potential contributions are lost.
Results:
After you completed your study, your findings will be listed in the results section. Particularly in a quantitative study, the results section is for revisiting your hypotheses and reporting whether or not your results supported them, and the statistical significance of the results. Whether your study supported or contradicted your hypotheses, it's always helpful to fully report what your results were. The researcher usually organizes the results of his/her results section by research question or hypothesis, stating the results for each one, using statistics to show how the research question or hypothesis was answered in the study.
The qualitative results section also may be organized by research question, but usually is organized by themes which emerged from the data collected. The researcher provides rich details from her/his observations and interviews, with detailed quotations provided to illustrate the themes identified. Sometimes the results section is combined with the discussion section.
Critical/rhetorical researchers would include their analysis often with different subheadings in what would be considered a "results" section, yet not labeled specifically this way.
Discussion:
In the discussion section, the researcher gives an appraisal of the results. Here is where the researcher considers the results, particularly in light of the literature review, and explains what the findings mean. If the results confirmed or corresponded with the findings of other literature, then that should be stated. If the results didn't support the findings of previous studies, then the researcher should develop an explanation of why the study turned out this way. Sometimes, this section is called a "conclusion" by researchers.
References:
In this section, all of the literature cited in the text should have full references in alphabetical order. Appendices: Appendix material includes items like questionnaires used in the study, photographs, documents, etc. An alphabetical letter is assigned for each piece (e.g. Appendix A, Appendix B), with a second line of title describing what the appendix contains (e.g. Participant Informed Consent, or New York Times Speech Coverage). They should be organized consistently with the order in which they are referenced in the text of the paper. The page numbers for appendices are consecutive with the paper and reference list.
Tables/Figures:
Tables and figures are referenced in the text, but included at the end of the study and numbered consecutively. (Check with your professor; some like to have tables and figures inserted within the paper's main text.) Tables generally are data in a table format, whereas figures are diagrams (such as a pie chart) and drawings (such as a flow chart).
Accessible Writing
As you may have noticed, academic writing does have a language (e.g., words like heuristic vocabulary and hypotheses) and style (e.g., literature reviews) all its own. It is important to engage in that language and style, and understand how to use it to communicate effectively in an academic context. Yet, it is also important to remember that your analyses and findings should also be written to be accessible. Writers should avoid excessive jargon, or—even worse—deploying jargon to mask an incomplete understanding of a topic.
The scourge of excessive jargon in academic writing was the target of a famous hoax in 1996. A New York University physics professor submitted an article, "Transgressing the Boundaries: Toward a Transformative Hermeneutics of Quantum Gravity," to a special issue of the academic journal Social Text devoted to science and postmodernism. The article was designed to point out how dense academic jargon can sometimes mask sloppy thinking. As the professor, Alan Sokal, had expected, the article was published. One sample sentence from the article reads:
It has thus become increasingly apparent that physical "reality", no less than social "reality", is at bottom a social and linguistic construct; that scientific "knowledge", far from being objective, reflects and encodes the dominant ideologies and power relations of the culture that produced it; that the truth claims of science are inherently theory-laden and self-referential; and consequently, that the discourse of the scientific community, for all its undeniable value, cannot assert a privileged epistemological status with respect to counter-hegemonic narratives emanating from dissident or marginalized communities. (Sokal, 1996. pp. 217-218)
According to the journal's editor, about six reviewers had read the article but didn't suspect that it was phony. A public debate ensued after Sokal revealed his hoax. Sokal said he worried that jargon and intellectual fads cause academics to lose contact with the real world and "undermine the prospect for progressive social critique" (Scott, 1996). The APA Manual recommends to avoid using technical vocabulary where it is not needed or relevant or if the technical language is overused, thus becoming jargon. In short, the APA argues that "scientific jargon...grates on the reader, encumbers the communication of information, and wastes space" (American Psychological Association, 2010, p. 68).
Data Visualization
Images and words have long existed on the printed page of manuscripts, yet, until recently, relatively few researchers possessed the resources to effectively combine images combined with words (Tufte, 1990, 1983). Communication scholars are only now becoming aware of this dimension in research as computer technologies have made it possible for many people to produce and publish multimedia presentations.
Although visuals may seem to be anathema to the primacy of the written word in research, they are a legitimate way, and at times the best way, to present ideas. Visual scholar Lester Faigley et al. (2004) explains how data visualizations have become part of our daily lives:
Visualizations can shed light on research as well. London-based David McCandless specializes in visualizing interesting research questions, or in his words "the questions I wanted answering" (2009, p. 7). His images include a graph of the peak times of the year for breakups (based on Facebook status updates), a radiation dosage chart, and some experiments with the Google Ngram Viewer, which charts the appearance of keywords in millions of books over hundreds of years.
The public domain image below creatively maps U.S. Census data of the outflow of people from California to other states between 1995 and 2000.
Visualizing one's research is possible in multiple ways. A simple technology, for example, is to enter data into a spreadsheet such as Excel, and select Charts or SmartArt to generate graphics. A number of free web tools can also transform raw data into useful charts and graphs. Many Eyes, an open source data visualization tool (sponsored by IBM Research), says its goal "is to 'democratize' visualization and to enable a new social kind of data analysis" (IBM, 2011). Another tool, Soundslides, enables users to import images and audio to create a photographic slideshow, while the program handles all of the background code. Other tools, often open source and free, can help visual academic research into interactive maps; interactive, image-based timelines; interactive charts; and simple 2-D and 3-D animations. Adobe Creative Suite (which includes popular software like Photoshop) is available on most computers at universities, but open source alternatives exist as well. Gimp is comparable to Photoshop, and it is free and relatively easy to use.
One online performance studies journal, Liminalities, is an excellent example of how "research" can be more than just printed words. In each issue, traditional academic essays and book reviews are often supported photographs, while other parts of an issue can include video, audio, and multimedia contributions. The journal, founded in 2005, treats performance itself as a methodology, and accepts contribution in html, mp3, Quicktime, and Flash formats.
For communication researchers, there is also a vast array of visual digital archives available online. Many of these archives are located at colleges and universities around the world, where digital librarians are spearheading a massive effort to make information—print, audio, visual, and graphic—available to the public as part of a global information commons. For example, the University of Iowa has a considerable digital archive including historical photos documenting American railroads and a database of images related to geoscience. The University of Northern Iowa has a growing Special Collections Unit that includes digital images of every UNI Yearbook between 1905 and 1923 and audio files of UNI jazz band performances. Researchers at he University of Michigan developed OAIster, a rich database that has joined thousands of digital archives in one searchable interface. Indeed, virtually every academic library is now digitizing all types of media, not just texts, and making them available for public viewing and, when possible, for use in presenting research. In addition to academic collections, the Library of Congress and the National Archives offer an ever-expanding range of downloadable media; commercial, user-generated databases such as Flickr, Buzznet, YouTube and Google Video offer a rich resource of images that are often free of copyright constraints (see Chapter 3 about Creative Commons licenses) and nonprofit endeavors, such as the Internet Archive, contain a formidable collection of moving images, still photographs, audio files (including concert recordings), and open source software.
Presenting your Work in Person
As Communication students, it's expected that you are not only able to communicate your research project in written form but also in person.
Before you do any oral presentation, it's good to have a brief "pitch" ready for anyone who asks you about your research. The pitch is routine in Hollywood: a screenwriter has just a few minutes to present an idea to a producer. Although your pitch will be more sophisticated than, say, "Snakes on a Plane" (which unfortunately was made into a movie), you should in just a few lines be able to explain the gist of your research to anyone who asks. Developing this concise description, you will have some practice in distilling what might be a complicated topic into one others can quickly grasp.
Oral presentation
In most oral presentations of research, whether at the end of a semester, or at a research symposium or conference, you will likely have just 10 to 20 minutes. This is probably not enough time to read the entire paper aloud, which is not what you should do anyway if you want people to really listen (although, unfortunately some make this mistake). Instead, the point of the presentation should be to present your research in an interesting manner so the listeners will want to read the whole thing. In the presentation, spend the least amount of time on the literature review (a very brief summary will suffice) and the most on your own original contribution. In fact, you may tell your audience that you are only presenting on one portion of the paper, and that you would be happy to talk more about your research and findings in the question and answer session that typically follows. Consider your presentation the beginning of a dialogue between you and the audience. Your tone shouldn't be "I have found everything important there is to find, and I will cram as much as I can into this presentation," but instead "I found some things you will find interesting, but I realize there is more to find."
Turabian (2007) has a helpful chapter on presenting research. Most important, she emphasizes, is to remember that your audience members are listeners, not readers. Thus, recall the lessons on speech making in your college oral communication class. Give an introduction, tell them what the problem is, and map out what you will present to them. Organize your findings into a few points, and don't get bogged down in minutiae. (The minutiae are for readers to find if they wish, not for listeners to struggle through.) PowerPoint slides are acceptable, but don't read them. Instead, create an outline of a few main points, and practice your presentation.
Turabian suggests an introduction of not more than three minutes, which should include these elements:
- The research topic you will address (not more than a minute).
- Your research question (30 seconds or less)
- An answer to "so what?" – explaining the relevance of your research (30 seconds)
- Your claim, or argument (30 seconds or less)
- The map of your presentation structure (30 seconds or less)
As Turabian (2007) suggests, "Rehearse your introduction, not only to get it right, but to be able to look your audience in the eye as you give it. You can look down at notes later" (p. 125).
Poster presentation
In some symposiums and conferences, you may be asked to present at a "poster" session. Instead of presenting on a panel of 4-5 people to an audience, a poster presenter is with others in a large hall or room, and talks one-on-one with visitors who look at the visual poster display of the research. As in an oral presentation, a poster highlights just the main point of the paper. Then, if visitors have questions, the author can informally discuss her/his findings.
To attract attention, poster presentations need to be nicely designed, or in the words of an advertising professor who schedules poster sessions at conferences, "be big, bold, and brief" (Broyles, 2011). Large type (at least 18 pt.), graphics, tables, and photos are recommended.
A poster presentation session at a conference, by David Eppstein (Own work) [CC-BY-SA-3.0 (www.creativecommons.org/licenses/by-sa/3.0)], via Wikimedia Commons]
The Association for Education in Journalism and Mass Communication (AEJMC) has a template for making an effective poster presentation. Many universities, copy shops, and Internet services also have large-scale printers, to print full-color research poster designs that can be rolled up and transported in a tube.
Judging Others' Research
After taking this course, you should have a basic knowledge of research methods. There will still be some things that may mystify you as a reader of other's research. For example, you may not be able to interpret the coefficients for statistical significance, or make sense of a complex structural equation. Some specialized vocabulary may still be difficult.
But, you should understand how to critically review research. For example, imagine you have been asked to do a blind (i.e., the author's identity is concealed) "peer review" of communication research for acceptance to a conference, or publication in an academic journal. For most conferences and journals, submissions are made online, where editors can manage the flow and assign reviews to papers. The evaluations reviewers make are based on the same things that we have covered in this book. For example, the conference for the AEJMC ask reviewers to consider (on a five-point scale, from Excellent to Poor) a number of familiar research dimensions, including the paper's clarity of purpose, literature review, clarity of research method, appropriateness of research method, evidence presented clearly, evidence supportive of conclusions, general writing and organization, and the significance of the contribution to the field.
Beyond academia, it is likely you will more frequently apply the lessons of research methods as a critical consumer of news, politics, and everyday life. Just because some expert cites a number or presents a conclusion doesn't mean it's automatically true. John Allen Paulos, in his book A Mathematician reads the newspaper, suggests some basic questions we can ask. "If statistics were presented, how were they obtained? How confident can we be of them? Were they derived from a random sample or from a collection of anecdotes? Does the correlation suggest a causal relationship, or is it merely a coincidence?" (1997, p. 201).
Through the study of research methods, we have begun to build a critical vocabulary and understanding to ask good questions when others present "knowledge." For example, if Candidate X won a straw poll in Iowa, does that mean she'll get her party's nomination? If Candidate Y wins an open primary in New Hampshire, does that mean he'll be the next president? If Candidate Z sheds a tear, does it matter what the context is, or whether that candidate is a man or a woman? What we learn in research methods about validity, reliability, sampling, variables, research participants, epistemology, grounded theory, and rhetoric, we can consider whether the "knowledge" that is presented in the news is a verifiable fact, a sound argument, or just conjecture.
References
American Psychological Association (2010). Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.
Broyles, S. (2011). "About poster sessions." AEJMC. http://www.aejmc.org/home/2013/01/about-poster-sessions/.
Faigley, L., George, D., Palchik, A., Selfe, C. (2004). Picturing texts. New York: W.W. Norton & Company.
IBM (2011). Overview of Many Eyes. http://www.research.ibm.com/social/projects_manyeyes.shtml.
McCandless, D. (2009). The visual miscellaneum. New York: Collins Design.
Merskin, D. (2011). A boyfriend to die for: Edward Cullen as compensated psychopath in Stephanie Meyer's Twilight. Journal of Communication Inquiry 35: 157-178. doi:10.1177/0196859911402992
Paulos, J. A. (1997). A mathematician reads the newspaper. New York: Anchor.
Scott, J. (1996, May 18). Postmodern gravity deconstructed, slyly. New York Times,http://www.nytimes.com/books/98/11/15/specials/sokal-text.html.
Sokal, A. (1996). Transgressing the boundaries: towards a transformative hermeneutics of quantum gravity. Social Text 46/47, 217-252.
Tufte, E. R. (1990). Envisioning information. Cheshire, CT: Graphics Press.
Tufte, E. R. (1983). The visual display of quantitative information. Cheshire, CT: Graphics Press.
Turabian, Kate L. (2007). A manual for writers of research papers, theses, and dissertations: Chicago style guide for students and researchers (7th ed.). Chicago: University of Chicago Press.