Chapter Four: Quantitative Methods (Part 3 - Making Sense of Your Study)

Data Interpretation

Once you have run your statistics, you have to figure out what your findings mean or interpret your data. To do this, you need to tie back your findings to your research questions and/or hypotheses, think about how your findings relate to what you discovered beforehand about the already existing literature, and determine how your findings take the literature or current theory in the field further. Your interpretation of the data you collected will be found in the last section of your paper, what is commonly called the "discussion" section.

Remember Your RQs/Hs

Your research questions and hypotheses, once developed, should guide your study throughout the research process. As you are choosing your research design, choosing how to operationalize your variables, and choosing/conducting your statistical tests, you should always keep your RQs and Hs in mind.

What were you wanting to discover by your study? What were you wanting to test? Make sure you answer these questions clearly for the reader of your study in both the results and discussion section of the paper. (Specific guidelines for these sections will be covered later in this chapter, including the common practice of placing the data as you present it with each research question in the results section.)

Tie Findings to Your Literature Review

As you have seen in chapter 3 and the Appendix, and will see in chapter 7, the literature review is what you use to set up your quantitative study and to show why there is a need for your study. It should start out broad, with the context for your study, and lead into showing what still needs to be known and studied about your topic area, justifying your focus in the study. It will be brought in again in the last section of the paper you write, i.e., the discussion section.

Your paper is like an hourglass – starting out broad and narrowing down in the middle with your actual study and findings, and then moving to broad implications for the larger context of your study near the end.

Think about Relationship of Findings to Theory

One of the things you will write about in your discussion or last section of your paper is the implications of what you found. These implications are both practical and theoretical. Practical implications are how the research can provide practical applications to real-world people and issues. Theoretical implications are how the research takes the current academic literature further, specifically, in relationship to theory-building.

Did any of the research you reviewed for your literature review mention a theory your findings could expand upon? If so, you should think about how your findings related to this theory. If not, then think about the theories you have already studied in your communication classes. Would any of them provide a possible explanation of what you found? Would your findings help expand that theory to a different context, the context you studied? Does a theory need to be developed in the area of your research? If so, then what aspects of that theory could your findings help explain?

Data Write-Up

All quantitative studies, when written, have four parts. The first part is the introduction and literature review, the second part is the methods section, the third section is the results or findings, and the fourth section is the discussion section. This portion of this chapter will explain what elements you will need to include in each of these sections.

Literature Review

The beginning of your paper and first few pages sets the tone for your study. It tells the reader what the context of your study is and what other people who are also interested in your topic have studied about your topic.

There are many ways to organize a literature review, as can be seen in the following website.
Literature Reviews — The Writing Center at UNC-Chapel Hill

After you have done a thorough literature search on your topic, then you have to organize your literature into topics of some kind. Your main goal is to show what has been done and what still needs to be done, to show the need for your study, so at the end of each section of your literature review, you should identify what still needs to be known about that particular area.

For quantitative research, you should do your literature review before coming up with your research questions/hypotheses. Your questions and hypotheses should flow from the literature. This is different from the other two research methods discussed in this book, which do not rely so heavily on a literature review to situation the study before conducting it.

Methods

In the methods section, you should tell your reader how you conducted your study, from start to finish, explaining why you made the choices you did along the way. A reader should be able to replicate your study from the descriptions you provide in this section of your write-up. Common headings in the methods section include a description of the participants, procedures, and analysis.

Participants

For the participants' subheading of the methods section, you should minimally report the demographics of your sample in terms of biological sex (frequencies/percentages), age (range of ages and mean), and ethnicity (frequencies/percentages). If you collected data on other demographics, such as socioeconomic status, religious affiliation, type of occupation, etc., then you can report data for that also in the participants' sub-section.

Procedures

For the procedures sub-section, you report everything you did to collect your data: how you recruited your participants, including what type of sampling you used (probability or non-probability) and informed consent procedures; how you operationalized your variables (including your survey questions, which often are explained in the methods section briefly while the whole survey can be found in an appendix of your paper); the validity and reliability of your survey instrument or methods you used; and what type of study design you had (experimental, quasi-experimental, or non-experimental). For each one of these design issues, in this sub-section of the methods part, you need to explain why you made the decisions you did in order to answer your research questions or test your hypotheses.

Analysis

In this section, you explain how you converted your data for analysis and how you analyzed your data. You need to explain what statistics you chose to run for each of your research questions/hypotheses and why.

Results

In this section of your paper, you organize the results by your research questions/hypotheses. For each research question/hypothesis, you should present any descriptive statistic results first and then your inferential statistics results. You do not make any interpretation of what your results mean or why you think you got the results you did. You merely report your results.

Reporting Significant Results

For each of the inferential statistics, there is a typical template you can follow when reporting significant results: reporting the test statistic value, the degrees of freedom 3, and the probability level. Examples follow for each of the statistics we have talked about in this text.

T-test results

"T-tests results show there was a significant difference found between men and women on their levels of self-esteem, t (df) = t value, p < .05, with men's self-esteem being higher (or lower) (men's mean & standard deviation) than women's self-esteem (women's mean & standard deviation)."

ANOVA results

"ANOVA results indicate there was a significant difference found between [levels of independent variable] on [dependent variable], F (df) = F value, p < .05."

If doing a factorial ANOVA, you would report the above sentence for all of your independent variables (main effects), as well as for the interaction (interaction effect), with language something like: "ANOVA results indicate a significant main effect for [independent variable] on [dependent variable], F (df) = F value, p < .05. .... ANOVA results indicate a significant interaction effect between [independent variables] on [dependent variable], F (df) = F value, p < .05."

See example YouTube tutorial for writing up a two-way ANOVA at the following website.

Factorial Design (Part C): Writing Up Results

Chi-square results

For goodness of fit results, your write-up would look something like: "Using a chi-square goodness of fit test, there was a significant difference found between observed and expected values of [variable], χ2 (df) = chi-square value, p < .05." For test of independence results, it would like like: "Using a chi-square test of independence, there was a significant interaction between [your two variables], χ2 (df) = chi-square value, p < .05."

Correlation results

"Using Pearson's [or Spearman's] correlation coefficient, there was a significant relationship found between [two variables], r (df) = r value, p < .05." If there are a lot of significant correlation results, these results are often presented in a table form.

For more information on these types of tables, see the following website: 
Correlation Tables.

Regression results

Reporting regression results is more complicated, but generally, you want to inform the reader about how much variance is accounted by the regression model, the significance level of the model, and the significance of the predictor variable. For example:

For more write-up help on regression and other statistics, see the following website location:

Multiple Regression (pp. 217-220)

Reporting Non-Significant Results

You can follow a similar template when reporting non-significant results for all of the above inferential statistics. It is the same as provided in the above examples, except the word "non-significant" replaces the word "significant," and the p values are adjusted to indicate p> .05.

Discussion

Many times readers of articles do not read the whole article, especially if they are afraid of the statistical sections. When this happens, they often read the discussion section, which makes this a very important section in your writing. You should include the following elements in your discussion section: (a) a summary of your findings, (b) implications, (c) limitations, and (d) future research ideas.

Summary of Findings

You should summarize the answers to your research questions or what you found when testing your hypotheses in this sub-section of the discussion section. You should not report any statistical data here, but just put your results into narrative form. What did you find out that you did not know before doing your study? Answer that question in this sub- section.

Implications

You need to indicate why your study was important, both theoretically and practically. For the theoretical implications, you should relate what you found to the already existing literature, as discussed earlier when the "hourglass" format was mentioned as a way of conceptualizing your whole paper. If your study added anything to the existing theory on a particular topic, you talk about this here as well.

For practical implications, you need to identify for the reader how this study can help people in their real-world experiences related to your topic. You do not want your study to just be important to academic researchers, but also to other professionals and persons interested in your topic.

Limitations

As you get through conducting your study, you are going to realize there are things you wish you had done differently. Rather than hide these things from the reader, it is better to forthrightly state these for the reader. Explain why your study is limited and what you wish you had done in this sub-section.

Future Research

The limitations sub-section usually is tied directly to the future research sub-section, as your limitations mean that future research should be done to deal with these limitations. There may also be other things that could be studied, however, as a result of what you have found. What would other people say are the "gaps" your study left unstudied on your topic? These should be identified, with some suggestions on how they might be studied.

Other Aspects of the Paper

There are other parts of the academic paper you should include in your final write-up. We have provided useful resources for you to consider when including these aspects as part of your paper. For an example paper that uses the required APA format for a research paper write-up, see the following source: 
Varying Definitions of Online Communication.

Abstract & Titles.

Research Abstracts
General Format

Tables, References, & Other Materials.

APA Tables and Figures 1
Reference List: Basic Rules

Data Presentation

You will probably be called upon to present your data in other venues besides in writing. Two of the most common venues are oral presentations such as in class or at conferences, and poster presentations, such as what you might find at conferences. You might also be called upon to not write an academic write-up of your study, but rather to provide an executive summary of the results of your study to the "powers that be," who do not have time to read more than 5 pages or so of a summary. There are good resources for doing all of these online, so we have provided these here.

Oral Presentations

Oral Presentations
Delivering Presentations

Poster Presentations

Poster Presentations

Executive Summary

Executive Summaries Complete the Report
Good & Poor Examples of Executive Summaries with the following link:http://unilearning.uow.edu.au/report/4bi1.html

Conclusion

Congratulations! You have learned a great deal about how to go about using quantitative methods for your future research projects. You have learned how to design a quantitative study, conduct a quantitative study, and write about a quantitative study. You have some good resources you can take with you when you leave this class. Now, you just have to apply what you have learned to projects that will come your way in the future.

Remember, just because you may not like one method the best does not mean you should not use it. Your research questions/hypotheses should ALWAYS drive your choice of which method you use. And remember also that you can do quantitative methods!

References

Footnotes

3 Degrees of freedom (df) relate to your sample size and to the number of groups being compared. SPSS always computes the df for your statistics. For more information on degrees of freedom, see the following web-based resources: 
http://www.youtube.com/watch?v=wsvfasNpU2s and http://www.creative-wisdom.com/pub/df/index.htm.

Back to Previous Spot