Evaluating Information--Part 2
Evaluating Content
Authored by Pamela Eyerdam and Ken Burhanna
The text only versions provide a linear presentation of the Hands-On flash modules. The Hands-On modules often incorporate images and interactive presentations to help demonstrate and support the text. These images and interactive features are lost in the text only format. Users can supplement their reading of the text versions by going onto the World Wide Web and visiting the web sites and doing the searches that the text indicates. This is most easily done by printing the text version and using it as a guide.
After completing this module you will be able to evaluate the content of information sources for:
1. Authority
2. Accuracy & Objectivity
3. Coverage, Audience & Appropriateness
Introduction
Content is information that is being distributed, whether in print, audio, video, or online format. In terms of your research, content is the information that is potentially relevant to your topic. It could be a book or journal article you've been looking for, or it could be a web site or government report.
In terms of your life, content represents the information that informs you about the world. Content evaluation skills will allow you to question and think critically about what you read in the newspaper, see on TV, or hear from your best friend.
This lesson will discuss skills and approaches to evaluating information content (regardless of format) once you find it.
1. Authority
Evaluating authority involves considering the author's or editor's credentials and the reputation and track record of the publisher.
Use the following questions to guide your evaluation of authority:
- What are the author's credentials, other publications?
- Is the author an expert in the field he or she is writing about?
- Has your instructor or another information source mentioned the author's
name?
- Is the author affiliated with an organization, institution, or university?
- Who is the publisher and what is their reputation?
Where to Look for Information on Authority
Usually publishers and authors wish to promote their strong reputations and status as experts. So the information is usually highlighted at the beginning or near the end of the source. This is especially true of books. Journal articles sometimes do not have the time or space to include author notes. In those cases, you might focus on the reputation of the journal itself.
Sometimes you might need to turn to other resources to establish the authority of a source. You might search for the author in a library catalog or index. More publishing credits usually indicate more authority. You might also look up the author in biographical sources like the Who's Who series from Marquis.
Evaluating Authority -- Exercise
Your writing topic is to compare and contrast two American literary magazines: their beginnings, successes, and current status.
Examine the following book citation and accompanying information. In your estimation, does this appear to be an authoritative source for your paper?
Chielens, Edward E., ed. American Literary Magazines: the Twentieth
Century. Westport, CT: Greenwood Press, 1992.
About the Editor (this information was located at the back of the book after the index):
Edward E. Cheilens is Chair of the English Division at Henry Ford Community College, Dearborn, Michigan. His publications include two annotated bibliographies, The Literary Journal in America to 1900 and The Literary Journal in America, 1900-1950, as well as American Literary Magazine: The Eighteenth and Nineteenth Centuries (Greenwood Press, 1986).
Other Notes
The book also includes contributor's notes for the 43 authors who contributed essays to the book. These authors are English professors, graduate students, and museum curators. More than two-thirds of them have been previously published.
What is your answer?
Yes, appears authoritative
No, not very authoritative
The correct answer is: Yes, it appears authoritative.
The editor is an English professor who has worked on three similar books. Also, the contributors notes indicate that many qualified scholars have contributed to the book.
This looks like a great information source for the assigned paper.
2. Accuracy & Objectivity
Accuracy and objectivity many times go hand-in-hand. For information to be accurate it usually needs to be objective.
Use the following questions to guide your evaluation of accuracy and objectivity:
- Does the source state objectives and then meet them?
- Does the source present facts, opinions, or propaganda?
- Is the content written with correct spelling and punctuation?
- Are points supported by evidence and/or citations to other sources?
- Does the information contradict with other information you've found?
- Do the authors display bias and/or emotional language?
- Does the source include a list of works cited at the end?
What to Look for Regarding Accuracy & Objectivity
Evidence of bias will show up in the author's word choice and his failure to consider opposing points of view.
Lapses in accuracy also will show from a lack of support. Works cited lists and citations within the text of a source are good faith indications of accuracy. You also need to compare and contrast what you know against what an author is telling you (or be willing to go verify what you are being told).
Evaluating Accuracy & Objectivity -- Exercise
You're researching the use of animals in research. You discovered the following article in the database Academic Search Premier. Explore the links below the citation and evaluate the article for accuracy and objectivity.
Keville, Kathi. "Compassionate Cosmetics." Better Nutrition. 64.6 (Jan
2002): 58-62.
The opening paragraphs of the article
Have you ever seen a rabbit wearing rouge? Or a mouse in mascara? Of course not. Then why has the cosmetics industry traditionally tested its personal-care products on animals? Conventional wisdom has maintained that animal testing identifies substances that can be harmful to humans, and therefore makes products safer. But is this really the case?
"Many regulators feel more comfortable with animal tests-even with tests that are known to be unreliable and of questionable relevance," says Michael Balls, head of the European Centre for the Validation of Alternative Methods in Ispra, Varese, Italy. The questionability Balls refers to arises because the skin, hair and eyes of an animal can react quite differently from those of a human-especially in tests where animals receive extremely large doses applied over a long duration. And several studies conducted during the past 30 years have indicated that animal testing simply does not accurately predict human responses.
Works Cited in Article
No works are cited within or at the end of this article. The author does quote several people from companies and organizations who speak against animal testing. The author mentions "...several studies...(that) have indicated that animal testing simply does not accurately predict human responses," but does not cite a single study by name. Additional resources appear at the end of the article. They were provided by PETA (People for the Ethical Treatment of Animals).
What is your answer?
Yes, the article appears objective and accurate.
No, the article may not be accurate, objectivity is questionable.
The correct answer is:
No, the article may not be accurate, objectivity is questionable.
This article does not provide a balanced view of the subject. No citations or references to supporting material are given. The author actually seems to assume the reader already agrees with her point of view.
Remember, your evaluation needs to be independent of your views on an issue. Even if you agree with this author, you must acknowledge that the author has presented a one-sided view. Also, the information in the article may be accurate, but the author has failed to provide the support in this article to make that clear.
3. Coverage, Audience, & Appropriateness
The author's intended audience will determine the coverage he or she gives the subject, and your information needs in relation to this coverage will determine the appropriateness of the source for your research.
Use the following questions to guide your evaluation of coverage, audience, and appropriateness:
- Does the source cover your topic in depth or only superficially?
- Is the material primary or secondary?
- Is the publication aimed at a specialized or general audience?
- Does the information support your topic or force you to rethink your
approach?
What to Look for Regarding Coverage, Audience, & Appropriateness
Before evaluating for these qualities take a moment to reflect on your needs and objectives. It will be difficult to make any judgments without a clear understanding of what you're trying to accomplish.
Word choice will be a strong indicator of the intended audience. Technical jargon speaks to a specialized audience. Also, check the source's introduction or preface , if one is present. The audience and coverage will often be stated there. Also look at titles, sub-titles, and headings in the work. These can help establish what is covered by the source. Now compare what you find to your needs. Is this information appropriate? Does it fit into what you're doing?
Evaluating Coverage, Audience, & Appropriateness -- Exercise
You're researching the topic nuclear waste disposal for a paper. You're going to present a broad overview of the topic for a general audience. Examine the following citation and accompanying information. Does this journal article appear appropriate for your needs?
Beitz, James V. and Clayton W. Williams. "A Single Material Approach to
Nuclear Waste Disposal." AIP Conference Proceedings.
532.1(2000):151-152.
Article Abstract:
We are developing a novel concept for microencapsulating and chemically fixing actinide and other heavy element ions in phosphate-rich phases in vitreous silica. Our work is based on a chemically functionalized, porous silica that is termed Diphosil. Diphosil was developed by R. Chiarizia and coworkers in a collaboration between Argonne National Laboratory and the University of Tennessee to selectively sorb most actinide ions from nitric acid solutions [1]. Subsequently, EiChroM Industries received support from the U.S. Department of Energy to demonstrate production of Diphosil on an industrial scale. © 2000 American Institute of Physics.
What is your answer?
Yes, it is appropriate
No, it is not appropriate
The Correct Answer is: No, the article is not appropriate.
You don't have to read far into this abstract to see that it has been written for a specialized audience of engineers. Words like "microencapsulating" and "actinide" make this clear. The article is beyond the scope of the writing assignment.
Having a checklist or handout at your side as you evaluate the content of information sources can help keep you on track and make sure you don't forget any questions.
A printable checklist for evaluating content is available on the Resources page of the Hands-On site.
This concludes Evaluating Content