The Web as a Research Tool: Evaluation Techniques
By Jan Alexander and Marsha Tate.
Reproduced from www.erlbaum.com
Topics Covered
· Need for Evaluation of Web Sources
· Review of the Five Traditional Print Evaluation Criteria
· Adapting the Five Traditional Print Evaluation Criteria to Web Sources
· Additional Challenges Presented by Web Sources and How to Cope with Them
· Applying Evaluation Techniques to Specific Types of Web Resources
Need for Evaluation of Web Sources
Web usage for academic research is increasing rapidly. Because the quality of
sources on the Internet vary tremendously, techniques are needed to evaluate Web
resources. Some traditional print techniques for evaluation are still appropriate, but
different techniques are also needed to address this new medium.
Review of the Five Traditional Print Evaluation Criteria
Traditionally, five print evaluation criteria have been used to verify information:
Criterion 1: Accuracy How reliable and free from error is the
information?
Are there editors and fact checkers?
Criterion 2: Authority What are the author's qualifications for writing
on this subject?
How reputable is the publisher?
Criterion 3: Objectivity Is the information presented with a minimum
of bias?
To what extent is the information trying to sway the opinion of the
audience?
Criterion 4: Currency Is the content of the work up-to-date?
Is the publication date clearly labeled?
Criterion 5: Coverage What topics are included in the work?
Are the topics included explored in depth?
Adapting Five Traditional Print Evaluation Criteria to Web Resources
These five traditional print evaluation criteria can be adapted to suit Web resources.
Criterion 1: Accuracy of Web Resources Almost anyone can publish
on the Web
Many Web resources not verified by editors and/or fact checkers
Web Standards to ensure accuracy yet to be fully developed
Criterion 2: Authority of Web Resources Often difficult to determine authorship of Web Sources
If author's name is listed, his/her qualifications frequently absent
Publisher responsibility often not indicated
Criterion 3: Objectivity of Web Resources Goals/aims of persons or groups presenting material often not clearly
stated
Web often functions as a “virtual soapbox”
Criterion 4: Currency of Web Resources Dates not always included on Web pages
If included, a date may have various meanings:
1. Date information first written
2. Date information placed on Web
3. Date information last revised
Criterion 5: Coverage of Web Resources Web coverage may differ from print coverage
Often hard to determine extent of Web coverage
Additional Challenges Presented by Web Resources and How To Cope with
Them
Marketing-Oriented Web Pages
Challenge
- In print sources, usually clear distinction between advertising and
information
- On the Web, the distinction between advertising and information can easily
become blurred
Coping Strategy
- Determine if advertising and informational content are being supplied by the
same person or organization;
- If so, advertising likely to bias informational content
"Infommercial" Web Pages
Challenge
- Blending of entertainment, information, and advertising on Web Pages
Coping Strategy
- Caveat Emptor: View these Web pages with the same critical eye you
would an infommercial
Use of Hypertext Links
Challenge
- Quality of Web pages linked to original Web page may vary
Coping Strategy
- Evaluate each Web page independently
Software Requirements May Limit Access to Web Information
Challenge
- Full access may require additional software
- Browsers may alter the appearance of Web Pages
Coping Strategy
- Be aware that software may limit how much information
you obtain and how the information appears on your screen
Web Pages Out of Context
Challenge
- Search Engines can retrieve Web Pages out of context
- May or may not be a way of determining source of information
Coping Strategy
- Always try to return to the “home page” to determine source of information
Instability of Web Pages
Challenge
- Web pages may move or disappear without notice
Coping Strategy
- Try to determine the stability of your source
- Document source to the fullest extent possible
Susceptibility of Web Pages to Alteration
Challenge
- Web pages are susceptible to both accidental and deliberate alteration
Coping strategy
- Attempt to verify information using other sources
Applying Evaluation Techniques to Specific Types of Web Resources
Step 1: Identify the Type of Web Page
Entertainment
Business/Marketing
Reference/Information
News
Advocacy
Personal Page
Step 2: Use the Appropriate Checklist
Step 3: Based on the Checklist Criteria, Determine the Relative
Quality of the Web Page
The more “yes” answers to questions indicates a higher quality Web
page
Conclusion: Remember!
The Web is only one source of information
- It can be very useful for researching certain topics
- It can be almost useless for other topics
- To research a topic thoroughly, use a variety of sources, both
Web and non-Web
Web evaluation techniques are just beginning to be
developed
Technology is outpacing ability to create standards and
guidelines
Establishing evaluation procedures will be an ongoing
evolutionary process