Preparation
For this assessment, you will conduct a deeper analysis of the technical quality of the selected test against Element 5 of the Code, which states that the test user will “evaluate evidence of the technical quality of the test provided by the test developer and any independent reviews.”
Instructions
For Assessment 1, you selected one standardized test that has relevancy to your academic and professional goals. Assessment 1 focused on the first four elements of the code for selecting a test. For Assessment 2, you will complete a deeper analysis of the technical quality of your selected test by focusing on the fifth element of the code, which states that the test user will “evaluate evidence of the technical quality of the test provided by the test developer and any independent reviews.” To complete this assignment, you will draw upon the knowledge you have gained so far about psychometrics in general and reliability and validity in particular. For Assessment 2, use the test you selected for Assessment 1. Locate and summarize a minimum of four articles related to the technical qualities of the selected test. You are encouraged to use the PSY Library Research Guide, linked in the resources, to assist your search.
For each article:
List the APA reference for each journal article (a minimum of seven).
Identify if the article addresses reliability or validity.
Discuss if the article addresses sources of error variance, reliability estimates, evidence of validity, or bias and fairness.
Identify the specific type of reliability or validity (for example, test-retest reliability, predictive validity, et cetera).
Identify the overall results of the research, including any psychometric or statistical outcome.
Guidelines for Selecting the Literature
Use the most current sources you can find. Do not use sources older than 8 years. (You may cite older sources if they are classics, if you want to show the chronology of something, or if you have another good reason. If you choose to use older sources, you will need to explain why.) Use current, peer-reviewed journal articles. Do not use sources without an author or a publication date. Do not use quotes; use only your own words. Evaluate whether the results support the use of your test as appropriate for your field and populations to be served.
Note: The articles you need to complete this assignment should be available as part of the library collection. In future courses, you may use the library’s Interlibrary Loan service to obtain articles outside of the collection, but you should not have to use the service for this course. In the event that you cannot find articles covering a newer test edition, please refer to the List of Tests by Type document, linked in the resources for Assessment 1. Note which tests have been designated as acceptable for searching prior test editions.
Refer to The Annotated Bibliography link in Suggested Resources to guide the formatting of your paper.
Note: Use the Assessment 2 Template: Evaluation of Technical Quality provided in the Required Resources to complete this assessment.
Introduction
Use the Introduction section of the template to complete this section.
Identify the test and briefly describe the publisher’s stated purpose for its use.
Identify briefly a population or psychological condition that is within the standardization of the test.
Technical Review Article Summaries
Use the Technical Review Article Summaries on the template to complete this part of the executive summary.
Each article is to be directly related to your chosen test and one aspect of its technical quality. Note: Use an annotated bibliography for evaluative information format. (See the Suggested Resources for information available at about annotated bibliographies.)
List the APA reference for each journal article (a minimum of four).
Identify if the article addresses reliability or validity.
Explain how the article addresses sources of error variance, reliability estimates, evidence of validity, or bias and fairness.
Identify the specific type of reliability or validity (for example, test-retest reliability, predictive validity, et cetera).
Identify the overall results of the research, including any psychometric or statistical outcome.
Conclusion
Use the Conclusion section of the template to complete the following:
Evaluate the current state of the test’s technical quality and its status as an appropriate quality tool in the field.
Support conclusions about a test’s appropriateness for use in the field and with the population to be served with peer-reviewed research.
Synthesize the information from all the articles you reviewed about validity.
Evaluate if your test continues to be deemed as appropriate for your planned use in the field and with the population to be served, as suggested by the director in your setting.
Provide your references that you used for the technical review and summary to your director.
Additional Requirements
Your assessment should meet the following requirements:
Written communication: Write clearly and logically, with correct use of spelling, grammar, punctuation, mechanics, and APA format and style.
References: A minimum of six peer-reviewed journal articles (textbooks, web pages, literature reviews, and the MMY book reviews do not count for these references). Three of the articles must focus on reliability and three must focus on validity.
APA format: Follow current APA format and style throughout the assessment. Be sure to use correct format and style for each respective type of reference, for example, website versus journal).
Length: 3–4 double-spaced pages, including the technical review. Do not count the title page or references.
Font and font size: Times New Roman, 12 point.
