This assessment is a culmination of the previous assessments you have completed during this course. In this assessment, you will synthesize your previous research as well as conduct research on the final element in the code, Element 9. Element 9 states that a test user, “evaluate(s) the available evidence on the performance of test takers of diverse subgroups … determine(s) to the extent feasible which performance differences may have been caused by factors unrelated to the skills being assessed.” Together, the previous course assessments and this current one involving Element 9 will provide you with the data, research, and literature reviews across all nine elements of the code to assist your decision-making process about the appropriate selection of a test.
Locate reviews or research related to how Element 9 applies to your selected test. If the research or reviews do not address this element in any way, then you will need to cite the references you reviewed and note what they were lacking in addressing this element, drawing appropriate conclusions for when a test is lacking such evidence.
Synthesize all of the data and information you gathered on your selected test throughout the course and identify highlights, both positive and negative, both advantages and disadvantages, according to all nine elements of the code.
Evaluate your selected test based on these data and draw a conclusion as to whether or not it is a test that you would select, recommend, or even defend, if necessary, in practice.
Note: You should not merely copy and paste your earlier assessments for the final report. Instead you will be synthesizing the research you completed for each element into a summary of that element that you will offer in support of your final evaluation. (For example, note that the technical quality element (that is, Element 5) will be only a synthesis and evaluation, not a repeat of previous analysis work.
Review all of your evaluations for each element, recommended improvements to the test, and write an overall evaluation and determination about the use of your selected test.
Instructions
Assume the role in the scenario below:
You are a consultant and are called as an expert witness in a court proceeding to evaluate the use of this test for a specific setting and population. The court requests a 6-page report, Analysis of (Name of Test), with an executive summary.
Include the following:
Title Page
Analysis of Test to the Code of Fair Testing Practices in Education
Identify the strengths or weaknesses for each element, and determine if the information about that element supports (or opposes) the use of your selected test in the field and population to be served.
Analyze the test against each element.
Element 1. Purpose: Define the purpose for testing, the content, and skills tested.
Element 2. Appropriateness: Evaluate appropriateness of test content, skills tested, and content covered.
Element 3. Materials: Evaluate materials for which clear, accurate, and complete information is provided
Element 4. Training: Test users have appropriate knowledge, skills, and training.
Element 5. Technical Quality.
Synthesis of evidence of reliability.
Synthesis of evidence of validity.
Element 6. Test Items and Format: Evaluate test items, test format, directions, manuals, and scores.
Element 7. Test Procedures and Materials: Evaluate test procedures and materials to ensure that potentially offensive content or language is avoided.
Element 8. Modifications and Accommodations: Evaluate if tests provide appropriately modified forms or procedures for test takers with disabilities.
Element 9. Group Differences: Evaluate evidence on performance of test-takers of diverse subgroups.
Executive Summary
This summary should be comprehensible to layperson.
Conclusion
Overall recommendation to use the selected test in the field and with populations to be served.
Identify the setting and its population.
Identify the test and the intended population for the test.
If recommending the use of the selected test, identify the greatest strengths you discovered and determined in its use. Additionally, identify any limitations or concerns that may still exist with its use regardless of the recommendation. Are there still concerns for the test in certain situations?
If not recommending the use of the selected test, identify the greatest weaknesses you discovered and determined in its use. Additionally, identify any strengths that may still exist with its use regardless of the opposition. Are there still uses for the test within set parameters?
References
A minimum of nine references are required for this assessment, of which at least five must be of peer-reviewed journal articles. These may include journal articles, literature reviews, Mental Measurements Yearbook (MMY) reviews, and publisher Web sites. At least five of the nine references must be from professional journals. It is likely and appropriate that many of these references and citations were included in one or more of your previous assessments. Alternatively, you may want to supplement your paper with current, peer-reviewed journal articles you located after completing an earlier assessment. Such inclusions would also be acceptable.
