Measurement Validity & Reliability
What is measurement validity?
Given the imperfect nature of measurement, validity is a matter of degree
Approaches to validity include:
Content
Domain of Meaning
For Example:I want to assess the content validity of a test in research methods.
?I also need to consider the skill level to measure. ?For example, knowledge of facts & definitions, application of definitions, drawing inferences, and making critical appraisals, and so forth.
Face Validity
Criterion Related Validity
In both predictive and concurrent validity, we validate by comparing scores with a criterion.
What is a criterion?
Predictive Validity
What is the criterion
When is the criterion measured?
Example: Employment Test
How do we do it?
Concurrent Validity
What is the criterion?
Example: Reading Achievement Test
Other examples:
Construct Validity
What is a construct?
Those behaviors are indicators of depression.
Example:
So how do you determine the construct validity?
What does it mean?
Now let’s suppose that we find a relationship between scores obtained on the new depression measure and success in college.
What does this mean?
Example of the “other variable”
What is measurement reliability?
Reliability concerns:
Approaches to reliability:
Test-retest
Issues to consider in establishing time frame for test-retest:
Interitem (internal consistency)
Alternate-forms
Interobserver
Example for Schutt disk
Validity
Have researchers assessed the validity of arrest rates as measure of crime?
Another example from Shutt disk
Reliability
Download presentation source