Docsity
Docsity

Prepare for your exams
Prepare for your exams

Study with the several resources on Docsity


Earn points to download
Earn points to download

Earn points by helping other students or get them with a premium plan


Guidelines and tips
Guidelines and tips

Validity and Reliability of Psychometric Measures: Face, Content, and Construct Validity, Lecture notes of Algebra

The different types of psychometric measures, including achievement, attitude/opinion, personality, social skills, aptitude, and iq. It also explores the concepts of face validity, content validity, and construct validity, and the importance of each in ensuring the accuracy and reliability of test results. The document also covers the statistical assessment of construct validity through discriminant validity, and provides an example of evaluating a measure of depression.

What you will learn

  • What is the difference between face validity and content validity?
  • What are the different types of psychometric measures and how are they validated?
  • How is construct validity assessed statistically?

Typology: Lecture notes

2021/2022

Uploaded on 09/12/2022

ekaraj
ekaraj 🇺🇸

4.6

(29)

264 documents

1 / 3

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Face, Content & Construct Validity
Kinds of attributes we measure
Face Validity
Content Validity
Construct Validity
Discriminant Validity ÆConvergent & Divergent evidence
Summary of Reliability & Validity types and how they
are demonstrated
What are the different types of “things we measure” ???
The most commonly discussed types are ...
Achievement -- “performance” broadly defined (judgements)
e.g., scholastic skills, job-related skills, research DVs, etc.
Attitude/Opinion -- “how things should be” (sentiments)
polls, product evaluations, etc.
Personality -- “characterological attributes” (keyed sentiments)
anxiety, psychoses, assertiveness, etc.
There are other types of measures that are often used…
Social Skills -- achievement or personality ??
Aptitude -- “how well some will perform after then are trained and
experiences” but measures before the training & experience”
some combo of achievement, personality and “likes”
IQ -- is it achievement (things learned) or is it “aptitude for
academics, career and life” ??
Face Validity
Does the test “look like” a measure of the construct of interest?
“looks like” a measure of the desired construct to a member
of the target population
will someone recognize the type of information they are
responding to?
Possible advantage of face validity ..
If the respondent knows what information we are looking for,
they can use that “context” to help interpret the questions
and provide more useful, accurate answers
Possible limitation of face validity …
if the respondent knows what information we are looking for,
they might try to “bend & shape” their answers to what they
think we want -- “fake good” or “fake bad”
pf3

Partial preview of the text

Download Validity and Reliability of Psychometric Measures: Face, Content, and Construct Validity and more Lecture notes Algebra in PDF only on Docsity!

Face, Content & Construct Validity

•^

Kinds of attributes we measure

-^

Face Validity

-^

Content Validity

-^

Construct Validity– Discriminant Validity

Æ

Convergent & Divergent evidence

•^

Summary of Reliability & Validity types and how theyare demonstrated

What are the different types of “things we measure” ???The most commonly discussed types are ...• Achievement -- “performance” broadly defined (judgements)

  • e.g., scholastic skills, job-related skills, research DVs, etc.
    • Attitude/Opinion -- “how things should be” (sentiments)
      • polls, product evaluations, etc.
        • Personality -- “characterological attributes” (keyed sentiments)
          • anxiety, psychoses, assertiveness, etc. There are other types of measures that are often used…• Social Skills -- achievement or personality ??• Aptitude --

“how well some will perform after then are trained and

experiences” but measures before the training & experience”

  • some combo of achievement, personality and “likes” -^ IQ -- is it achievement (things learned) or is it “aptitude for

academics, career and life” ??

Face Validity

  • Does the test “look like” a measure of the construct of interest?
    • “looks like” a measure of the desired construct to a member

of the target population

  • will someone recognize the type of information they are

responding to?

  • Possible advantage of face validity ..
    • If the respondent knows what information we are looking for,

they can use that “context” to help interpret the questionsand provide more useful, accurate answers

  • Possible limitation of face validity …
    • if the respondent knows what information we are looking for,

they might try to “bend & shape” their answers to what theythink we want -- “fake good”

or “fake bad”

Content Validity

  • Does the test contain items from the desired “content domain”?
    • Based on assessment by experts in that content domain
      • Is especially important when a test is designed to have low face

validity

  • e.g., tests of “honesty” used for hiring decisions
    • Is generally simpler for “achievement tests” than for

“psychological constructs” (or other “less concrete” ideas)

  • e.g., it is a lot easier for “math experts” to agree whether or

not an item should be on an algebra test than it is for“psychological experts” to agree whether or not an itemsshould be on a measure of depression.

  • Content validity is not “tested for”. Rather it is “assured” by the

informed item selections made by experts in the domain.

Construct Validity

  • Does the test interrelate with other tests as a measure of this

construct should?

  • We use the term construct to remind ourselves that many of the

terms we use do not have an objective, concrete reality.

  • Rather they are “made up” or “constructed” by us in our

attempts to organize and make sense of behavior andother psychological processes

  • attention to construct validity reminds us that our defense of the

constructs we create is really based on the “wholepackage” of how the measures of different constructs relateto each other

  • So, construct validity “begins” with content validity (are these the

right types of items) and then adds the question, “does thistest relate as it should to other tests of similar anddifferent constructs?

The statistical assessment of Construct Validity …

Discriminant Validity

  • Does the test show the “right” pattern of interrelationships with

other variables?

-- has two parts

  • Convergent Validity -- test correlates with other measures of

similar constructs

  • Divergent Validity -- test isn’t correlated with measures of

“other, different constructs”

  • e.g., a new measure of depression should …
    • have “strong” correlations with other measures of “depression”• have negative correlations with measures of “happiness”• have “substantial” correlation with measures of “anxiety”• have “minimal” correlations with tests of “physical health”,

“faking bad”, “self-evaluation”, etc.