digplanet beta 1: Athena
Share digplanet:

Agriculture

Applied sciences

Arts

Belief

Business

Chronology

Culture

Education

Environment

Geography

Health

History

Humanities

Language

Law

Life

Mathematics

Nature

People

Politics

Science

Society

Technology

In psychometrics, content validity (also known as logical validity) refers to the extent to which a measure represents all facets of a given social construct. For example, a depression scale may lack content validity if it only assesses the affective dimension of depression but fails to take into account the behavioral dimension. An element of subjectivity exists in relation to determining content validity, which requires a degree of agreement about what a particular personality trait such as extraversion represents. A disagreement about a personality trait will prevent the gain of a high content validity.[1]

On content validity[edit]

Content validity is different from face validity, which refers not to what the test actually measures, but to what it superficially appears to measure. Face validity assesses whether the test "looks valid" to the examinees who take it, the administrative personnel who decide on its use, and other technically untrained observers. Content validity requires the use of recognized subject matter experts to evaluate whether test items assess defined content and more rigorous statistical tests than does the assessment of face validity. Content validity is most often addressed in academic and vocational testing, where test items need to reflect the knowledge actually required for a given topic area (e.g., history) or job skill (e.g., accounting). In clinical settings, content validity refers to the correspondence between test items and the symptom content of a syndrome.

One widely used method of measuring content validity was developed by C. H. Lawshe. It is essentially a method for gauging agreement among raters or judges regarding how essential a particular item is. Lawshe (1975) proposed that each of the subject matter expert raters (SMEs) on the judging panel respond to the following question for each item: "Is the skill or knowledge measured by this item 'essential,' 'useful, but not essential,' or 'not necessary' to the performance of the construct?" According to Lawshe, if more than half the panelists indicate that an item is essential, that item has at least some content validity. Greater levels of content validity exist as larger numbers of panelists agree that a particular item is essential. Using these assumptions, Lawshe developed a formula termed the content validity ratio: CVR = (n_e - N/2)/(N/2) where CVR= content validity ratio, n_e= number of SME panelists indicating "essential", N= total number of SME panelists. This formula yields values which range from +1 to -1; positive values indicate that at least half the SMEs rated the item as essential. The mean CVR across items may be used as an indicator of overall test content validity.

Lawshe (1975) provided a table of critical values for the CVR by which a test evaluator could determine, for a pool of SMEs of a given size, the size of a calculated CVR necessary to exceed chance expectation. This table had been calculated for Lawshe by his friend, Lowell Schipper. Close examination of this published table revealed an anomaly. In Schipper's table, the critical value for the CVR increases monotonically from the case of 40 SMEs (minimum value = .29) to the case of 9 SMEs (minimum value = .78) only to unexpectedly drop at the case of 8 SMEs (minimum value = .75) before hitting its ceiling value at the case of 7 SMEs (minimum value = .99). Whether this departure from the table's otherwise monotonic progression was due to a calculation error on Schipper's part or an error in typing or type setting is unclear. Wilson, Pan, and Schumsky (2012), seeking to correct the error, found no explanation in Lawshe's writings nor any publications by Schipper describing how the table of critical values was computed. Wilson and colleagues determined that the Schipper values were close approximations to the normal approximation to the binomial distribution. By comparing Schipper's values to the newly calculated binomial values, they also found that Lawshe and Schipper had erroneously labeled their published table as representing a one-tailed test when in fact the values mirrored the binomial values for a two-tailed test. Wilson and colleagues published a recalculation of critical values for the content validity ratio providing critical values in unit steps at multiple alpha levels.

See also[edit]

References[edit]

  1. ^ Pennington, Donald (2003). Essential Personality. Arnold. p. 37. ISBN 0-340-76118-0. 
  • Lawshe, C.H. (1975). A quantitative approach to content validity. Personnel Psychology, 28, 563–575. doi:10.1177/0748175612440286
  • Wilson, F.R., Pan, W., & Schumsky, D.A. (2012). Recalculation of the critical values for Lawshe’s content validity ratio. Measurement and Evaluation in Counseling and Development, 45(3), 197-210. doi:10.1177/0748175612440286

External links[edit]

  • Handbook of Management Scales, a Wikibook containing previously used multi-item scales to measure constructs in empirical management research literature. For many scales, content validity is discussed.

Original courtesy of Wikipedia: http://en.wikipedia.org/wiki/Content_validity — Please support Wikipedia.
This page uses Creative Commons Licensed content from Wikipedia. A portion of the proceeds from advertising on Digplanet goes to supporting Wikipedia.
28199 videos foundNext > 

Validity

This video describes the concept of measurement validity in social research.

Content Validity

The extent to which the participants judge the learning content to reflect job requirements accurately. -Are the skills and knowledge taught similar enough t...

Validity and Reliability

A Prezicast tutorial on the differences between these two critical concepts in social science research methods. Prepared as a revision guide for A level psyc...

Reliability and Validity

A discussion of these two very important concepts and their interrelationship.

Types of Validity

This video tells the story of a girl named Whiney. She's had pretty bad luck with roommates and, based on her experiences, has made the claim that ALL JMU GI...

Content Validity Rating Demo

This video shows how to complete Merrill's 2007 5 Star Instrument Content Validity Rating form.

Step 2: Select the right item types (Content Validity)

Addressing Commercial Bias: Ensuring Content Validity with Criterion 10

Murray Kopelow, MD, ACCME President and CEO, discusses the importance of keeping commercial bias out of CME and how Criterion 10 helps ensure content validit...

Transfer Factor 2 - Content Validity

International expert Dr. Ed Holton discusses the effect of Content Validity on training transfer.

Content Validity Index

Content validity Index for scale development- I-CVI, S-CVI/Ave and S-CVI/ UA using a live example in MS Exel.

28199 videos foundNext > 

6 news items

 
7thSpace Interactive (press release)
Thu, 28 Aug 2014 01:15:00 -0700

A key element that influences content validity in developing instruments for evaluating the quality of teaching is culture. The aim of this study was to develop a culture-specific instrument with strong content validity for evaluating clinical teaching ...

Techaeris

Techaeris
Mon, 25 Aug 2014 13:42:35 -0700

Often to bump page views and increase ad revenue. They will decide the validity of the link by using the prodigal value of internet worth; the 'time spent on page' value. The content validity and worth is then judged on the length the user stays to ...

ThinkProgress

ThinkProgress
Tue, 26 Aug 2014 07:05:56 -0700

... homeschooling expert Robert Kunzman quoted Farris expressing concern that standardized testing is not going to be a fair measurement because content validity can't be attained for so many different homeschooling experiences: “The problem is that ...
 
7thSpace Interactive (press release)
Wed, 20 Aug 2014 06:18:45 -0700

Women diagnosed with early stage (I or II) breast cancer face a highly challenging decision - whether or not to undergo adjuvant chemotherapy. We developed a decision quality instrument for chemotherapy for early stage breast cancer and sought to ...
 
7thSpace Interactive (press release)
Tue, 12 Aug 2014 04:48:45 -0700

Measurement properties were evaluated per subscale according to the COSMIN taxonomy consisting of: reliability (internal consistency, test-retest reliability and measurement error), validity (structural validity, content validity and cross-cultural ...
 
7thSpace Interactive (press release)
Tue, 19 Aug 2014 09:18:45 -0700

The aims of this study were to evaluate the psychometric properties of a German version of the TSK (TSK-GV), examining aspects of content validity with special focus on fear-avoidance and endurance, and to confirm criterion-related validity in patients ...
Loading

Oops, we seem to be having trouble contacting Twitter

Talk About Content validity

You can talk about Content validity with people all over the world in our discussions.

Support Wikipedia

A portion of the proceeds from advertising on Digplanet goes to supporting Wikipedia. Please add your support for Wikipedia!