psyass 6&7

100問 • 1年前

問題一覧

legal terminology: if it is “executed with the proper formalities

valid

, a judgment or estimate of how well a test measures what it purports to measure in a particular context. ● judgment based on evidence about the appropriateness of inferences drawn from test scores.

validity

No test technique is “_______”. Tests may be shown to be valid within what we would characterize as “________”.

universally valid, reasonable boundaries

Characterizations of the validity test

acceptable, weak

, a logical result or deduction.

inference

, process of gathering and evaluating evidence about validity.

validation

role is to supply validity evidence in the test manual in validation

test developer

conduct their own validation studies

test user

, are absolutely necessary when the test user plans to alter in some way the format, instructions, language, or content of the test. ● yield insights regarding a particular population of testtakers compared to the norming sample.

local validation studies

it might be useful to visualize construct validity as being “_______” because every other variety of validity falls under it.

umbrella validity

, different plans of attack

strategies

based on an evaluation of the subjects, topics, or content covered by the items in the test. ● a judgment of how adequately a test samples behavior representative of the universe of behavior that the test was designed to sample.

content validity

, the universe of behavior

assertive

, a plan regarding the types of information to be covered by the items, the number of items tapping each area of coverage, the organization of the items in the test etc. ● culmination of efforts to adequately sample the universe of content areas

test blueprint

what constitutes historical fact depends to some extent on who is _______

writing the history

obtained by evaluating the relationship of scores obtained on the test to scores on other tests or measures. ● a judgment of how adequately a test score can be used to infer an individual’s most probable standing on some measure of interest—the measure of interest being the criterion.

criterion-related validity

the standard against which a test or a test score is evaluated.

criterion

Characteristics of a criterion

relevant, valid, uncontaminated

Characteristics of a criterion that is pertinent or applicable to the matter at hand.

relevant

characteristics of a criterion: If one test (X) is being used as the criterion to validate a second test (Y), then evidence should exist that X is valid.

valid

, a criterion measure that has been based, at least in part, on predictor measures. Ex. If the guards’ opinions were used both as a predictor and as a criterion, then we would say that criterion contamination had occurred.

criterion contamination

a correlation coefficient that provides a measure of the relationship between test scores and scores on the criterion measure.

validity coefficient

Two types of statistical evidence of Criterion-related validity

validity coefficient, incremental validity

used to determine the validity between the two measures in the validity coefficient

Pearson correlation coefficient

self-ranking =

Spearman rho rank-order correlation

degree to which an additional predictor explains something about the criterion measure that is not explained by predictors already in use.

incremental validity

Incremental validity is ____ when a predictor is strongly correlated with the criterion and minimally correlated with other predictors.

highest

helps us decide whether the additional information a variable provides is worth the time, effort, and expense of measuring it.

incremental validity

, a statistical procedure to estimate the quantitative of incremental validity

hierarchical regression

, an index of the degree to which a test score is related to some criterion measure obtained at the same time ● If test scores are obtained at about the same time as the criterion measures are obtained

concurrent validity

, an index of the degree to which a test score predicts some criterion measure. ● test scores may be obtained at one time and the criterion measures obtained at a future time

predictive validity

a particular trait, behavior, characteristic, or attribute exists in the population (expressed as a proportion).

base rate

proportion of people a test accurately identifies as possessing or exhibiting a particular trait, behavior, characteristic, or attribute.

hit rate

proportion of people the test fails to identify as having, or not having, a particular characteristic or attribute.

miss rate

, a miss wherein the test predicted that the testtaker did possess the particular characteristic or attribute being measured when in fact the testtaker did not.

false positive

, a miss wherein the test predicted that the testtaker did not possess the particular characteristic or attribute being measured when the testtaker actually did.

false negative

a judgment about the appropriateness of inferences drawn from test scores regarding individual standings on a variable called a construct.

construct validity

unobservable, presupposed (underlying) traits that a test developer may invoke to describe test behavior or criterion performance. ● the unifying concept for all validity evidence

construct validity

an informed, scientific idea developed or hypothesized to describe or explain behavior.

construct

, how uniform a test is in measuring a single concept.

homogeneity

homogeneity, how uniform a test is in measuring a single concept.

evidence of homogeneity

, If a test score purports to be a measure of a construct that could be expected to change over time, then the test score, too, should show the same progressive changes with age

evidence of changes with age

, evidence that test scores change as a result of some experience between a pretest and a posttest can be evidence of construct validity.

evidence of pretest–posttest changes

if a test is a valid measure of a particular construct, then test scores from groups of people who would be presumed to differ with respect to that construct should have correspondingly different test scores.

Evidence from distinct groups

, if scores on the test undergoing construct validation tend to correlate highly in the predicted direction with scores on older, more established, and already validated tests designed to measure the same (or a similar) construct

convergent evidence

, (0) a validity coefficient showing little (statistically insignificant) relationship between test scores and/or other variables with which scores on the test being construct-validated should not theoretically be correlated provides this

discriminant evidence

an experimental technique useful for examining both convergent and discriminant validity evidence ● the matrix or table that results from correlating variables (traits) within and between methods.

multitrait-multimethod matrix

is the correlation between measures of the same trait but different methods.

convergent validity

, the similarity in scores due to the use of the same method. ● correlations of different traits via the same method represents this

method variance

, shorthand term for a class of mathematical procedures designed to identify factors or specific variables that are typically attributes, characteristics, or dimensions on which people may differ ● can be used to give a more precise evaluation of the homogeneity/unidimensionality of the test.

factor analysis

, estimating, or extracting factors; deciding how many factors to retain; and rotating factors to an interpretable orientation.

exploratory factor analysis

, researchers test the degree to which a hypothetical model (which includes factors) fits the actual data.

confirmatory factor analysis

, each test is thought of as a vehicle carrying a certain amount of one or more abilities ● conveys information about the extent to which the factor determines the test score or scores.

factor loading

condemned trinitarian view as fragmented and incomplete.

Messick

, one that takes into account everything from the implications of test scores in terms of societal values to the consequences of test use.

unitary view of validity

, a judgment regarding how well a test measures what it purports to measure at the time and place that the variable being measured (behavior, cognition, or emotion) is actually emitted.

ecological validity

d greater the ecological validity of a test or other measurement procedure, the ______ of the measurement

greater the generalizability

in-the-moment and in-the-place evaluation of targeted variables (behaviors, cognitions, and emotions) in a natural, naturalistic, or real-life context.

ecological momentary assessment (EMA)

what a test appears to measure to the person being tested than to what the test actually measures.

face validity

lack of face validity contribute to a ________ in the effectiveness of the test

lack of confidence

, if a test definitely appears to measure what it purports to measure “on the face of it,”.

High in face validity

factor inherent in a test that systematically prevents accurate, impartial measurement

test Bias

, when the use of a predictor results in consistent underprediction or overprediction of a specific group’s performance or outcomes.

intercept bias

when a predictor has a weaker correlation with an outcome for specific groups.

slope bias

a judgment resulting from the intentional or unintentional misuse of a rating scale

rating error

, a numerical or verbal judgment (or both) that places a person or an attribute along a continuum identified by rating scale.

rating

a scale of numerical or word descriptors.

rating scale

, an error in rating that arises from the tendency on the part of the rater to be lenient in scoring, marking, and/or grading.

leniency error

, less than accurate rating or error in evaluation due to the rater’s tendency to be overly critical

severity error

, the rater exhibits a general and systematic reluctance to giving ratings at either the positive or the negative extreme.

central tendency error

one way to overcome the restriction-of-range rating errors (central tendency, leniency, severity errors)

rankings

a procedure that requires the rater to measure individuals against one another instead of against an absolute scale. ● the rater is forced to select first, second, third choices, and so forth.

rankings

(central tendency, leniency, severity errors)

restriction-of-range rating errors

, tendency to give a particular ratee a higher rating than the ratee objectively deserves because of the rater’s failure to discriminate among conceptually distinct and potentially independent aspects of a ratee’s behavior.

halo effect

the extent to which a test is used in an impartial, just, and equitable way.

test Fairness

, practical value of using a test to aid in decision making and improve efficiency. ● also refer to the usefulness or practical value of a training program or intervention.

test utility

anything from a single test to a large-scale testing program that employs a battery of tests.

testing

disadvantages, losses, or expenses in both economic and noneconomic terms. ● relating to expenditures associated with testing or not testing.

costs

the higher the ______[ of test scores for making a particular decision, the higher the utility of the test is likely to be.

criterion-related validity

- costs in terms of loss.

noneconomic costs

, profits, gains, or advantages.

Benefits

family of techniques that entail a cost–benefit analysis designed to yield information relevant to a decision about the usefulness and/or practical value of a tool of assessment. ● umbrella term covering various possible methods

utility analysis

, can provide an indication of the likelihood that a testtaker will score within some interval of scores on a criterion measure—an interval that may be categorized as “passing,” “acceptable,” or “failing.”

expectancy table

provide an estimate of the extent to which inclusion of a particular test in the selection system will improve selection. ● provide an estimate of the percentage of employees hired by the use of a particular test who will be successful at their jobs, given different combinations of three variables: the test’s validity, the selection ratio used, and the base rate.

Taylor-Russell tables

determining the increase over current procedures

taylor-russell tables

, numerical value that reflects the relationship between the number of people to be hired and the number of people available to be hired.

selection ratio

, obtaining the difference between the means of the selected and unselected groups to derive an index of what the test (or some other tool of assessment) is adding to already established procedures. ● determining the increase in average score on some criterion measure

Naylor-Shine tables

used to calculate the dollar amount of a utility gain resulting from the use of a particular selection instrument under specified conditions.

Brogden-Cronbach-Gleser formula

an estimate of the benefit (monetary) of using a particular test or selection method

utility gain

a test has obviously ______ if the hit rate is _____ without using it.

no value

, reference point derived as a result of a judgment and used to divide a set of data into two or more classifications, with some action to be taken or some inference to be made on the basis of these classifications.

cutoff score/cut score

, a reference point—in a distribution of test scores used to divide a set of data into two or more classifications— that is set based on norm-related considerations rather than on the relationship of test scores to a criterion.

relative cut score

, a reference point that is typically set with reference to a judgment concerning a minimum level of proficiency required to be included in a particular classification

fixed cut score

, the use of two or more cut scores with reference to one predictor for the purpose of categorizing testtakers.

multiple cut scores

, one collective element of a multistage decision-making process in which the achievement of a particular cut score on one test is necessary in order to advance to the next stage of evaluation in the selection process.

multiple hurdles

, assumption is made that high scores on one attribute can, in fact, “balance out” or compensate for low scores on another attribute. ● a person strong in some areas and weak in others can perform as successfully in a position as a person with moderate abilities in all areas relevant to the position in question.

compensatory model of selection

, statistical tool that is ideally suited for making such selection decisions within the framework of a compensatory model.

multiple regression

cut scores are typically set based on tessttakers’ performance across all the items on the test; some portion of the total number of items on the test must be scored “correct” in order for the testtaker to “pass” the test.

classical test scores theory

can be applied to personnel selection tasks as well as to questions regarding the presence or absence of a particular trait, attribute, or ability.

Angoff Method (William Angoff)

100

collection of data on the predictor of interest from groups known to possess, and not to possess, a trait, attribute, or ability of interest. ● cut score is set on the test that best discriminates the two groups’ test performance.

Known Groups Method

AB PSY CHAPTER 7: Eating and Sleep-Wake Disorders

valerie · 100問 · 2年前

AB PSY CHAPTER 7: Eating and Sleep-Wake Disorders