Psychometric Assessment Exam: Level 2 Ability - PsyAsia International Community

Psychometric Assessment Exam: Level 2 Ability

Final Course Exam: PAWL2A

Kindly note that because this is a test of your current competence, you will be given only ONE opportunity to take the assessment at the current time.

If you do not pass, you will need to wait at least 7 days (in order to have sufficient time to revise the course content) and pay a re-sit fee of US$99. We charge this fee, both for admin purposes, and to discourage students from taking the exam before they are ready. If you are confident that you are ready to proceed with the assessment, please feel free to do so, but note the only deadline for doing so is your ticket validity, so you do not need to sit this assessment prematurely.

Thank you for your understanding.

Final advice: Please do not use the back buttons on your browser and please stay inside the current tab. Do not switch back and forth between this tab and another. Tab switches are recorded by the system as they are suggestive of looking for the answers elsewhere – we are assessing your own knowledge and competence right now. We reserve the right to cancel certificates of those who switch tabs more than 2-3 times during the exam and to request that you resit.

The number of attempts remaining is 1

Kindly complete the following for tracking and certification purposes.
Name should be entered exactly as you would like to see it on any certificate.

1 / 30

What is the minimum level of reliability that we aspire to for ability tests?

2 / 30

Which of the following statements is TRUE about test-retest reliability?
(Check ALL that apply)

It is less important than internal consistency reliability

The test-retest reliability value is used in the calculation of a scale's standard error of measurement

The end result is expressed as a correlation coefficient

To compute it you need to assess 2 different groups of candidates at 2 different times using the same test

To compute it you need to assess 1 group of candidates at 2 different times using the same test

It requires more resources than internal consistency reliability

3 / 30

A candidate scores a raw score of 17 on a test which has a standard deviation of 2 and mean of 17.
How would you feed this back?

You scored at the th percentile. This means that you did better than per cent of similar others. This score falls within the band.

4 / 30

A candidate obtains a raw score of 15 on test wherein 39 out of 167 people scored less than 15. How would you feed this back?

You scored at the rd percentile. This means that you did better than per cent of similar others. This score falls within the band.

5 / 30

At the 1% level of significance, how many correlations in every 100 are probably due to chance effects?

6 / 30

A candidate scored at the 39th percentile. His score is in the average band.

True

False

7 / 30

A candidate scores at the 95%ile. Which of the following are acceptable ways to convey the score?

It's a poor score

It's an above average score

It's an excellent score

It's an average score

8 / 30

If you are unable to undertake a formal job analysis, what method could you use as an absolute minimum?

9 / 30

Z scores have a mean of

10 / 30

Every significant finding is useful in establishing the validity of the test:

True

False

11 / 30

Match the sampling methods with their correct descriptions:

Each person in the norm group has an equal chance of being selected

Norm group members are recruited as a result of having easy access, perhaps due to an existing relationship with a company

Norm group members are selected based on demographics

12 / 30

Horn and Cattell took Spearman’s work with g further and introduced two sub areas. One of these was called crystallised intelligence and the other was called intelligence.

13 / 30

Looking at the 2 correlations in the table – what is the probability that they occurred by chance?

95%

10%

5%

1%

99%

14 / 30

Match the types of validity with their descriptions:

Predictive Criterion Related Validity

Faith validity

Content Validity

Face Validity

Construct Validity

Concurrent Criterion Related Validity

15 / 30

A test publisher correlates an ability test score with a rating of job performance and concludes that the finding is significant at the 5% level. What does she mean? Choose all that apply:

The finding definitely happened by chance.

The finding is unlikely to have happened by chance. The probability of it happening by chance is 5% or less.

The finding definitely did not happen by chance.

The finding is likely to have happened by chance. The probability of it happening by chance is 95% or more.

16 / 30

The picture shows reliability data from a test manual. What type of reliability is shown here?

Internal Consistency

Test-retest

Parallel Forms

17 / 30

Which scatterplot shows a correlation of -1.0

C

A

B

18 / 30

Think about this carefully – don’t rush it! Sally and Jo both undertake a numerical reasoning test. The test has an SEm of 2. Sally scores 10 on the test whilst Jo scores 16. How confident can we be that Jo is really better than Sally at numerical reasoning?

96% confident

68% confident

50% confident

99% confident

100% confident

19 / 30

Calculate the SEMean for the following: 150 Candidates, SD = 2 (Round to nearest 2 decimal places)

20 / 30

Match the level of data to the typical correlation statistic used:

Interval

Ordinal

Nominal

21 / 30

Which of the following Job Analysis methods is the best?

Incumbent interviews

HTA

PAQ

Critical incident

A mixture of multiple methods

22 / 30

Match the possible methods of assessing validity to the respective type of validity:

Simply read the questions

Correlate test score with a future criterion

Ask subject matter experts

Correlate test score with scores on another similar test

Correlate test score with recent performance

23 / 30

This picture shows reliability data from a test manual. If a candidate scored a raw score of 15 on NMG1, what would their Z score be?
(Hint: This draws upon knowledge from Level 1 which you should recall!)

24 / 30

The SD of a sten scale is (exactly):

25 / 30

What single word best describes the concept of reliability in psychometrics?

Error

Norms

Validity

Consistency

Prediction

26 / 30

A company uses an abstract reasoning test as part of its selection process. Candidates who achieve the pass mark are carried forward to the next stage of the selection process. The pass mark is set at a Z score of +2. If the company tests 100 candidates, how many of them are likely to pass?

27 / 30

Which of the following statements would be CORRECT for the following data (check all that apply):
SEMean = 1, Norm Group Mean = 16, Norm Group SD = 2

We are 96% certain that the true population mean lies between 15 and 17

We are 68% certain that the true population mean lies between 15 and 17

We are 96% certain that the true population mean lies between 14 and 18

We are 68% certain that the true population mean lies between 14 and 18

28 / 30

What is the minimum level of reliability that we aspire to for personality assessments?

29 / 30

A client of test publisher does his own validity study. He asks each of his many managers to assess the performance of employees selected using the psychometric test. He provides the managers with a list of 6 competencies to evaluate the employees on. Subsequent analyses show no significant relationship between the psychometric test and any of the competencies. What is the most likely of the following 3 biases at play here?

Criterion validity problems

Criterion reliability problems

Restriction of range problems

30 / 30

Approximately how much of the variance in grade performance is associated with the numerical reasoning test score?

22%

2%

5%

9%

95%

Your score is

0%