PsyAsia is pleased to advise clients that we have extended our special 50% discount offer for those who register for our Psychometric Test Training Course: BPS Level A & B in Singapore until the end of January. Any client who registers for the Level A and B course will be offered a 50% discount on the Saville Consulting Wave accreditation course that follows the day after the Level B training; and/or, 50% off our Behaviour-based Interview Course which is confirmed for the day immediately before the Level A training.  Furthermore, we are pleased to continue to offer a 50% discount off the Behaviour Based Interview Course for any client who registers for our 4-day Human Resource Management Course in Singapore on 22-25 February. 

Training places are limited and courses are now beginning to fill, so please register asap to ensure your place. The above discount offers will expire on 31 January.

If you are in Hong Kong, you can also avail the offers by joining our Hong Kong Psychometric Assessment Level A and B course in March.

All course dates and details as well as email links can be found from here: http://dates.psyasia.com

Kindly contact us on Singapore +65 6521 3131 or Hong Kong +852 8200 6005 for full details.

Identity is a self-perception personality
questionnaire that measures important individual differences
between how people prefer to behave in a workplace setting.
It was developed specifically for the world of work
and is supported by robust research proving its effectiveness
for use in many areas of business and personal development.
The questionnaire is available in English, simplified
Chinese and traditional Chinese.

Developed to be the most comprehensive personality assessment
tool, Identity measures 36 Primary Scales – which
are specific areas of personality related to the world
of work. It is fully validated for making sensitive
selection decisions and found through scientific
research to be more predictive of leadership performance
than even ability tests or interviews.

Sample Cover Page

The PsyAsia logo can be replaced with your corporate
logo if you have your own Identity System. Also note
the PTC logo that confirms Identity is a quality
test registered with the British Psychological Society
Psychological Testing Centre.

Narrative Report

This report is written in second or third person depending
on whether you are using it as a feedback report for
the candidate or for the decision-maker. Text-based
narrative reports are the only type of report available
to untrained users. All other reports/graphics require
a certification.

Quick Look Page

This gives an indication as to the accuracy of the candidate’s
responses and shows you where you need to focus for
additional probing in an interview. For this fake candidate,
the report tells us we need to probe on every competency!
For other candidates you may see “Strong”
and/or “OK” in place of “Further Probing”.

Profile Chart

This is the first page of a 2-page chart which provides
the candidate’s score for each scale in Identity. Labels
and descriptions on either side assist in accurate interpretation
of each scale score.

Pre-Interview Report

This is a sample page from Identity’s Pre-Interview
Report. Personality test reports should be followed
up with a good behavioral interview. This report assists
in this process by providing example questions to ask
the candidate based on their profile.

Derived scales

Assess aspects of the person such as Jungian Type, Learning
Styles, EQ, Team Roles, Leadership Style and so on.
All of these charts come at no additional cost.

The above are just a few examples of
pages from Identity reports. Identity offers a number
of different reports: Pre-Interview, Comprehensive,
Career Focus and Candidate Feedback. Unlike other psychometric
personality tests, clients only pay once for the candidate
rather than for each report generated.

To download full sample reports, please click here

Free Online Psychometric Testing System

All qualified users of Identity get a FREE online system
- so, you can set up test sessions and produce reports
whenever you want – even at night and on weekends!

View our multimedia Identity Sales Presentation

Click here to view all current public training course dates

In this session we will explore the following:

1. Computer-based scoring of psychometric tests
2. Hand-scoring of psychometric tests
3. Norming of test results
4. The link between scoring of tests and reliability

Converting raw scores to standardised scores and using representative norms will be covered in a later session.

Once a psychometric test has been properly administered, it needs to be scored.  Depending on the test chosen, you may have a few options. 

a. You can opt for computer-based scoring.

This would work if you had administered the test using computer software or if you had asked your candidate to complete an online test. For online tests, this option is good because it is less likely to involve scoring errors! Your candidate completes the test online and then the system immediately and automatically scores the test. There is no additional input required and hence less chance for error. This pre-supposes the publisher has used the correct scoring algorithms of course. Whilst most reputable test publishers will, we do know of one who had an error in a test battery that was not spotted until one of their distributors pointed out that his partner had done poorly on a test for which she was a subject matter expert!!

If you administer the test to your candidate using desktop software, you should be able to automatically score it in the same way as above. 

b. You can opt for hand-scoring or a bureau service or keyed input followed by computer-scoring. You are most likely to use this option if you administered the test to your candidate using hard-copy test booklets and answer sheets. 

Firstly, you’ll need to double-check the answer sheets to ensure that there are no irregularities. Ensure that it’s obvious which answer the respondent selected. Be careful with any “blobs” that may have appeared from ink or pencil smudges etc.  If a respondent has changed their mind after selecting a response and has crossed it out, ensure that you only use the most recent response in scoring. 

For hand-scoring using a scoring key, you’ll next need to align the scoring key with the answer sheet. The exact requirements will vary based on the test you are using, so ensure that you read and fully understand the instructions provided by the test publisher. 

Once you have scored the responses, double-check your scoring. You then need to record the score. The score you calculate at this point is called the RAW SCORE.  On its own, a raw score means nothing. If I tell you that you scored 54 on a numerical reasoning test or 75 on the extraversion scale of a personality assessment, you’ll need to ask me more questions before you truly understand your score. The most important question to ask would be how your score compared to others.  The comparison of your score with others is called norming. 

It is called norming because we compare a candidate’s score to a group of others (called the norm group) who completed the test in the past.  To undertake this comparison, you can do it by way of a simple calculation or through the use of norm tables either developed by yourself or, more usually, supplied by the test publisher.

Norm tables allow us to use a standard vocabulary for expressing a candidate’s score in relation to others who have taken the test and it is for this reason that we call your new score a standardised score.  A standardised score is simply your candidate’s raw score, compared with the norm group and expressed in terms of how the candidate scored in relation to others.  We’ll consider standardised scores in more detail in a later lesson.  You’ll see by now that your objective is to calculate the candidate’s standard score as this is the way to achieve maximum meaning.  If you opt for paper and pencil tests and hand-scoring, the process can be lengthy. So are there other options?

We have already seen above that we can simply have the candidate complete an online test. However, you may not wish to do this if there are many candidates.  This is because you will need as many computers as candidates if you are going to supervise them.  If you are using an unsupervised test, the candidate can complete on their own PC, but you may be concerned about possible cheating and so on.  This is why you may end up using paper and pencil tests (in a supervised environment).  However, there is an alternative to arduous hand-scoring if you have used paper and pencil tests. 

You can use the bureau service of your psychometric test distributor. You just need to check that the answer sheet is properly completed, clear and free from any irregularities and then send the answer sheet to the distributor by fax or scanned email.  The bureau service will then score the test for you and send you a report. 

Furthermore, you may have another option yet.  If you have access to a computer or online test system, you can probably also enter the candidate’s responses to each question into the system and have the system produce the report. This is essentially what the bureau service above does for you.  Doing it yourself should work out cheaper.  Do be careful when you transpose the responses though – accuracy is far more important than speed unless you want to invalidate the whole process!!

Self-scoring answer sheets: Some psychometric tests are supplied with self-scoring answer sheets. These are much easier to use than non-self-scoring answer sheets. In this case you usually need to open up the answer sheet by tearing off some perforated card. Inside the answer sheet, the candidate’s responses will have been duplicated via carbon or similar onto a scoring card. Usually, you add up the number of responses (often black circles) that appear inside a circle. Those outside of a circle represent incorrect answers so don’t get counted. Once you’ve added up correct responses, you have your raw score.  Slightly different procedures obviously apply for personality assessments and fewer personality assessments provide self-scoring answer sheets due to their scoring complexity.  When using self-scoring answer sheets you need to be especially careful to ensure that the candidate presses hard on the answer sheet when completing the test. If they are light-handed their responses may not come through onto the scoring card!

Finally, let’s consider the link between psychometric test scoring and reliability/validity.  As you know, the test administrator can have a huge impact upon psychometric test reliability throughout the whole process. At the scoring stage you can affect reliability simply by scoring incorrectly. This might happen because you miss the fact that a candidate crossed out their answer and changed their mind. It may also happen because you try to score fast and just don’t add up correctly.  Perhaps you use the scoring key incorrectly or perhaps the scoring is so arduous (often the case for personality assessments) that you simply get lost in the scoring or incorrectly use your calculator! 

Ensure therefore that you fully understand how to score the test, use the scoring key as per the publisher’s instructions, score slowly and double check or have someone else double check your scoring. If possible, use computer based scoring or self-scoring answer sheets. Incorrect scoring reduces reliability and of course that means that a valid test can become invalid and a waste of time or money!

Interested in learning more about psychometric testing for HRM? Keep reading – your next free session is not far away! To ensure you don’t miss a single instalment, we suggest you follow-us on twitter as each new post will be announced there. You may also like to join our face-to-face psychometric training courses in Singapore or Hong Kong – these range from simple introductory courses through to Certification Courses such as the BPS Level A and BPS Level B Certificates of Competence in Occupational Testing. Not in Singapore or Hong Kong? No problem – we also offer both recorded and live online training in psychometrics! For full details please see here or email us.

DO NOT COPY OR SAVE THIS ARTICLE TO YOUR COMPUTER.
THIS ARTICLE IS CLEARED FOR PUBLISHING ON PSYCHOLOGY1 GROUP SITES ONLY. IT REMAINS COPYRIGHT AND INTELLECTUAL PROPERTY OF PSYASIA INTERNATIONAL PTE. LTD. YOU ARE NOT AUTHORIZED TO PUBLISH IT ON ANY OTHER SITE. YOU ARE NOT PERMITTED TO COPY/PASTE THIS ARTICLE OR TO SAVE IT TO YOUR LOCAL DRIVE. YOU ARE ONLY PERMITTED TO READ IT ONLINE AT OUR WEBSITE. VIOLATION OF THESE TERMS WILL RESULT IN BANNING OF OFFENDING IPS AND LEGAL ACTION FOR THOSE WHO REPUBLISH THIS ARTICLE WHETHER IT BE WITH OR WITHOUT A REFERENCE TO THE ORIGINAL AUTHOR.

In this session we will explore the following:

1. How to conduct a psychometric test administration session

Previously you were introduced to the importance of ensuring that every test administration session that you run remains the same in order to ensure consistency and hence reliability. By not adhering to this and by not being standardised in your test administration, you run the ultimate risk of invalidating the whole process because reliability is a precursor to validity.  So this means that the company purchasing the tests has wasted money at the very least.  Worse still however is the fact that many candidates may not see the process as fair (leading to problems in attracting applicants in the future) and likewise, the law in some countries may take issue with the way tests were administered leading perhaps to a bias in the process for one group compared to another.  Given this, the following will discuss what is required to ensure you conduct a good, reliable psychometric test administration session.

Be prepared

Firstly, you need to be prepared!

Here is a list of things you need in order to be fully prepared:

1. Find and book an appropriate room. One that is large enough for the group of assessees and one which is in a quiet area. Ensure that on the day there will not be any nearby noise such as construction noise. Ensure that there are no fire drills planned. Consider the room temperature – make sure there is enough time for the room to cool down or heat up to a comfortable temperature before the assessment starts. Layout the room as per regular ‘exam conditions’ whereby desks are separated from each other.

2. Prepare a timetable for the day and send this out to candidates with their invitation letter (which we covered previously). Often, psychometric testing forms only part of a day-long series of assessments, that’s why a timetable is critical.

3. If you are using paper-based assessments, don’t forget to order the right quantity from the publisher or test distributor in good time before the session. We advise you do this at least 2 weeks before the day of assessment to allow for shipping.

4. Whether you are using paper-based or online tests, you must familiarise yourself with the tests and their instructions. Ensure that you fully understand the process of administering the tests. You don’t need to understand the questions in the test, but you do need to know each aspect of the process of administration with the specific test(s) you are using.  You need to know when to pass each item (e.g., question booklet, answer sheet) to the candidate and when to collect it back in. You must also know how long each timed test lasts and have a stopwatch to assist with accurate timing. Also have some rough paper so that you can write down the time the test started. This helps if the stopwatch fails – you’ll know “roughly” when to stop the session. However we want 100% accuracy in the session, so let’s hope this backup is not required.

5. Ensure that you have the correct ratio of qualified test administrators to candidates. The best practice ration is 1:10. So for a room of 50 candidates you need 5 test qualified administrators. One administrator can just about keep their eye on 10 candidates, that’s why it would go against best practice to have only one or two administrators ensuring a room of 50 candidates do not cheat by looking at each other’s work or continuing with the test beyond the time limit.

6. Prepare a test log. This is sheet of paper upon which you will record events that happen during the session. The events range from the ordinary (i.e., 25 question booklets handed out and 25 returned or, test started at 3pm and finished at 3.25pm) to the less expected (i.e., candidate 34 reported that she has dyslexia).

Introducing the Psychometric Test Session to Candidates

Be friendly but professional. Introduce yourself and your role. Then go on to cover everything that you previously covered in your invitation letter to your candidates. This will include:

a) Why are we here today

b) Brief description of the assessments candidates are about to undertake

c) Reason why we are using psychometric tests (i.e., they are objective predictors of work performance)

d) How the tests fit into the overall process of selection or development (they should only be part of the process)

e) How long today’s session will last in total

f) What will happen after today’s session (e.g., you will hear from us within 7 days)

g) When feedback on test results will be given

h) A commitment that the results will remain confidential and be used only for this current purpose

i) Then ask candidates if they have any questions so far and thank them for agreeing to take the tests

j) Continuing with the introduction, convey any special emergency/fire instructions to candidates – this is a legal requirement for public gatherings in many countries.

k) Tell candidates where the washrooms are and that if they need to use them, a good time would be right now as they shouldn’t leave the room once the assessment commences and if they do, they certainly won’t get additional time! Also remind them that they may need their reading glasses to complete the assessments and if they left them outside, now is also a good time to go and get them!

At this point, people may have left the room for a couple of minutes following your advice. Once everybody has reassembled, continue with the more formal part of the test administration session.  At this point you will refer to the publisher’s official instruction card. The publisher expects you to read the instructions and hand out/collect materials in exactly the same way and order presented here for consistency (and therefore reliability).

l) Tell candidates that you will now read from the test instructions and that this may make you sound a little more robotic for the next few minutes and that the reason you are doing this is to ensure that everybody gets the same instructions every time this test is administered. Ask them to listen very carefully to the instructions.

m) Read the instructions word for word. Ensure that you pause in the right places. Ensure that you hand out materials when told to do so.  There are usually example questions which you will need to ask the candidates to complete. Do so and allow them a few minutes to complete. During this time you can walk around ensuring that they are completing the correct section of the answer sheet and are looking at the correct section of the question booklet. Correct anybody who is not but do not correct their answers until the example question time is up for all. Then you’ll need to go through the example question answers with candidates. At this stage you’ll be reading from the instructions. Do not go into lengthy explanations with candidates about why they may have got the answer wrong. Simply tell them not to worry, to do their best and remind them that the test in only part of the process.

o) If you are administering a personality questionnaire, remember to tell the candidates that there are no right or wrong answers – you are who you are! Tell them that personality assessments are used to assess candidate fit with the organisation and are more scientific and objective than interviews. Ask them to be honest and open and tell them that it is usually the first answer them comes to their mind which is most accurate; so do not spend too long deliberating over each question. Some candidates may say that they think their personality is different at work compared with home. Simply ask them to answer from a work perspective. Tell candidates that the test is untimed but that most people take around X minutes to complete.

p) Now it’s time for final questions. Ask candidates if they have any and answer them as best you can. It’s a good idea to consider possible questions before starting the sessions. We’ve put a few together here with answers:

http://www.psyasia.com/supportsuite/index.php?_m=knowledgebase&_a=view&parentcategoryid=33&pcid=0&nav=0

p) That’s it, now it’s time to test.  So, as per your instructions, ask candidates to turn over the page and begin. If you’re administering an aptitude/ability test, remember to start your stopwatch at that point and then write down the time the test started as an independent time check. Now you need to walk around the room adjudicating. Don’t answer any more questions – candidates need to concentrate now. If they need replacement pencils/rough paper, fine, but no talking of any kind! Check candidates are on the right page and responding to questions in the correct section of the answer sheet. If not, correct them quietly.

q) As soon as time is up, call “STOP” or whatever is mentioned in your instructions. For personality assessments, wait until everybody has finished. For aptitude tests, ensure that all pencils are placed on desks as soon as you call time. A candidate who continues beyond time can increase their score unfairly and invalidate the process!

r) Collect all materials in the order instructed by the publisher and remember to note down in your test log everything that comes back. You must also collect all rough paper from candidates. This is because they may have written questions down on the paper and now those questions may get leaked out of the testing room – this would obviously invalidate the test.

s) Once you have ensured that all materials were returned, you may close the session as follows:

• Thank candidates for attending
• For aptitude tests, reassure them that they are supposed to be difficult and designed so that not everybody completes all questions
• Remind candidates that everything will remain confidential
• Remind candidates about the feedback session
• Remind candidates about the next part of the selection or development process
• Ask them if they have any final questions
• Thank them all again and then dismiss them

Sticking to these guidelines and the publisher’s test administration instructions will help to ensure consistency in your administration sessions. As you know, this means higher reliability and hence you uphold the validity of the test.

Interested in learning more about psychometric testing for HRM? Keep reading – your next free session is not far away! To ensure you don’t miss a single instalment, we suggest you follow-us on twitter as each new post will be announced there. You may also like to join our face-to-face psychometric training courses in Singapore or Hong Kong – these range from simple introductory courses through to Certification Courses such as the BPS Level A and BPS Level B Certificates of Competence in Occupational Testing. Not in Singapore or Hong Kong? No problem – we also offer both recorded and live online training in psychometrics! For full details please see here or email us.

DO NOT COPY OR SAVE THIS ARTICLE TO YOUR COMPUTER.
THIS ARTICLE IS CLEARED FOR PUBLISHING ON PSYCHOLOGY1 GROUP SITES ONLY. IT REMAINS COPYRIGHT AND INTELLECTUAL PROPERTY OF PSYASIA INTERNATIONAL PTE. LTD. YOU ARE NOT AUTHORIZED TO PUBLISH IT ON ANY OTHER SITE. YOU ARE NOT PERMITTED TO COPY/PASTE THIS ARTICLE OR TO SAVE IT TO YOUR LOCAL DRIVE. YOU ARE ONLY PERMITTED TO READ IT ONLINE AT OUR WEBSITE. VIOLATION OF THESE TERMS WILL RESULT IN BANNING OF OFFENDING IPS AND LEGAL ACTION FOR THOSE WHO REPUBLISH THIS ARTICLE WHETHER IT BE WITH OR WITHOUT A REFERENCE TO THE ORIGINAL AUTHOR.

It’s perhaps quite natural to believe that the Chinese personality is so different to others that it requires a special psychometric test to assess it. What better way to sell your new Chinese personality test than to state that it is “high time a test for the Chinese” were developed. However, this throws doubt upon the utility of rigorously developed international psychometric tests of personality.

Given the above, we embarked on a research program to assess whether Chinese people differ significantly comparied to others in terms of personality structure and whether personality tests that purport to assess Chinese Personality are able to predict any more work performance than internationally developed tests have already been proven to do!

You can read our research findings it: personality.cn, our Chinese Personality at Work Research Site.

No time to read the whole site? Here’s a quick summary:

Locally developed psychometric tests which purport to assess “indigenous” aspects of Chinese Personality were found to be less reliable than reputable internationally developed tests of personality. Furthermore, there is a big question as to whether so-called “indigenous” traits are Chinese-specific. Issues such as traditionalism or face also exist in other cultures! Moreover, the research has demonstrated that whatever we choose to believe about Chinese Personality, locally developed (Hong Kong) tests of “indigenous” personality add nothing to the prediction of performance at work that is not already accounted for by reputable internationally developed personality tests.

We present this research in a free HRM webinar which you can watch here. We held a vote at the beginning and end of our webinar whereby we asked attendees if they believed that Chinese Personality is so different that Chinese people need their own personality test. At the beginning of the webinar, the majority of the attendees said yes! By the end of the webinar only one attendee still believed this to be the case! We recommend choosing well designed psychometric tests with high reliability and validity. Personality is a universal construct, thus locally developed tests may have little benefit to the hiring manager!

Singapore and Hong Kong based award-winning PsyAsia International offers 360 Performance Appraisal via the Saville Consulting Performance Culture Framework. The company has recently set-up a new site dedicated to easy understanding of the 360 appraisal process. It’s easy to set up and the cost is very reasonable. Optional services such as feedback from a psychologist consultant or team building and development services can be added to the package.  The online performance appraisal system can be used by any organisation worldwide. 

The Saville Consulting Wave is based upon a validation-centric scientific framework known as the Performance and Culture Framework. As part of this framework, Saville Consulting offers the Wave Performance 360 (multi-rater) online assessment of performance at work. Wave Performance 360 online assessment enables a range of relevant individuals to rate a colleague’s performance at work. How an individual perceives themselves and how this compares to other people’s perceptions of them is a powerful feedback tool. 360 assessment enhances self-awareness and provides a great platform for personal development. 

Wave 360 provides a unique report where the dual reporting lets the individual being assessed understand on one profile exactly how they were rated and how this benchmarks externally. 

The report combines quantitative rating scales with qualitative comment. All raters have the option of contributing narrative text on areas they think the individual does well, could do less of and could improve on. As a further option, Saville Consulting provides a very detailed development report for the individual based on all ratings. 

This powerful 360 appraisal can be used on it’s own or in conjunction with Saville Consulting Wave® Styles. When used in combination it can help individuals understand the gaps between their performance and potential as a platform for utilising unused potential and realising critical areas of potential.

Further details at the special site: http://360-appraisal.com

PsyAsia International offers Free Psychometric Testing Course in Hong Kong & Singapore

Introduction to Psychometric Testing Course: Hong Kong, 4 May 2010; Singapore, 11 May 2010

PsyAsia International is Asia’s independent Leader in Psychometric Test products and Training. We choose to distribute only the world’s best, most validated psychometric assessments and offer locally relevant, world-class training in psychometrics. The Introduction to Psychometrics Workshop expands on PsyAsia’s expertise in Psychometric Training in Asia by offering a course geared to those with very little experience or understanding in Psychometrics. Many first time clients don’t understand why they need to be careful in their choice or use of psychometrics and many do not understand why training is a necessity in competent test use.

This one-day course aims to provide experienced-based training in an accessible and economical way. The course is easy to understand and yet covers many of the important issues to be aware of when choosing and using psychometric tests. Given our passion for Asia and our passion for the competent use of psychometric tests in Asia, PsyAsia makes no profit on this course. We charge delegates a small fee that reflects the cost of the hotel venue (including buffet lunch and refreshments) where the training is held as well as materials that we provide to the delegates. What’s more, if you later decide to attend one of our accreditation courses in Psychometrics, we will issue you with a discount code that reduces your course fee by the amount you paid for this course!

The history of psychometric testing Comparison of psychometric tests with other modes of employee testing and assessment The benefit of using psychometric tests in recruitment/selection, development and coaching Reliability in psychometric testing Validity in psychometric testing Error in psychometric testing Review of different aptitude, personality and values tests on the market Questions to ask your test publisher or distributor What next?Note: During the workshop, delegates will create quasi-psychometric tests in groups to enable a hands-on exploration of issues such as reliability, error and validity in psychometric tests.

To view full course details and to register, please click here.

PsyAsia International is pleased to once again be supporting Singapore’s Human Resource professionals as a sponsor of the Singapore Human Resources Institute’s Annual Human Resource Congress.

The Singapore HR Congress and Business-Connect Exposition 2010 will address the newly derived term of HR TransmutationTM and explore the topic in deeper context.  The current economic churning has made it explicitly clear that industry is not just facing another downturn but it is accompanied by impactful structural, demographic and mindset changes across industry and top management cannot afford to respond with anything less than a complete overhaul of the system to survive and sustain. Renowned speakers and leaders from the HR fraternity will share their experiences and provide useful insights on the know-how of managing paradoxes in a turbulent world.

PsyAsia’s clients are entitled to a 35% discount on the price of conference tickets.  Please contact us in the first instance to avail of this special offer.
“A strong and capable HR community can be the catalyst and change agents to initiate and implement people development efforts in organisations, and help build stronger capabilities amongst our business leaders and managers.”
 
PM Lee Hsien Loong
11th World HR Congress 2006 organised by SHRI

PsyAsia International is Asia’s leading independent distributor of Psychometric Tests of Personality and Aptitude. From offices across Asia, including Singapore and Hong Kong, our psychologists assist the world’s top organisations and local governments to recruit, select, assess and retain the best employees. Our services are only offered by fully registered organisational psychologists with years of experience in their field. PsyAsia also offers world-class training in Psychometric Testing in Singapore, Malaysia, Hong Kong and Online.

Types of Bias in Psychometric Test Translation

With the demand and need for psychological tests increasing in various different cultures and countries, there has been much greater awareness regarding some of the issues that are associated with the development or adaptation of tests to be used in contexts and situations that may be different from which the test was developed for. This article focuses on one of the key aspects of translating tests, the types of bias that can occur.

When utilizing the test in a new cultural group, it is not quite as simple as directly translating the test, administering it and then comparing the results for its validity. There are a number of issues that need to be considered such as whether the area assessed with the test applies to the new culture or whether is may be biased towards that group and whether what is assessed by the test also has similar behavioral indicators? These are just some of the potential areas where bias can be found in the translation of tests and affect the validity of the test being utilized in the new context.

Van der Vijer & Hambleton (1996) differentiates between three distinct types of bias that may affect the validity of tests that have been adapted for different cultural contexts and these are construct bias, method bias and item bias.

Construct bias occurs when the construct (e.g. personality) that is measured by the test displays significant differences between the original culture for which it was developed and the new culture where it is going to be utilized. These differences can occur in the way that the construct was formulated and developed as well as in the relevant behaviors that are associated with the construct. It is critical to examine whether the underlying theory of the test is subject to construct bias and this can be examined through the studies examining the construct and its associated behaviors in the context that it will be utilized in. If there are significant differences found in these studies, it may indicative that there is construct bias. Major revisions may be required to overcome this bias. If not, the validity of the test will be affected.

Method bias refers to factors or issues related to the administration of the test that may affect the validity of the test. Examples of areas that method bias can occur include social desirability, acquiescence response styles, the conditions in which the test was conducted and the motivation of the respondents. Across cultures, there potentially can be differences that can occur in these areas and these can affect the way that the respondents answer the items in the test. This potentially may lead to differences between found that can be erroneously attributed to cultural differences when in fact, these differences are the result of differences in the administration procedures. As a result, it is threat to the validity of tests that have been adapted for use in new cultures. Test developers also not only need to focus on the adaptation of the test itself but also need to be aware of issues regarding the implementation of the test in a new context.

Item bias is another source of bias that can occur in the translation of tests and these refer to biases that occur with the items in the test. This is usually the result of either poor translation choices for items or due to culturally inappropriate translations. For example, the phrase “kick the bucket” is essentially a phrase that referring to passing away in the Western context and is commonly known by most people in that culture; unfortunately, this phrase would have no meaning for people from cultures without any prior experience with that phrase. In this manner, a literal translation of that phrase would be a poor translation as it does not convey the correct meaning of the item. The items in the test need to be culturally equivalent, where the meaning of the items needs to be correctly translated so as to maintain the validity of the test in the new cultural context.

These are some of the biases that may occur during the translation of tests. Test developers will need to be aware of the sources of bias and take the appropriate measures to avoid these biases.

References:

Van der Vijer, F. and Hambleton, R. K. (1996). Translating tests: some practical guidelines. European Psychologist, 1, 89-99.

Psychometric Training in Singapore, Hong Kong, Malaysia, and China
If you are serious about using psychometric tests properly then we recommend joining PsyAsia International’s Psychometric Assessment at Work Course which leads to a certificate of competence in Occupational Testing Level A and Level B from the British Psychological Society. The Course is run publically in Singapore and Hong Kong or in-house anywhere.
More details about BPS Level A and B in Singapore and Hong Kong

Online Psychometric Training – Worldwide
Alternatively, you might be interested in introductory Online Psychometric Test Training presented live by a registered psychologist. PsyAsia is offering a special fee of just US$12 for anybody who registers for the February online psychometric training course!
More details about online psychometric test training