Campbell Interest and Skill Survey CISS Assessment Test Critique Structure

TEST CRITIQUE STRUCTURE

Test Critique Structure of Campbell Interest and Skill Survey (CISS) Assessment

In today’s modern world, where more deployment of artificial intelligence is observed, people have become anxious about their importance as the necessary ‘human labor’ for employment in a globalized world (Blustein, Ali & Flores, 2019). People want to work for a living but are worried whether the technology would entirely replace them. Vocational psychologists are now debating the changing nature of work and human psychology regarding specific occupations and skills. Campbell Interest and Skill Survey (CISS) is considered a vital tool for assessing the individual’s fitness for the jobs they are interested in. This paper aims to provide a detailed critique of the said instrument and its application in the contemporary world.

Introduction of the Assessment Survey

David P. Campbell created Campbell Interest and Skill Survey assessment. This tool’s purpose is self-reporting by the individuals whose occupational interests are related to a specific job. It is a 25-30 minute test in which the scales of this assessment are developed so that the individual’s aptitude for a certain occupation, based on his ability to complete his tasks with confidence, could be evaluated. Employment specialists and the hiring officers use this tool to assess whether the applicant is apt for a particular job. Career development in new avenues would be possible for the individual. Personal counseling is also offered based on this instrument so that the skills could be built that are needed for a certain profession. Even the displacement of employees due to lack of specific skills is also traced by this tool so that transitioning in outplacement programs could be made convenient.

The CISS tool’s creation and development started a few decades ago when David Campbell started working on improving another tool called String Interest Inventory (SII) (Taylor & Donnelly, n.a.). SII is still reviewed as one of the strongest foundational instruments for the same purpose; however, David Campbell’s entry for its development was justified when E.K. Strong fell ill. The research and development for Strong’s assessment tool were at risk. David Campbell helped and published a new improved version in 1974 named Strong-Campbell Interest Inventory (SCII). This early version had single-sex incorporation within the scales and soon changed when the gender equality argument was on the rise.

The publishers contemplated that gender composition for the assessment tool was essential, and modification was required for fair evaluations of interests for both genders. The inclusivity of female-focused occupations was to be taught within the survey, and hence, in the 1980s, the advancements were initiated. Unluckily, the legal conflict between Campbell and Stanford University Press for intellectual property rights of SCII rose, and the University became successful in gaining the rights of SCII. Until then, Campbell decided to pursue his differentiated development with his comprehensive knowledge and continued developing CISS by holding its rights and developmental purposes.

The reputation of the instrument could be guaranteed if it is high in reliability. It is considered an effective tool for measuring college students’ propensity for entering the practical world since that is the high time they start thinking about their careers. Based on the educational degrees they are to complete, their skills and knowledge are carefully tested by this assessment tool, including a procedural check to avoid any possible miscalculations. It is also proven effective in balancing the employers’ misconceptions of the new applications coming for interviews in the human resource department and their actual skills required for the job they are applying for. The H.R. officials can benefit from this measurement by exploring occupational and college choices where gender stereotyping is predominant.

The instrument is believed as new, although its latest version was upgraded in 1995. Though, after a certain number of protests about scales, it was constantly edited to be made as much inclusive of the genders and plethora of occupations for skills matching as possible. The new skill measurement was presented as a monumental example. The scales are standardized and could be used in modern world evaluations for the person’s tendency to possess skills for a career. Combined gender scoring and testing for several years make it a valuable and knowledgeable tool to be merged with modern technology occupations.

Items

There are 320 questions in the survey: 85 questions related to occupation, 43 related to school subjects, and 72 pertinent to interesting activities (Taylor & Donnelly, n.a.). Another 120 questions are for assessing the skills required for the job. The 6-point Likert scale is used for the survey, known as suitable for ages 15 and above. There are two options for taking the test, either with pen or pencil or online. There are colored interpretation features for enhanced perceiving of the results. The scales are easily understood and match the present-day requirements of job placement. The reading level is as easy as that of sixth grade and could be used by college attending students to pursue their careers (Boggs, 1999; Hansen & Leuty, 2007). The test items do not discriminate based on gender, religion, race, or nationality. There is a wide variety of included occupations in the survey, so skill matching is done without any hassle.

A variety of scales are set for the accurate computation of results. The scales include interest and skill scales, orientation, occupational, procedural, and special scales. The basic interest and skills scales include testing individuals’ orientation like influencing, organizing, helping, creating, analyzing, adventure and producing (Taylor & Donnelly, n.a.). The orientation scales help determine whether an individual’s certain capacity would be helpful in a particular job. It would help analyze whether the individual would be confident in performing certain tasks and attracted to the designated area of expertise. For instance, if he scores high on ‘influencing,’ he would be apt for enterprising jobs. This matching of the skills orientation benefits hiring officers and vocational psychologists in gauging the best possible equalizing of the abilities with the industry’s job requirements. The occupational scales assist in finding the right and suitable careers matching the job interests of the applicants. The occupations’ specific profiles are appraised to understand the abstract, and conceptual terms could be made better. Again, if the individual scores high in orientation abilities such as influencing, his job matching would be appropriate for leading, negotiations, and marketing professions (Pearson Assessments, 2009). The special scales include extraversion and academic focus since high scoring on extraversion would determine whether the individual is comfortable contacting people and making interactions with new people. High scoring on academic focus determines the capability of studying, research conduction, and lecturer in academic institutes. The procedural checks are two scales presented for re-checking whether the individual made any mistake while responding to the survey. It is a ‘double-check’ kind of scale where the individual’s inattentiveness or distraction could have played a part, or he could have given wrong responses. This is where modifications could be made if the individual thinks that his responses were unusual and might mislead the evaluator about his occupational orientations.

The scales seem coherent since they have a quality of being logical and consistent throughout the survey. They measure what they aimed at in the beginning. The problem they are trying to assess is measured coherently since the scales are broadly formulated keeping in view skills, expertise, and aptitude levels of an individual for the jobs they are interested in. the initial criticisms of the survey, which were related to gender discrimination and gender-focused jobs, are also eliminated. It leads to the fact that the survey is a comprehensive analysis inclusive of both genders and their job preferences that reflect a unified whole.

The item that stood out for me was the last section of the survey, where procedural checks have been mentioned. These are the essential checks for an accurate assessment of the individual and his abilities. It is to verify whether any mistakes throughout the survey and any inclination of such circumstance could be amended on the spot. It reduces any likelihood of errors and increases the accuracy and validity of the survey, making it a reliable assessment tool for any individual regardless of gender or occupation.

Quantitative Measures

The quantitative measures of CISS include reliability and validity. It was investigated over 90 days that median test-retest reliability coefficients for orientation skills were 0.87, for basic skills was 0.83 and for occupational interest scales was 0.87 (Statistics Solutions, n.a.). Although the skills scales were 0.81, 0.79, and 0.79 depicting lower coefficients, still the assessment tool provides enough evidence of construct validity and concurrent validity for the occupational scale. The reliability coefficient (alpha) and test-retest correlations were favorable for this assessment (Taylor & Donnelly, n.a.). The temporal stability was considered good since the test-retest reliability coefficients gave results above 0.80. Thus, it has good standing of being a consistent measurement tool for measuring vocational orientations.

The scale’s inter-correlations show the validity of CISS. The examinations of the individual’s engagement in occupations that would score a higher rating gave a theoretical explanation of the validity. The theoretical relations were further derived from the specific interest and skills related to satisfaction and success as the correlation between these two criterion variables was explicit. There is a condition for these scales to be valid. A contrast created in the professional samples relevant to their degree of engagement and the significant difference of relevant interest and skills distribution would exhibit CISS scale validity.

Additionally, CISS was evaluated for its construct validity by computing correlations between the interest orientation scales and skill orientation scales (Taylor & Donnelly, n.a.). The correlations turned out to be 0.76 and 0.66, and their median was 0.70. This is suggestive of the fact that 50% of the variance is common and construct validity exists. An objective approach for examining the construct validity is advised that involves its measurement with a well-renowned instrument that is validated (Sullivan & Hansen, 2004).

Fifty-eight different professional samples were taken to compute concurrent and predictive validity from the mean scores of interest and skill scales. The mean scores were ranked from the highest rated to the lowest ones so that the strongest occupations in which more people have interest could be designated, most commonly known as the orientation scale in CISS. Professions were pointed in front of each orientation scale in seven categories so that the best-suited skill for the relevant occupation was easily marked.

An in-depth analysis of the reliability measures indicates that more than one kind of reliability test was used. Test-retest reliability for three scales and the reliability coefficient were calculated so that the assessment tool is dependable. However, Cronbach’s alpha for validity was not observed for the assessment tool under discussion. It is a coefficient that determines internal consistency among all the scales of an assessment instrument. Contrarily, other measures of validity are present such as construct validity, concurrent and predictive validity. They are powerful validity tests; for instance, concurrent validity shows that if discrimination between two groups is quite similar, then the measures are considered strong.

Qualitative Measures

The instrument has been used several times and is still being used worldwide by the individuals themselves and even in formal organizations so that skill matching for occupational orientations could be reviewed effectively. It is advised that even if the individual self-conducted, it should be reviewed by expert career counselors to understand the scales and measures that indicate accurate results. There were numerous erroneous attempts in the beginning when this assessment tool was in the developmental stages; however, its repeated testing over several individuals produced different findings that helped in making the tool better each time. The foundations were set on Binet’s techniques of standardization and normal responses (Campbell, 1995). The scores themselves show the candidate’s self-efficacy and strength so that his self-confidence in his skills could produce a stronger aptitude for a certain occupation. The more empirically accurate the skill measures are, the more surety there is that the candidate would perform well in his interesting occupation. The appositeness of the tools, procedures, and data collection for the applicants is done accurately, signifying that quality is present. The researcher has made the assessment tool credible by his ability to incorporate the best corresponding scales and skill areas. Consequently, the research for the assessment survey becomes credible.

Comparison and Critique

Compared to other instruments used for the same purpose, Campbell’s assessment survey is more comprehensive and reliable. There have been several reliability, and validity tests run on CISS that produce favorable results for the usage of assessment evaluation. Other similar tools such as Self-Directed Search that has been formulated by Holland himself, whose personality types are the foundations of any vocational interest survey that is designed today, Vocational Preference Inventory, Kuder Occupational Interest Survey, and Strong Interest Inventory have proven effective in measuring the concern that they are aimed at.

It can be considered equally effective as the others since it has a broad range of evaluative measures relevant to personality types, self-conceptions, behaviors required to cope with certain occupational issues, and self-identification. Almost all of these same characteristics are found in the Vocational Preference Inventory mentioned earlier has given foundational grounds for CISS.

Holland’s career theory gives a strong basis for all of the vocational inventories like CISS since people like to opt for jobs that are more similar to people who are like them (Tang, 2009). This unity is found in CISS as the individuals’ personalities must resonate with the career and working environment to match their personality.

However, an extended discussion has been seen on CISS’s benefits and appropriateness for evaluating an individual’s skills required for the job he is interested in. However, it should be noted that it has a shortcoming that the assessment survey might be less useful for those who keep on changing their jobs frequently. The current workforce has inherently developed this feature of regular occupation change since they might not be satisfied with their employers or do not find supportive work environments.