Note: Sample below may appear distorted but all corresponding word document files contain proper formattingExcerpt from essay:
Telephone Customer Service Representatives
Employment Assessment - Telephone
How do you interpret the reliability results for the clerical test and work sample? Are they favorable enough for the company to consider using them for keeps in selecting job applicants?
A primary objective of evaluating two new methods of assessing candidates for positions as telephone customer service representatives for the Phonemin Company is to improve the caliber of the employment pool from which new hires are selected. The participation of customer service representatives in the telephone ordering system of the company is critical to this endeavor. Moreover, the company will be adding roughly 40 employees to the call center in order to meet the anticipated growth in phone order sales. From this, it is readily apparent that effective means of assessing candidates for the positions of telephone customer service representatives is needed. The reliability figures for the current employee candidate system, which is comprised of a clerical work test and two work samples, are as follows:
For the clerical test, reliability is indicated with a high alpha coefficient of 0.85 and 0.86. This is a reasonably high reliability score. And the test-retest reliability score is even higher, at a very solid 0.92.
The work sample (T) reliability scores show an inter-rater agreement at 88% and 79%, both of which are adequate scores for inter-rater reliability. Higher reliability scores would be preferable. The work sample (C ) inter-rater reliability scores are 81% and 77%. Again, these inter-rater agreement percentages are adequate, but lower than the percentage typically desirable for inter-rater reliability scores.
Overall, the company can be comfortable using these the work samples and the clerical work test as measures to assist with the selection of candidates for positions as telephone order sales customer service representatives. The company should, however, consider undertaking measures to improve the inter-rater reliability scores for the assessments. Typical ways of improving inter-rater agreement are to increase specificity in the rating protocol and to provide additional training and periodic recalibration of raters. This is so because a known weakness of inter-rater reliability is drift, a term used to indicate movement away from the standards set by the rating protocol by the raters over time, and an increasing distance between the raters scores from each other (Shoukri, 2010).
2. How do you interpret the validity results for the clerical test and work sample? Are they favorable enough for the company to consider using them for keeps in selecting new job applicants?
Validity is a pivotal metric with any assessment. Psychometrists take precautions to ensure that validity of the instruments they use is sufficiently robust to enable confidence in the measures. Validity figures are achieved through scientific measures that are designed to assess the particular type of validity under review. Scientists regularly utilize the following types of validity: Content validity (types are face validity, curricular validity), criterion-related validity (types are predictive validity, concurrent validity), construct validity (types are convergent validity, discriminant validity), and consequential validity ("Validity evidence," 2014). Content validity examines the match between the content (often a subject area) that is being assessed and the actual test questions ("Validity evidence," 2014). Curricular validity is an expression of the extent to which a test matches specific objectives of a curriculum that is part of the training or education processes ("Validity evidence," 2014). Criterion-related validity examines the relationship between test scores and some relevant outcome, which in the assessment of candidates for employment is actual job performance ("Validity evidence," 2014). Construct validity is the degree to which a testing instrument or particular measure serves to assess the underlying theoretical construct ("Validity evidence," 2014). Consequential validity, a construct that is familiar to human resources personnel and social scientists, is a term used to refer to the social consequences of using a certain test for a particular purpose ("Validity evidence," 2014).
Criterion-related validity is the type most commonly of interest in performance and other psychometric tests used to assess the suitability of candidates for employment ("Validity evidence," 2014). The relevant figures for the clerical test include the following: Work sample (T) and work sample (C ) correlations are low and are not significant. The criterion-related validity measures of the clerical test show significant correlations with a negative error rate and a…[continue]
"Developing Best Employee Performance Assessment For Call Centers" (2014, July 02) Retrieved December 2, 2016, from http://www.paperdue.com/essay/developing-best-employee-performance-assessment-190250
"Developing Best Employee Performance Assessment For Call Centers" 02 July 2014. Web.2 December. 2016. <http://www.paperdue.com/essay/developing-best-employee-performance-assessment-190250>
"Developing Best Employee Performance Assessment For Call Centers", 02 July 2014, Accessed.2 December. 2016, http://www.paperdue.com/essay/developing-best-employee-performance-assessment-190250
Emotional Labor Implications on a Call Centre During the last two decades Contact or call centers have emerged as the answer to cost effectiveness for all sort of businesses that require back end customer services (Boreham et al., 2007). These call centers hailing from different countries are very similar with respect to markets, offered services, structure of the organization and type of workforce. This industry has flourished very quickly but usually these
The initial recommendation comes from the employee's direct supervisor and is then discussed with the general director and the payroll manager. At the fourth stage, the performance review, the employee and his direct supervisor come once again face-to-face to discuss the outcome of the performance appraisal process. The employee is informed of the managerial decision regarding future remunerations, and a date for a new meeting is set. The new meeting
Organization Performance Assessment Organizational performance assessment can be defined as a process of evaluating the performance of an organization against some well defined goals and targets. It lays much emphasis on the accomplishments of an organization in relation to its mission and the stated objectives. In the situation of a government department, the assessment would check the major mandates, ambitions, priority and the performance schedules and evaluates the advancements that have
Employee Satisfaction with a Company's Review Process The following research examines the reason for a decline in employee satisfaction regarding the review process at XYZ, Inc. The results of the survey revealed that sample biases may have confounded the results and that the survey will have to be re-administered to reflect the true attitudes and results of the preliminary research leading up to the current survey. The result showed a high
Performance of the Company Annual reports Statements of corporate goals SWOT analysis of United Health Group 9A PESTEL Analysis In this paper, we present a systematic analysis of the United Health Group through a SWOT and PESTEL analysis. The analysis is aimed at the identification of an internal problem within the company's environment and then prescribing a suitable solution to it. The identified problem is poor Ergonomics. This is then explored and then recommendations
Human Potential Developing Human Potential When an organization makes the decision to take an individual on as a part of staff, effectively they are making a human capital investment in that individual (Lepak & Snell, 1999). Where the organization pays for the training of, insuring of, and salary to that individual they in turn are expected to perform the tasks within their job description efficiently and accurately thus allowing the organization to
BEST BUY CO. INC. STRATEGIC ANALYSIS Strategic Analysis of Best Buy Current situation A- Current performance B- Strategic posture Corporate Governance A- Board of directors B- Top management External Environment: Opportunities and threats A- Natural physical environment B- Societal Environment C- Task Environment D- Summary of external environment Internal Environment: Strengths and Weakness A- Corporate Structure B- Corporate Culture C- Corporate resources D- Summary of internal environment Analysis of Strategic Factors (SWOT) A- Situational Analysis Strategic Alternatives and Recommended Strategy A- Strategic Alternatives Recommended Strategy Implementation Evaluations and control Part II Functional and Business strategies of