1. Why are reliability and validity important for assessment? How are content validity and criterion-related validity used to establish construct validity? Support your position.
Assessment instructions, whether for measuring cognitive ability or intelligence, or for psychometrics like personality, need to be both reliable and valid; otherwise, their results would be meaningless. In fact, using unreliable or invalid assessment instruments could lead to distorted judgments and biased beliefs. The decisions made based on reliable assessments can be sound and productive, whereas decisions made based on invalid or unreliable assessments may be unethical. Assessment reliability refers to how consistent the results are, and validity refers to how well the instrument measures what it intends to measure (“Reliabiity and Validity,” n.d.). The same test administered to the same population at a different point in time should yield similar results—the “test/retest” effect (Sullivan, 2011, p. 119). Likewise, assessment reliability takes into account how the same test administered to a population with similar demographic characteristics such as age or nationality yields similar results. Similarly, different questions on the same instrument should yield similar results within that same population—something called internal consistency (Sullivan, 2011). The assessment questions should also be tested to determine whether they measure the desired construct.
Content validity refers to the way an assessment method matches the instructional objectives (“Reliability and Validity,” n.d.). Educational assessments provide the prime examples of the importance of content validity, as a test on Shakespeare should not include questions on Tolstoy. Criterion validity matches the assessment results with some other objective. For example, if extraversion is strongly correlated with high rates of sales among employees, then human resources would be using an instrument with strong criterion validity. Both content and criterion-related validity determine construct validity. Construct validity is similar to criterion validity but is more theoretical (‘”Reliability and Validity,” n.d.). One example would be when a personality test results correlate with worker productivity.
References
“Reliability and Validity,” (n.d.). Classroom assessment. https://fcit.usf.edu/assessment/basic/basicc.html
Sullivan, G.M. (2011). A primer on the validity of assessment instruments. Journal of Graduate Medical Education 3(2): 119-120.
2. Is a job-oriented, a worker-oriented, or a hybrid job analysis approach most appropriate? Why?
Job analyses can be job-oriented, worker-oriented, or hybridized. Job-oriented, or work-oriented analyses can be task-focused, functional, or based on critical incidents (Morgeson, 2017). Task-focused analyses involve listing all the necessary tasks required to complete a specific job effectively. To perform a task-oriented job analysis, it may also be important to take into account time spent performing each task.
Worker-oriented job analyses include specific methods like the Position Analysis Questionnaire (PAQ) (“Job Analysis Methods,” n.d.). Unlike the job-oriented approach, the worker-oriented analysis can be used to compare different jobs within the same department (Morgeson, 2017). Parameters of the PAQ include contextual variables, relationship or interpersonal variables, and also mental processes, making this analysis method potentially more robust than a job-oriented approach alone.
A hybrid approach to job analysis is, as the term suggests, a combination of worker-oriented and job or task-oriented analyses. Given the complexity of most positions, particularly within the information and services sectors, the hybrid approach is the most appropriate for many firms. However, there are many positions for which human resources managers might want to perform either a worker-oriented or job-oriented analysis. The hybrid approaches can be time consuming and unnecessarily complicated when applied to positions that are better assessed via paying attention to key variables.
However, the hybrid approach does take into account factors such as the experience required, education and training, and even personality characteristics. Providing an abundance of information along various domains, a hybrid approach to job analysis such as the Occupational Information Network helps companies to strategize their organizational structure more effectively.
References
“Job Analysis Methods,” (n.d.). Psychology. http://psychology.iresearchnet.com/industrial-organizational-psychology/recruitment/job-analysis-methods/
Morgeson, F.P. (2017). Job analysis methods. The SAGE Encyclopedia of Industrial and Organizational Psychology, 2nd edition. https://msu.edu/~morgeson/morgeson_2017b.pdf
You’re 100% through this paper. Sign up to read the full paper.
Sign Up Now — Instant Access Already a member? Log inAlways verify citation format against your institution’s current style guide requirements.