Planning an Evaluation There Are Several Steps Essay

Download this Essay in word format (.doc)

Note: Sample below may appear distorted but all corresponding word document files contain proper formatting

Excerpt from Essay:

planning an evaluation, there are several steps an evaluator must take. One of the final steps in the planning process is to present a written proposal. What should the written proposal include, and why is it important to get the details of the evaluation in writing?

The steps that must be taken in the planning process for research or evaluation include the written proposal, which is comprised of specific sections. The first section of the research proposal is the introduction or background, which briefly provides information about the issue to be examined. The next section is titled the 'Research Objectives & Aims' which states the goals of the research that is being proposed. Following the objectives and aims of research is the 'Research Purpose' section, which sets out the reasons that the research is being conducted. The research proposal should contain a section entitled 'Significance of the Study', which relates the contributions that the study will make to the knowledge base existing and any new knowledge that might be provided. Next stated in the research proposal is the section entitled 'Justification or Rationale" which provides an explanation of why the research is important. The section that follows is the theoretical framework and conceptual framework. The theoretical framework examines existing or self-formulated theories relating to the objectives of the researcher while the conceptual framework is a set of variables, which a researcher will operationalize in the study in order to achieve the set objectives. The section entitled "Scope of the Research" provides "for the boundary of the research in terms of depth of investigation, content, and sample size, geographical, time frame and theoretical coverage. The section entitled "Literature Review" is such that examines literature in the area of research "with the objective of revealing contributions, weaknesses and gaps." (Makerere University, 2012, p.3 ) Finally, the proposal should contain a section summarizing the literature reviewed and its findings and state recommendations.

(2) According to the text, after evaluators and stakeholders have agreed on criteria that would indicate successful implementation and outcome, evaluators face the task of developing methods to measure those criteria. Measures should have both reliability and validity. Briefly describe the difference between reliability and validity and explain why they are important concepts when performing an evaluation.

Reliability and Validity

Reliability is defined as "the extent to which a questionnaire, test, observation or any measurement procedure produces the same results on repeated trials." (Miller, nd, p.1) Reliability is "the stability or consistency of scores over time or across raters." (Miller, nd, p.1) Reliability is reported to relate to scores rather than to people. Miller reports three aspects of reliability including those of: (1) equivalence; (2) stability; and (3) internal consistency. (nd, p.1) Equivalence is reported to refer to the "…amount of agreement between two or more instruments that are administered at nearly the same point in time. Equivalence is measured through a parallel forms procedure in which one administers alternative forms of the same measure to either the same group or different group of respondents. This administration of the various forms occurs at the same time or following some time delay. The higher the degree of correlation between the two forms, the more equivalent they are" (Miller, nd, p.5) Stability is such that occurs when the "same or similar scores re obtained with repeated testing with the same group of respondents." (Miller, nd, p.5) Internal consistency is related to the extent to "which items on the test or instrument are measuring the same thing." (Miller, nd, p.5)


Validity is reported to include the "entire experimental concept and establishes whether the results obtained meet all of the requirements of the scientific research method." (Experiment Resources, 2012, p.1) There is a requirement for randomization of the sample groups and appropriate care and diligence shown in the allocation of controls." (Experiment Resources, 2012, p.1 ) Internal validity is reported to dictate how an experimental design is structured and encompasses all of the steps of the scientific research method." (Experiment Resources, 2012, p.1) It is reported that control groups and randomization will reduce external validity problems but no method can be 100% successful.

(3) Briefly describe the difference between closed-ended and open-ended questions when conducting a qualitative interview.

Open-ended questions are reported to have the advantages of allowing respondents "to include more information, including feelings, attitudes and understanding of the subject. This allows researchers to better access the respondents' true feelings on an issue." (Answers, 2012) Open-ended questions cut down on two types of response error, respondents are not likely to forget the answers they have to choose from if they are given the chance to respond freely, and open-ended questions simply do not allow respondents to disregard reading the questions and just fill in the survey with all the same answers." (Answers, 2012) Open-ended questions enable the interviewer to obtain additional information from the respondent "such as demographic information and surveys using open ended questions are such that can be used in secondary analysis by other researchers than can surveys that do not provide contextual information about the survey population." (Answers, 2012) Open-ended questions allow respondents to use their own words making it different to compare meanings of the responses. Closed-ended questions can be analyzed more easily, they are more specific and more likely to communicate similar meanings than open-ended questions. In large-scale surveys, closed-ended questions are less time consuming for the interviewer and results in a survey method that is not as costly as those with open-ended questions.

(4) According to the text, an Institutional Review Board (IRB) is not necessarily required for a program evaluation. Please describe a situation where it would be appropriate to convene an IRB prior to conducting a program evaluation.

It is reported that the IRB must make provision of "substantive and meaningful review of research on a continuing basis at the interval established by the IRB at the prior review. IRB review must be performed by the convened IRB unless the research meets the criteria for expedited review." (Ohio State University, 2012, p.1) Research that is approved by the IRB must satisfy the requirements stated as follows:

(1) Risks to participants are minimized (but not necessarily eliminated) by using procedures that are consistent with sound research design and that do not unnecessarily expose participants to risks, whenever appropriate, risks to participants are minimized by using procedures already being performed for diagnostic or treatment purposes;

(2) Risks to participants are reasonable in relation to anticipated benefits (if any) and the importance of the knowledge that may reasonably be expected to result from the research. (Note: The IRB will consider risks and benefits that may result from the research, not risks and benefits of treatments or other activities the subject would undergo even if he or she were not participating in the research.);

(3) Selection of participants is equitable, taking into account the purposes of the research and the setting in which the research will be conducted.

(4) Informed consent is sought, obtained, and appropriately documented for each prospective participant or the participant's legally authorized representative as required by the regulations.

(5) If the research involves greater than minimal risk, the data and safety monitoring plan and/or data and safety monitoring board (where appropriate) makes adequate provision for monitoring the data collected to ensure the safety of participants.

(6) There are adequate provisions to protect the privacy of participants and to maintain the confidentiality of data in accordance with HRPP policy;

(7) When some or all of the participants are likely to be vulnerable to coercion or undue influence, such as children, prisoners, pregnant women, adults unable to consent for themselves, or economically or educationally disadvantaged persons, additional safeguards have been included in the study to protect the rights and welfare of these participants. (Ohio State…[continue]

Cite This Essay:

"Planning An Evaluation There Are Several Steps" (2012, October 12) Retrieved October 21, 2016, from

"Planning An Evaluation There Are Several Steps" 12 October 2012. Web.21 October. 2016. <>

"Planning An Evaluation There Are Several Steps", 12 October 2012, Accessed.21 October. 2016,

Other Documents Pertaining To This Topic

  • Planning A Literature Review in

    The value of this case study is demonstrative. It demonstrates how contingency planning can be used, but it says nothing of the results. A quasi-experimental design was used by Chermack & Kim (2008) to explore the effect of scenario planning on decision-making styles. It was found hat participants in scenario planning have a tendency to make a mental shift towards intuitive-based decision-making styles after their participation in the scenario planning

  • Strategic Planning at the Chronicle Gazette

    Strategic Planning at the Chronicle Gazette The Declining Newspaper Readership The Strategic Planning The Reestablished Mission of the Chronicle Gazette The Human Resource Planning The Importance of Strategic Planning The Evaluation Criteria The Anticipated Needs of the Organization The Strategies of the Competitors Internal Assessment of the Chronicle Gazette Strengths Weaknesses External Assessment of the Chronicle Gazette Opportunity Threats Proposed Strategic Plans for the Chronicle Gazette The case study presents a detailed and structured analysis of how the preferences of the newspaper reader shifted from the

  • Steps Towards Successful Project Management

    Project Management prioritizing projects d.D. WILLIAMSON Prioritizing Projects at D.D. Williamson Prioritizing Projects at D.D. Williamson As seen from the second chapter, Williamson could have reaped more benefits from project management team through proper training. Miscommunication and disorganization appeared to be the significant issues bedeviling the project (Kloppenborg & Nkomo, 2012). Planning and research formed critical tools for success of the project coupled with the incorporation of strong management skills. Firms work on numerous

  • Health Care Introduction to Evaluation Research Evaluation

    Health Care Introduction to Evaluation Research Evaluation Research is a vital aspect of organizational and program establishment and development. Used extensively across multiple industries, Evaluation Research encompasses dozens of methods, some of which overlap and/or encompass other methods. Though the methods vary, they ideally share the common characteristics of good basic research, systematic processes, data collection to increase knowledge, enhancement of decision making, and practical use of evaluation findings. In addition, despite

  • Succession Planning for Multi Faceted Enterprises and Organizations...

    Succession Planning for Multi-Faceted Enterprises and Organizations La Russa Enterprises Thunder Bay, Ontario Nadia La Russa The journey to this point in my academic career has been a long one, and challenging, however I am successful. A number of people have effortlessly contributed to my success, and I take this opportunity to thank them. First, it is with great honor that I thank my academic adviser he/she took on the obligation of advising me

  • Strategic Planning at the Chronicle Gazette Decline

    Strategic Planning at the Chronicle Gazette Decline of the Newspaper Publishing Industry Declining Circulation and Revenue Status of Leading Newspapers Reasons for Decline in Circulation and Revenue Economic Factors Political Factors Demographic Factors Technological Factors Porter's Model Strategies adopted by different Companies Steps to be taken by the Chronicle Gazette Form a Website Minimize Cost and Increase Efficiency Organization Structure Adopt Digital Technology Susan Feiman is the publisher of The Chronicle Gazette, which is one of the most prominent newspapers of the United States. It has

  • Strategic Planning and Implementation Over the Last

    Strategic Planning and Implementation Over the last several years, identity theft has become a major issue that a number of individuals are dealing with. This is because criminals are using various techniques to be able to gain access to a host of personal information including: bank accounts, credit card / social security numbers and the date of birth. Once this occurs, is when they can assume the identity of this person

Read Full Essay
Copyright 2016 . All Rights Reserved