Posts by Swati Karve

Swati Karve

Swati Karve has 20 years of experience in Training and Development, teaching and organizational consulting in India and US. She has a Masters in Clinical Psychology and PhD in Organizational Psychology. She has published articles in the ASTD T&D Magazine and ASTD Links. Recently she started her own...read more

Level III Evaluation Part II: Learning Objectives and Measurement

Before we move to defining the criteria for measurement for different training programs and methods of assessment at Level III, let us look at the relation between the learning objectives and assessment. This is because to do any evaluation, especially Level III, an understanding of the learning...read more

Level III Evaluation Part I: Transfer of Training

In the last blog, we considered Level II Evaluations, which focus on measuring the gain in knowledge after training. This can be done through pre and post training tests. We can also assess this by comparing the results of participants who have been through training to those who have not been...read more

Level II Evaluaiton 3: Level II Evaluation: Constructing Your Own Tests

Here we will consider the points to consider when you are creating your own tests. Define WHAT you want to measure: In Level II you are dealing with knowledge. It is simple to design tests that assess knowledge. However, there are several factors other that affect the validity of the test as we...read more

Level II Evaluation 2: Standardized Tests vs Designing Your Own Tests

As explained in the earlier blog, Level II evaluations measure the amount of learning that has happened in the training. The most important measurement tool is to test the participant on the knowledge. You have a lot of choice in making use of different types of tests to measure the gain in...read more

Level I Evaluations: Items Selection and Piloting

In the last blog on Level 1 Evalations, we looked at different scales that can be used in creating a survey. Here let us consider some of the characteristics the items on the scales need to have so that the respondents can answer the survey effectively. “Items” means the “questions” or “statements”...read more

Level 1 Evaluation: Deciding on the Survey Format

Level 1 Evaluation relates to the feedback of the participants to the training event. Typically the participants are given "smiley sheets" to indicate their level of satisfaction with the program. As discussed in the earlier post, many categories are evaluated during level 1 evaluation. They include...read more

Training Evaluation: Level 1 Evaluation

With a lot of focus on ROI on training, and other metrics of training, many times training managers and others forget that the good ol' Level 1 training feedback is also very important. The Kirkpatrick Level 1 measures the participant reaction or feedback to the entire training event. In fact, Level...read more

Imporance of Qualitative Feedback

The survey is one of the most important means of collecting data. The advantage is that it can be given to a large sample that may ensure a reasonable rate of return. However, the survey has disadvantage—it may not yield the finer details for what you are seeking data. For example, you have designed...read more

Training Evaluations: Who is Responsible?

In times when every penny counts, there is more demand on training managers to “prove” that training has paid off. Most organizations follow Kirkpatrick’s 4 Levels of Evaluation: The immediate feedback: The smiley sheets at the end of the training program where participants respond to questions on...read more
Survey Newsletter