Comparative Review of Problem Solving Assessment Tools Through Learning Orientation: A Focus on Hon
In assessing problem solving negotiation capabilities in a graduate level course taught in the law faculty of the University of Hong Kong, students are trained to use a peer-evaluation feedback sheet. The sheet is used following in-class negotiation simulation exercises. The use of this instrument is based on a number of underlying assumptions: 1) students can be active agents of their own learning; and 2) a learning-orientation methodology positively correlates with the development of knowledge, insights and capabilities.
Learning orientation is a relatively field most recently discussed in management literature. Its focus is primarily on attention toward self-referent levels of performance. Through feedback on past performance in order to evaluate current performance, individuals with a learning-oriented approach focus on improving skills and acquiring knowledge, and are less concerned with ‘making mistakes.’ Such an approach, according to recent research, leads to greater intrinsic motivation.
The in-class assessment tool is divided into 3 sections that correlate with three stages of the collaborative problem solving process: 1) Framing, 2) Dialogue and 3) Decision Making.
In the first stage of Framing, students are asked to evaluate their negotiating partners capabilities in:
Creating a supportive physical space for the negotiation
Making an opening statement that establishes a collaborative negotiation climate
Attitude, tone of voice, body language contributed to creating a collaborative climate.
In the second state of Dialogue, students are asked to provide feedback on their negotiating partners ability to engage in an effective process of listening, informing and identifying common ground. Finally in the last phase of Resolution, students provide feedback to one another on capabilities in the following areas:
Reframing the conflict as a mutual problem to be solved in partnership
Engaging in creative brainstorming to generate innovative solutions to the problem-solving and transformative levels of the conflict
Considering how follow-through will be undertaken
The benefits of this approach include the development of capacities for continuous learning, strengthening the habit of self reflection, improving the ability to give constructive peer feedback, transforming the view of stumbling blocks as stepping stones to progress, reminding students of the goals and principles of the collaborative negotiation process, and providing an opportunity to make adjustments based on constructive feedback.
The drawbacks of the approach are likewise apparent. In the assessment context, peer evaluation creates difficulty in effective quantification and measurement, and therefore difficulty in translating assessment into course grades. Furthermore, subjective viewpoints can lead to a high degree of variation in feedback. As a result, students are generally assessed on their participation on the feedback process and on other more objective measures such as student’s negotiation skills journal, in-class presentation and research paper.
 DeShon, R.P. & Gillespie, J.Z. (2005). A motivated action theory of goal orientation. Journal of Applied Psychology, 90, 1096-1127.
 Elliot, A. & Church, M. (1997). A hierarchical model of approach and avoidance achievement motivation. Journal of Personality and Social Psychology,72, 218-232.