A STUDY OF STOCK ISSUES, JUDGING CRITERIA,
AND DECISIONS IN DEBATE
James C. McCroskey and Leon R. Camp
The need for research has been a repeated concern of teachers of speech
since the founding of the Speech Association of America a half-century
ago. One segment of the field of speech, academic debating, was the subject
of relatively few studies until recent years. During the past decade several
studies have been reported concerning judging and stock issues in debate.
The purposes of the study reported below were to replicate portions of
several of these studies and to consider some questions not considered
in previously reported research. Specifically, this study was designed
to shed some light on the following questions:
1. Which stock issues tend to be the most important in judges' and debaters' minds?
2. During which speech does the most important issue tend to become evident?
3. Do partners tend to agree on the major stock issues in their debates?
4. Do winning debaters tend to recognize the most important stock issue more often than losing debaters?
5. What factors contribute to a debater's ability to recognize the most important stock issue in a debate?
6. Can debaters render objective decisions in the debates in which they are participants?
7. Is there a relationship between debater and judge agreement on stock issues and decisions?
8. What is the relative importance of selected criteria in arriving at decisions in debates?
9. Does the judge's bias on the topic enter into his decision?
PROCEDURE
The data for this study were obtained by three questionnaires submitted
to judges and debaters at the annual Southern Speech Association Tournament
in Houston, Texas, April 8-10, 1964.1 Each judge was asked to
complete Judges Form I at the completion of rounds 3, 4, 5, and 6 in the
college division and at the completion of rounds 3 and 4 in the high school
division. On this form the judge was asked to indicate the decision in
the debate, his personal opinion on the topic, what stock issue he considered
to be the most important in the debate, and during which speech the issue
became apparent to him. The stock issues the judge was asked to consider
were as follows:
1. Need (Is there a problem in existence which is serious enough to require action to alleviate it?)
2. Inherency (Is the cause of the problem an intrinsic part of the present system, or can it be overcome with minor modification?)
3. Plan (Would the action suggested by the affirmative overcome the problem?)
4. Practicality (Is it reasonable to assume that the affirmative proposal could be implemented?)
5. Desirability (Would the adoption of the affirmative proposal be advantageous or disadvantageous to society?)
6. Counterplan (Is a substitute proposal suggested by the negative a
better solution to the problem than the affirmative plan?)
Each judge was asked to complete Judges Form II once during the tournament. On this form he was asked to rank from one to seven various criteria for judging debate. Space was provided for adding criteria not listed on the questionnaire. In addition, the judge was asked to indicate his occupation.
Debaters were asked to complete a questionnaire similar to Judges Form
I at the completion of rounds 3, 4, 5, and 6 in the college division and
at the completion of rounds 3 and 4 in the high school division. On this
form he was asked to indicate what he considered to be the most important
stock issue in the debate, who he thought won the debate, which side he
had debated, his high school debate experience, his college debate experience,
and whether he had a course in argumentation and/or debate.
RESULTS
Table 1 reports the percentage of debates in which each issue was considered
most important by judges and debaters in each division of the tournament.
The need issue was considered most important in a majority of the debaters
by both judges and debaters in both divisions. Inherency was the second
most important issue in the college division; plan ranked second in the
high school
TABLE 1
Relative Importance of Stock Issues in Debate
Judges | Debaters | |||||
Stock Issue |
College Division |
High School Division | Total |
College Division |
High School Division | Total |
Need | 64.4% | 68.6% | 66.0% | 73.4% | 53.4% | 66.4% |
Inherency | 16.9 | 3.1 | 12.4 | 15.6 | 4.6 | 11.7 |
Plan | 13.8 | 12.5 | 13.4 | 8.2 | 20.6 | 12.5 |
Practicality | 3.1 | 3.1 | 3.1 | 1.2 | 6.1 | 3.0 |
Desirability | 1.5 | 6.3 | 3.1 | 1.6 | 4.6 | 2.7 |
Counterplan | 0.0 | 6.3 | 2.1 | 0.0 | 10.7 | 3.7 |
division. The findings of a similar study by Giffin and Megill were
in general agreement on the importance of the need issue.2 There
was a marked difference, however, on the importance of other issues. Their
findings were as follows:
Need | 44.7% |
Solution (Plan) | 15.5 |
Workability (Practicality) | 25.2 |
Disadvantages (Desirability) | 14.6 |
Counterplan | 0.0 |
On the basis of these studies it is clear that the need issue is considered the most important by judges and debaters, while the counterplan issue rarely assumes importance. To determine the importance of the other issues further research will be needed.
Giffin and Megill found that the most important stock issue in the debate
was determined by the judge frequently in either the first or second negative
speech. As indicated in Table II, no such trend was found in this study.
Similarly, no issue was found to be recognized substantially more often
in one speech than another.
TABLE II
Speech in Which Judge Determined Major Issue
College Division | High School Division | Total |
|
First Affirmative Constructive | 18.8% | 21.9% | 19.8% |
First Negative Constructive | 31.2 | 15.6 | 26.0 |
Second Affirmative Constructive | 25.0 | 28.1 | 26.0 |
Second Negative Constructive | 18.8 | 21.9 | 19.8 |
First Negative Rebuttal | 6.2 | 12.5 | 8.4 |
First Affirmative Rebuttal | 0.0 | 0.0 | 0.0 |
Second Negative Rebuttal | 0.0 | 0.0 | 0.0 |
Second Affirmative Rebuttal | 0.0 | 0.0 | 0.0 |
In 21.7% of the debates in the tournament considered by Giffin and Megill, judges did not determine the major stock issue until the last three rebuttal speeches. In the tournament studied by the writers, no judge found it necessary to wait until this point to determine the most important stock issue.
One item of information that was gleaned from these data could prove helpful for debaters. The debater during whose speech the judge determined the major stock issue tended eventually to win the decision. Specifically, this was the case in 55 of the 88 debates from which completed questionnaires were available. The probability that this could occur by chance is .10 > p > .05. While this is not a high level of significance, it does tend to indicate that there may be a relationship between the judge's point of determination of the major issue and who will win the debate. The debater would be wise to take this possibility into account.
Table III reports the degree of agreement between partners on the most
important stock issue in the debate. The possibility of the indicated proportion
of agreement to disagreement occurring due
TABLE III
Agreement on Stock Issues by Partners
College Division |
High School Division | Total |
|
Teams Agreeing on Issue | 88 | 43 | 131 |
Teams Disagreeing on Issue | 31 | 20 | 51 |
to chance is less than 1% for the college division and less than 5% for the high school division. This is an encouraging sign, for if partners can not agree on the major issue the likelihood of their working together as a team is greatly diminished.
The importance of teamwork is indicated by examining the debates in which partners on one team agreed with each other on the major stock issue while partners on the opposing team were in
disagreement with each other. Of the fifteen debates in which this occurred, the partners that agreed with each other on the major stock issue won fourteen. This strongly indicates that partner agreement is a significant factor in successful debating.
Because the ability to recognize the major stock issue in the debate
should indicate ability in analysis, it would seem reasonable to assume
that those debaters who recognize the major stock issue should tend to
win more debates than those who do not. Table IV reports the data concerning
this question. It appears that there is a trend in the hypothesized direction,
but it is not statistically significant. A need for further research with
a larger sample would seem to be indicated.
TABLE IV
Agreement with Judge on Stock Issue and Ability to Win Debate
Debater Won | Debater Lost | Total | |
Debater Agreed with Judge | 90 | 82 | 172 |
Debater Disagreed with Judge | 64 | 70 | 134 |
From the above discussion we may conclude that it is far more important for debaters to agree with their partners on the major issue than it is for them to agree with the judge. Such agreement, however, should not be considered a guarantee for winning debates. In 38% of the college debates and 37% of the high school debates all four debaters agreed upon the most important issue. Obviously, half of these teams lost.
Noting the fact that more debaters agreed with the judge on the major
issue in the debate than disagreed, the writers tried to determined what
factors contributed to this result. Tables V and VI report the findings
on two of these factors. It is readily apparent from Table V that experience
was not a significant factor in improving the student's ability to pick
out the major stock issue. In fact, the only difference that approaches
significance is between debaters who had high school and college experience,
and those who had college experience only. The significance of the difference
is .10 > p > .05 in favor of those debaters who had only college
experience. This would tend to indicate that not only does high school
experience fail to help the college debater determine the major
stock issue, it may even be harmful.
TABLE V
Experience of Debater and Ability to Pick Out Major Stock Issue
High School and College | College Only | ||
Agree on Issue | 69 | 51 | |
Disagree on Issue | 73 | 33 | |
Experience |
|||
College 1 Year |
College More than 1 Year | High School 1 Year |
High School More than 1 Year |
77 | 43 | 21 | 43 |
60 | 37 | 22 | 37 |
If recognition of stock issues is as important to successful debating
as writers of many textbooks infer (and as the writers of this paper believe),
this area should receive considerable attention in argumentation and debate
courses. The data reported in Table VI indicate that course work in argumentation
and debate did not improve the debaters ability to recognize the major
stock issue. In fact, those debaters who had no course work did slightly
better than their friends who had such course work. Perhaps this suggests
that instructors should re-examine the treatment of stock issues in their
courses.
TABLE VI
Course Work in Argumentation and Ability to Determine Major
Stock Issue
Had Course | No Course | Total | |
Agree on Issue | 90 | 90 | 180 |
Disagree on Issue | 74 | 67 | 141 |
Some writers have suggested that debaters could adequately judge themselves.
Two previously reported studies indicate that debaters' judgment corresponds
quite closely with critics' judgment on ratings and rankings.3
A study reported by King and Clevenger indicates that the reverse is true
with decisions.4 Our findings, as reported in Table VII, agree
with the latter. Only 29 of 284 debaters believed they had lost. Thus,
if the students had been judging the debates in this tournament, 89.4%
would have awarded themselves the decision. It can be reasonably
concluded that debaters tend to over-estimate their ability. Very few debaters
are able to recognize that they have lost a debate.
TABLE VII
The Relationship Between Debaters' Decisions and Judges' Decisions
Judges' Decisions | ||||
Win | Loss | Total | ||
Debaters' | Win | 141 | 114 | 255 |
Decisions | Loss | 3 | 26 | 29 |
Those debaters who recognized they had lost the debate were mostly in the college division. Table VIII indicates there was a strong relationship between the debater's ability to determine the major stock issue and his ability to agree with the judge on the decision. The probability that this apparent relationship could occur by chance is .05 > p > .02. Thus, the ability to determine the major stock issue will help a debater to decide whether or not he won the debate, even if it won't help him alter the decision.
In 1959 Giffin reported a study of criteria employed by 34 debate judges
at the "Heart of America" tournament.5 Giffin suggested
seven criteria and asked the judges to "allot numerical portions"
of the ratings they gave each team to these criteria. Using the same criteria,
the present writers asked the 63 judges at the Southern Speech Association
tournament to rank these criteria from one to seven on the basis of their
importance in reaching decisions. Table IX reports the rankings
TABLE VIII
Agreement on Issues and Decisions: College Division
Agreement on Issues |
|||
Agree | Disagree | ||
Agreement
on Decisions |
Agree | 58 | 40 |
Disagree | 31 | 41 |
of the three divisions of judges, the total group and Giffin's findings
translated into rank order. The ranking reported in Table IX is based on
the mean rank of each group. It should be noted that this procedure is
statistically questionable. However, ranks based upon median and modal
ranks are almost identical with those reported. It can, therefore, be assumed
that the mean rank procedure has not distorted the opinions of the judges
sampled.
TABLE IX
Relative Importance of Criteria in Arriving at Decisions in
Debate
Criteria |
College Coaches (N = 21) |
High School Coaches (N = 21) | Others (N = 21) |
Total Group (N = 63) |
Giffin Study (N = 34) |
Case--selection of logically defensible arguments | 1 |
1 |
4 |
1 |
1 |
Analysis--ability to analyze the topic-area | 2 |
2 |
3 |
2 |
3 |
Organization--ability to organize ideas into a structured whole | 3 |
3 |
1 |
3 |
6 |
Evidence--support of argument with information | 4 |
4 |
2 |
4 |
2 |
Refutation--perception of irrelevant or irrational arguments | 5 |
5 |
7 |
5 |
4 |
Language--phrasing of concepts clearly and concisely | 6 |
6 |
6 |
6 |
7 |
Delivery--ability to speak well | 7 | 7 | 5 | 7 | 5 |
Several observations based upon these data are noteworthy. The college and high school judges were in complete agreement on all items. The concern sometimes expressed by college coaches regarding the "competence" of high school coaches to judge college debaters seems completely unfounded, unless the college coaches also wish to question their own competence. However, the "other" category showed substantial disagreement on the criteria for judging debate.6 Although these findings conflict with those of a study reported by Roever and Giffin,7 some support is provided by this study for those who would bar such individuals from judging in tournaments. Decisions from this group could be expected to vary considerably from those rendered by the coaches.
These findings also seem to indicate a need for a change in ballot construction. Since most standard tournament ballots include delivery as one of five criteria for ratings, it is significant that the coach-judges in this tournament considered delivery the least important judging criterion. (The median rank was 7 as the modal rank.) Since usually only five criteria appear on ballots, it would seem reasonably to omit delivery from ballots altogether.
The final problem considered in this study was judges' bias and its
relation to decisions. A study reported by Scott indicated that judges'
bias on the topic had no effect on their decisions.8 In an attempt
to replicate this study, the writers asked each judge to indicate his personal
belief on the topic and the decision he rendered in the debate just completed
on Judges Form I each round. No reliable conclusions can be drawn from
the data obtained. Twenty-one judges voted with their bias; twenty-five
voted contrary to their bias. Most significantly, however, over half of
the judges, fifty-two, refused to express an opinion. One might speculate
that these people were voting with their bias and didn't want to admit
it, even though the questionnaire was anonymous. It is not known whether
Scott was faced with this problem. He did not report the percentage of
judges who refused to state their opinion on the topic. Thus, the question
of judges' bias entering into decisions remains unanswered.
CONCLUSIONS
While not all of the questions for which this study was designed have
been answered by it, and while any conclusions must be qualified to the
extent that this study included only one tournament on two debate topics,
some tentative conclusions are in order:
1. The need issue is considered by both judges and debaters to be the most important issue in the majority of debates. The counterplan issue rarely assumes importance.
2. The judge usually determines the most important issue in the debate during the constructive speeches.
3. The debater during whose speech the judge determines the major issue in the debate tends eventually to win the decision.
4. Partner agreement on stock issues is a significant factor in successful debating.
5. There is a slight tendency for debaters who agree with the judge on the major stock issue to win more often than those who disagree.
6. Experience has little or no positive effect on debaters' ability to determine the major stock issue in a debate.
7. High school debate experience may be detrimental to college debaters' ability to determine the major stock issue in a debate.
8. Course work is argumentation and/or debate has no effect on debaters' ability to determine the major stock issue in debate.
9. Debaters cannot render objective decisions in the debates in which they are participants.
10. The ability to determine the major stock issue in a debate will help a debater to decide whether or not he won the debate.
11. High school and college coaches are in agreement on the relative importance of criteria in arriving at decisions in debate.
12. Non-coaches are in substantial disagreement with coaches on the relative importance of criteria in arriving at decisions in debate.
13. Delivery should not be included as one of the items on debate ballots.
FOOTNOTES
1. The writers would like to express their appreciation to Dr. Gregg Phifer, tournament director, and Dr. William DeMeugeot, director of the high school debate division, for their assistance in securing the data for this study.
2. See Kim Giffin and Kenneth Megill, "Stock Issues in Tournament Debates," Central States Speech Journal, XII (Autumn, 1960), 27-32 or Kim Giffin and Kenneth Megill, "A Study of the Use of Key Issues in Tournament Debates," Gavel, XLIII (Nov., 1960), 67-68. The reader will note that Giffin and Megill did not include "inherency" in their study.
3. Leroy T. Laase, "An Evaluation of the Quality Rating System in Measuring Debate Achievement," Quarterly Journal of Speech, XXVIII (Dec., 1942), 424-430 and Joseph Baccus, "Debaters Judge Each Other, Quarterly Journal of Speech, XXIII (Feb., 1937), 74-80.
4. Thomas King and Theodore Clevenger, Jr., "A Comparison of Debate Results Obtained by Participant and Critic Judging," Southern Speech Journal, XXV (Spring, 1960), 223, 232.
5. Kim Giffin, "A Study of the Criteria Employed by Tournament Debate Judges," Speech Monographs, XXVI (Mar., 1959), 69-71.
6. The "other" category included English teachers, drama teachers, speech students, etc.
7. James Roever and Kim Giffin, "A Study of the Use of Judging Criteria in Tournament Debate," AFA Register, VIII, No. 1 (1960), 12-14.
8. Robert L. Scott, "The Objectivity of Debate Judges," Gavel, XXXVII (Nov., 1954), 14-15.