What Is Wrong With the Traditional Examination
Chapter Thirty-Eight
Syllabus topic 3, "Examination reforms"
Pages 137 to 139 of 543
In one line
The traditional Indian law examination is a single three hour written paper at the end of the year, answered in essays on questions chosen from a list, and almost everything wrong with legal education can be traced to what that instrument rewards.
In the wording a student can write in an exam: the traditional examination is terminal, written, essay based and offers a wide choice of questions; its defects are that it tests recall rather than understanding or skill, samples the syllabus so narrowly that a student can pass by preparing a fraction of it, permits question spotting, is marked subjectively and inconsistently, concentrates the whole assessment of a year into a few hours, produces no feedback, and encourages reliance on printed guides in place of primary sources.
The instrument being criticised
Terminal. One examination at the end, after which nothing can be corrected.
Written and essay based. The candidate writes continuous prose from memory.
Wide choice. Answer any five of eight, or any four of seven, which is the pattern of this paper's own question papers.
Closed book. Nothing may be consulted.
Externally set and marked, usually by somebody who did not teach the class.
The defects, one at a time
It tests recall. The dominant demand is remembering and organising. Understanding is tested only incidentally, application rarely, and skill not at all.
It samples the syllabus very narrowly. With four answers from seven questions, a candidate answers on four topics out of a syllabus of many. A student who prepares a third of the course can pass comfortably, which is a rational response and not a moral failing.
It rewards question spotting. Where the pattern repeats across years, past papers become a prediction instrument, and preparation becomes the study of the examiner rather than of the subject.
Marking is subjective and inconsistent. Two examiners marking the same essay reach different figures, and the same examiner reaches different figures at different times of day. Objective questions were introduced largely to answer this.
It concentrates everything. A year of work is decided in three hours, so illness, anxiety or an unlucky question set can produce a result that says nothing about the student.
It gives no feedback. The script is returned as a number, usually after the course has ended, so neither the student nor the teacher learns anything usable.
It rewards the guide. A printed summary organised by likely question is a more efficient preparation than the bare Act, the judgments and the class, so students use it. This is the defect with the largest downstream effect, because it hollows out every method in topic 2.
It cannot examine the clinical papers. Drafting, interviewing, negotiating and arguing cannot be shown in an essay, so where they are examined this way they are not examined at all. Chapter 390.
What Is Wrong With the Traditional Examination
And it distorts teaching. A teacher who wants their students to do well teaches to the instrument, so exposition and dictated summaries are rational teaching for this examination, which closes the loop with chapter 230.
What the reports said
The 14th Report of the Law Commission, 1958, found the examination system to be a test of memory rather than of the capacity to use the law, and treated it as one of the causes of the condition of the profession. Chapter 70.
The 184th Report, December 2002, returned to legal education forty-four years later and found the same structural problems, its central complaint being the absence of any statutory definition of standards. Chapter 80.
And NEP 2020 proposes a move away from terminal examinations towards continuous and competency based assessment, which is the same direction in modern language. Chapter 100.
What is NOT wrong with it
An answer that condemns the whole instrument is weaker than one that concedes what it does well, and an examiner rewards the concession.
It certifies reliably. It is supervised, anonymous, externally marked and hard to cheat at scale, which is exactly why it survives.
It is fair in one important sense. Every candidate faces the same paper in the same time with the same materials, which is more than can be said for internal assessment across colleges.
It is cheap and it scales. Thousands of candidates can be examined at once by an instrument that needs a hall and a bundle of paper.
And essay writing is a real legal skill. A lawyer writes continuous, organised argument for a living, so the format is not arbitrary.
A worked example
Take a paper on the pattern of this subject's own: seven questions, attempt any four, all carrying equal marks, three hours.
A rational candidate identifies the four or five topics most often set, prepares those to a high standard from a guide, and ignores the rest. They score well.
A conscientious candidate reads the whole syllabus, the bare Acts and some judgments, and prepares everything to a moderate standard. They may score less, because depth on the four questions asked beats breadth across the whole course.
The instrument has rewarded the first strategy, and no amount of exhortation will change that, because the reward is structural.
Now change one thing: reduce the choice. Attempt any four of five, with the five drawn from across the modules. The first strategy stops working immediately, because a third of the syllabus no longer covers the paper.
That single change, which costs nothing, improves sampling, kills question spotting and changes what students read. It is the most economical reform available and it is worth naming in an answer, because most reform proposals cost money and this one does not.
What Is Wrong With the Traditional Examination
Quick revision
The instrument: terminal, written, essay based, wide choice, closed book, externally set and marked.
Nine defects: tests recall; samples the syllabus narrowly; rewards question spotting; is marked subjectively; concentrates a year into three hours; gives no feedback; rewards the printed guide; cannot examine the clinical papers; and distorts teaching towards exposition.
Its merits, which an answer should concede: it certifies reliably; it is uniform across candidates; it is cheap and scales; and written argument is a real legal skill.
The reports: the 14th Report, 1958 called it a test of memory; the 184th Report, 2002 found the same defects unchanged; NEP 2020 proposes continuous and competency based assessment.
The cheapest single reform: reduce the choice, which improves sampling and ends question spotting at no cost.
Test yourself
1. Give six defects of the traditional examination. It tests recall rather than understanding or skill; it samples the syllabus so narrowly that a third of the course can carry a pass; it rewards question spotting where the pattern repeats; its marking is subjective and inconsistent; it concentrates a year of work into three hours; and it produces no feedback, since the script returns as a number after the course has ended.
2. Name two things the traditional examination does well. It certifies reliably, being supervised, anonymous and externally marked; and it is uniform, since every candidate faces the same paper in the same time with the same materials, which internal assessment across colleges is not.
3. Why is preparing only a third of the syllabus a rational strategy rather than a moral failing? Because with four answers required from seven questions the instrument itself rewards depth on a few topics over breadth across the course, so the incentive is structural and exhortation cannot change it.
4. What is the cheapest available reform, and what does it fix? Reducing the choice of questions, so that the paper covers more of the syllabus. It improves sampling, ends question spotting and changes what students read, and it costs nothing.
The rest of this subject
These notes are cut from the University's printed syllabus. Open the syllabus itself, or the past papers, for the same subject.