Why Can AI Pass Our Tests?

AI can now pass many of the tests we give our children, which raises an uncomfortable question: are we testing what students can actually do, or merely whether they can produce the right answers?

The arrival of artificial intelligence has exposed something about education that we should have noticed long ago.

AI can pass tests.

It can write essays. It can answer history questions, solve mathematics problems, summarize books and produce reports that would earn respectable grades in many classrooms.

That has created a tremendous amount of worry about cheating. Schools are trying to determine whether a student or a machine wrote an assignment. Teachers are changing testing procedures. Software companies are building systems intended to detect AI-generated work.

But I think we may be concentrating on the wrong problem.  The debate over AI in education has largely centered on cheating and critical thinking, but underneath both is a more basic question: can the student apply what he has learned?

The interesting question isn’t how AI passes our tests.

The interesting question is why it can.

If a machine can produce the answer that supposedly demonstrates a student’s education, what exactly were we testing?

We Have Been Testing the Answer

Think about a simple distinction.

A child can memorize the formula for determining the area of a room. He can answer a question about that formula correctly on a test.

But give him a tape measure, put him in an actual room and tell him to determine how much flooring must be ordered.

Now something different has to happen.

He has to look at the room. He has to decide what measurements matter. He has to take them accurately. He has to select the right arithmetic. He has to notice the closet. He may have to account for waste. And at the end, his answer has consequences. Too little flooring and the job stops. Too much and somebody has wasted money.

He has applied what he knows.

That is a very different accomplishment from selecting the correct answer on a test.

And it points toward something AI is inadvertently showing us about our schools.

For a long time, we have treated the appearance of the correct answer as evidence of ability.

Now a machine can give us the appearance.

Suddenly the weakness in that measurement is much easier to see.

Knowledge Is Not Ability

There is nothing wrong with learning facts. A person cannot think intelligently about something he knows nothing about.

There is nothing wrong with testing whether a student knows those facts, either.

But knowledge is not the end product of education.

Ability is.

We don’t teach a child mathematics merely so he can tell us that he knows mathematics. We teach it so he can use mathematics when life presents him with a problem requiring it.

We don’t teach language so a student can identify a noun. We teach it so he can communicate an idea clearly enough that another human being understands him.

We don’t teach history merely so a student can remember when a war began. History should help him recognize human behavior, compare circumstances, understand consequences and make better judgments about events occurring in his own time.

Science should eventually produce an ability to observe the physical world and reason from evidence.

Ethics should eventually produce an ability to recognize a moral problem and make a responsible decision when nobody has supplied four possible answers.

Education should result in something the student can do.

That brings us to a wonderfully simple word:

Apply

Suppose we made application one of the central purposes of education.

Learn something.

Understand it.

Then use it.

A lesson shouldn’t necessarily end when the student can repeat what the teacher taught. Whenever practical, it should end when the student can do something with what he learned.

Learn percentages? Calculate the discount on an actual purchase.

Learn interest? Compare two real loans and determine which one costs more.

Learn persuasive writing? Write a letter attempting to persuade someone about an actual issue.

Learn nutrition? Examine several meals and determine what they contain.

Learn civics? Attend a town meeting, read an ordinance or follow an issue through local government.

Learn physics? Build something.

Learn measurement? Measure something.

Learn how to research? Give the student a question whose answer isn’t sitting conveniently in the textbook.

Then something important happens.

The student has to observe. He has to decide what information matters. He has to retrieve what he learned. He has to fit that knowledge to a circumstance that may not look exactly like the example in the book.

He has to think.

And then he has to make something happen.

That is much closer to what life will require of him.

AI Isn’t the Enemy Here

This is where the argument becomes particularly interesting.

I don’t think the answer is to keep AI away from children forever.

They are going to live in a world filled with it.

AI may become an extraordinary educational tool. It can explain difficult ideas several different ways. It can help a student find information. It can challenge an argument. It can tutor. It can simulate situations. It can give a child access to knowledge that would have been unimaginable a generation ago.

But there is a simple line we should learn to recognize.

Is AI helping the child develop an ability, or is AI exercising the ability in his place?

Those are not the same thing.

A calculator is extremely useful after a child understands arithmetic. It is disastrous if it prevents him from ever acquiring arithmetic.

A power saw greatly increases what a carpenter can accomplish. It doesn’t make the person holding it a carpenter.

AI should increase human ability.

It should not replace the process through which human ability is acquired.

That distinction could give parents and teachers a much better question than, Did the student use AI?

Ask instead:

What can the student now do that he could not do before?

If we cannot answer that question, we may not have educated him at all.

Perhaps AI Has Done Us a Favor

There is a certain irony in all this.

People are frightened that AI may damage education.

It may.

But it has also given us an opportunity to improve education because it has exposed a weakness that was already there.

If AI can pass a test merely by producing the expected answers, perhaps some of our tests were never measuring what we thought they were measuring.

The machine has separated the answer from the person producing it.

That gives us an opportunity to put the person back at the center of education.

Teach knowledge, certainly.

Teach children to read, calculate, remember, compare and understand.

But don’t stop there.

Give them things to solve. Things to build. Things to investigate. Things to repair. Decisions to make. Situations in which knowledge must leave the page and encounter the world.

Teach our kids to apply.

Because the final test of an education isn’t what a person can repeat.

It is what he can do.

Related Reading

What Is Education Supposed to Produce?

How to Speed Up and Improve Study
Instruction vs. Formation: Why Education Is More Than Information Delivery
When Truth Comes Too Cheaply