Evaluating Computer-Assisted Instruction Software for Christian Education
By: Dan Olinger

The most effective use of the computer in the educational setting is as a tool to teach "real" subjects such as math, science, reading, writing and history. This method is called "computer-assisted instruction," or CAI. Hundreds of software packages are available that are designed to be used in this way. The vast majority, however, are not worth buying at any price--many because they are not educationally sound, or because they contain elements that make them unacceptable for use in a Christian environment.

In the past, the most difficult part of evaluating software was obtaining the software to evaluate. Most publishers and distributors insisted that you buy the software without seeing it first, and many would not give refunds. Today, however, many publishers allow an evaluation period of 30 days or so, and many of those that do not will at least give a refund when the software is returned (though some do charge a restocking fee of around 25 percent, which is designed to protect them against illegal copying).
Once you have obtained software for evaluation, the following outline should help you decide whether to buy.

Efficiency
Ease of startup--Is the installation process straightforward? Does it allow you some choices, such as where on your hard drive you want the program stored? Once it's installed, can the user get into the program without a lot of hassle?
Ease of use--Can a child easily operate the software? For example, to move around on the screen, do you simply use the mouse or the arrow keys on the keyboard, or does the program require you to enter some arcane keystroke combination, such as [Control] U for "up"?

Intuitiveness--Is what's expected of you obvious from what's on the screen, or does the program let you get stuck? My opinion, which I admit may be extreme, is that for most CAI software you should never need to look at the manual to perform the software's basic functions.

Use of the computer's capabilities--Does the program do something that you couldn't do just as well with a book? Many early CAI packages were simple "page-turners": read a screen, press the spacebar, then read another screen, and so on. For such simple functions, you can do as well with a $5 book as with a $2,000 computer. Good software requires occasional thoughtful input and lets the student know how he's performing. It also makes good use of color, animation and sound to present an interesting image. Further, it should demonstrate some original, creative thought by the designer. One software publisher calls this the "giggle factor"; the child should find the software intriguing, amusing, fascinating.

Flexibility
Hardware requirements--Does the software require a mouse? Does it require a color monitor? A large amount of hard drive space? A modem? A sound card?
Sound control--Can you turn the sound off, or are you going to have to listen to a lot of distracting beeps and whistles as you work with one child while another is using the program?

Multiple uses--Is there more than one game or exercise on the disk? Many programs, such as simulations, are complex enough that only one function is plenty; but for simple math drill-and-practice programs, for example, you should expect multiple exercises.
Record keeping--Does the program keep score for you? It's especially useful if you can go in later and see a record of how your student is doing.

Error trapping--How does the software respond to the unexpected? Will it lock up if you strike keys at random or place an elbow (gently!) on the keyboard? Programmers can tell the machine to ignore or "beep" illegitimate input.

Customizability--Can you control the degree of difficulty or add your own problems?
Save and restore--For long games and exercises, can you save your position and return later, or do you have to start over?

Pedagogical Soundness
Response to wrong answers--How does drill-and-practice software respond when the student answers incorrectly (as distinguished from unexpected keystrokes; see "Error trapping" above)? Does it say "You made an error" or simply beep? Or, does it help the student work toward the right answer?

Branching--Does the software adjust its responses to the student's performance, getting more difficult as the student excels and less difficult as he demonstrates lack of understanding?

Objectionable elements--Much software contains references and allusions that Christians find objectionable: evolutionary material in science packages, for example, or references to rock music or other "hip" topics in creative writing or reading comprehension packages. Much software contains occult references--magicians, wizards, and so forth.

Open-endedness--Is the software easily mastered (and therefore short-lived)? If so, the price should reflect the amount of use you expect to get from it. Many simulations are open-ended, able to challenge a student for weeks or even months.

Marketing Considerations
Preview--You wouldn't buy tomatoes without seeing them first. There's no sense in buying software sight unseen either. Don't deal with anyone who won't deal reasonably with you. (See the earlier comments on preview and refund policies.)

Copy protection and replacement--Copy protection is not the same thing as copyright. Software that is copyrighted is simply protected by law as the property of someone, and you are legally, morally and ethically forbidden to copy it (except for backup purposes) without payment to the owner or his permission to copy. 
Copy protection, on the other hand, is one means of protecting copyrighted material electronically. The publisher puts technological barriers on the disk to prevent you from copying it. The motive--protection from theft--is understandable, but copy protection may also prevent you from making a backup copy or from installing the program on your hard disk. Unfortunately, most CAI software is copy protected and will likely remain so. In the meantime, publishers of copy-protected software should allow hard drive installation, provide you with an extra (backup) copy in the package, or at least offer an inexpensive (preferably free) replacement should your disk become damaged.

Response to bugs--Is the program full of bugs (programming errors that make the program respond incorrectly)? How does the publisher respond when informed of these bugs? In general you should avoid software that has just been released. (Many publishers label such software "Release 1.0.") Unless the publisher has unusually intensive testing procedures, such software is likely to have bugs.

Despite the high incidence of unacceptable CAI software, there are many packages available that offer exciting and effective educational opportunities. The reward is worth the effort of tracking down and evaluating software.

Dan Olinger holds a Ph.D in theology.