Published: Oct. 1, 2013

$5.7 million NSF grants seek better ways to assess STEM learning

Contact(s): Tom Oswald Media Communications office: (517) 432-0920 cell: (517) 281-7129 Tom.Oswald@cabs.msu.edu, Mark Urban-Lurain Center for Engineering Education Research office: (517) 432-2108 urban@msu.edu, John Merrill Biological Science Program office: (517) 432-3618 merrill3@msu.edu

Michigan State University has received two National Science Foundation grants totaling $5.7 million, funds that will utilize computer software to analyze student writing in science and engineering classes.

The goal is to help retain more students who are enrolled in the so-called STEM disciplines – science, technology, engineering and mathematics.

The two grants include $5 million for five years to develop a website where student exam answers can be analyzed; and an additional three-year, $718,000 grant to assist instructors in the use of the software.

In typical, large-enrollment STEM courses, multiple-choice exams are given because they are easily scored by computers. But a lot of information is hidden from view with multiple-choice exams.

The grants will allow a team of MSU researchers to develop computerized tools that will analyze students’ written responses to homework, quiz and test questions to predict how they would be assessed.

“Students answering questions in their own words is the most meaningful way for instructors to identify learning obstacles,” said Mark Urban-Lurain, principal investigator for the $5 million grant and associate director of MSU’s Center for Engineering Education Research. “The realities of typical large-enrollment undergraduate classes, however, restrict the options that faculty members have for evaluating students' writing.”

“When students express what they know in their own words, it is deeper and a more rich view of what students know and have learned,” said John Merrill, principal investigator of the $718,000 grant and director of MSU’s Biological Sciences Program. “It’s a more interactive form of learning and teaching.”

The computer software is based on programs from the business world that analyze surveys. It selects words and phrases written by the students that provide insight into how they understand the course material. It can analyze several sentences.

A major part of the funding is targeted for completion and public rollout of a fully automated website where instructors around the world can have their students’ open-response answers analyzed automatically.

Merrill said improvements to the current constructed response assessments would reveal more about student misconceptions, allowing faculty members to make small corrections throughout the semester.

“The software can analyze text and determine correctness,” he said. “But we have to train the computer to do that.”

Other collaborators on the project include faculty members at the University of Colorado at Boulder, the State University of New York at Stony Brook, the University of Maine at Orono, the University of Georgia, the University of South Florida and Western Michigan University.

 

John Merrill (l), director of MSUís Biological Sciences Program, and Mark Urban-Lurain, associate director of the MSU Center for Engineering Education Research, have received two National Science Foundation grants totaling $5.7 million. The researchers are looking for ways to use computer software to analyze student writing in STEM courses. Photo by G.L. Kohuth.

The Grad Factor
Be a Spartan Advocate
More on these topics
MSU was honored by the Lansing Regional Chamber of Commerce for construction of the Bio Engineering Facility. The chamber honored MSU for its commitment to economic development, as well as research and development in the biomedical sciences and human health.
Pride Point RSS Pride Point Subscription Subscribe Share
From the archives