Students didn’t know their TA was a computer
College of Computing Professor Ashok Goel teaches Knowledge Based Artificial Intelligence (KBAI) every semester. It’s a core requirement of Georgia Tech’s online master’s of science in computer science program. And every time he offers it, Goel estimates, his 300 or so students post roughly 10,000 messages in the online forums — far too many inquiries for him and his eight teaching assistants (TA) to handle.
That’s why Goel added a ninth TA this semester. Her name is Jill Watson, and she’s unlike any other TA in the world. In fact, she’s not even a “she.” Jill is a computer — a virtual TA —implemented on IBM’s Watson platform.
“The world is full of online classes, and they’re plagued with low retention rates,” Goel said. “One of the main reasons many students drop out is because they don’t receive enough teaching support. We created Jill as a way to provide faster answers and feedback.”
Goel and his team of Georgia Tech graduate students started to build her last year. They contacted Piazza, the course’s online discussion forum, to track down all the questions that had ever been asked in KBAI since the class was launched in fall 2014 (about 40,000 postings in all). Then they started to feed Jill the questions and answers.
“One of the secrets of online classes is that the number of questions increases if you have more students, but the number of different questions doesn’t really go up,” Goel said. “Students tend to ask the same questions over and over again.”
That’s an ideal situation for the Watson platform, which specializes in answering questions with distinct, clear solutions. The team wrote code that allows Jill to field routine questions that are asked every semester. For example, students consistently ask where they can find particular assignments and readings.
Jill wasn’t very good for the first few weeks after she started in January, often giving odd and irrelevant answers. Her responses were posted in a forum that wasn’t visible to students.
“Initially her answers weren’t good enough because she would get stuck on keywords,” said Lalith Polepeddi, one of the graduate students who co-developed the virtual TA. “For example, a student asked about organizing a meet-up to go over video lessons with others, and Jill gave an answer referencing a textbook that could supplement the video lessons — same keywords — but different context. So we learned from mistakes like this one, and gradually made Jill smarter.”
After some tinkering by the research team, Jill found her groove and soon was answering questions with 97 percent certainty. When she did, the human TAs would upload her responses to the students. By the end of March, Jill didn’t need any assistance: She wrote the class directly if she was 97 percent positive her answer was correct.
The students, who were studying artificial intelligence, were unknowingly interacting with it. Goel didn’t inform them about Jill’s true identity until April 26. The student response was uniformly positive. One admitted her mind was blown. Another asked if Jill could “come out and play.” Since then some students have organized a KBAI alumni forum to learn about new developments with Jill after the class ends, and another group of students has launched an open source project to replicate her.
Back in February, student Tyson Bailey began to wonder if Jill was a computer and posted his suspicions on Piazza.
“We were taking an AI course, so I had to imagine that it was possible there might be an AI lurking around,” said Bailey, who lives in Albuquerque, New Mexico. “Then again, I asked Dr. Goel if he was a computer in one of my first email interactions with him. I think it’s a great idea and hope that they continue to improve it.”
Jill ended the semester able to answer many routine questions asked. She’ll return —with a different name — next semester. The goal is to have the virtual teaching assistant answer 40 percent of all questions by the end of year.
The Latest on: AI Teaching Assistant
via Google News
The Latest on: AI Teaching Assistant
- University of Sheffield receives over £8m in funding to train the next generation of artificial intelligence scientists and engineers on February 21, 2019 at 2:59 am
The industry partners will contribute through research projects, internships, teaching ... assistants, such as Siri, Alexa and Cortana, and the rapidly increasing commercial uptake of speech and text ... […]
- Student provides inmates with technical training for agricultural work on February 20, 2019 at 9:07 pm
A graduate research assistant in the Virginia Tech College ... the researchers are aided by minor offenders who are approaching release. An AI – artificial insemination – expert, Dias wanted ... […]
- The Pediatric AI That Outperformed Junior Doctors on February 20, 2019 at 7:00 am
Building a doctor may be as easy as teaching an AI how to read ... That’s a decade and a half wherein an AI diagnostic assistant would be an invaluable partner—both as a training tool and a safety mea... […]
- Teaching AI to Predict Pedestrian Behavior on February 19, 2019 at 7:32 am
Researchers at the University of Michigan are teaching self-driving cars to recognize and predict ... neural network” that catalogs human movements. The network lets AI machines predict poses and futu... […]
- Meet the teaching assistant that works for free on February 14, 2019 at 4:52 am
That assistant is already here ... Its CopyScanPublications app harnesses AI means that, with one touch, a teacher can copy (or scan) while the app captures all of the necessary information in the bac... […]
- IBM and the future of digital assistants: Building superhumans on February 14, 2019 at 2:58 am
I’ve been talking about Project Debater as a hybrid-AI, but combined with the aforementioned sensor suite, you effectively become a hybrid human, tied much more closely to the assistant and better abl... […]
- Can Online Education Lower Costs and Improve Quality? on February 12, 2019 at 1:46 pm
It’s called the Teaching Online Podcast, or TOPcast ... But the human being would be informed by the data from some of these big-data systems, or AI or analytics. Some critics of learning analytics wo... […]
- Google’s AI Assistant Fund Invests in GradeSlam to Make Online Tutoring More Equitable on February 12, 2019 at 4:18 am
“I saw early on in my teaching career that a lot of my students ... the other is Edwin, an AI-powered English-tutoring tool. Altogether, the Google Assistant Investments program has funded 10 startups ... […]
- The Future Of Voice AI In Patient Care on February 11, 2019 at 10:03 am
Voice-driven artificial intelligence (AI) can help cure the time shortage on ... At Beth Israel Deaconess Medical Center in Boston (BIDMC), a teaching hospital of Harvard, the tech team has been exper... […]
- AI Blazing the New Healthcare Frontier on February 11, 2019 at 5:00 am
Sensely’s “Molly” is a smartphone app that allows patients to interact with an AI-powered virtual nursing assistant before being directed ... “An important feature of a learning machine is that its te... […]
via Bing News