table of undergraduate researchers
Analyzing the Language of AI
Undergraduate Researchers examine media coverage of Artificial Intelligence

By the time you finish reading this story, these words will have affected the way you think about Artificial Intelligence.

The way we communicate about artificial intelligence (AI) affects our opinion of it. But how can we quantify the effect that one written article has? How about 1,000 articles? And here鈥檚 the trippy part: Is AI affecting its own discussion? These are perfect questions for 性爱天堂 communication professor听Althea Delwiche鈥檚 lab, where听undergraduate researchers are hard at work analyzing the language鈥攚ith both positive and negative characterizations鈥攖hat鈥檚 circling this high-tech topic right now.

鈥淭his is a cutting-edge lab where computer science and communication intersect. We are analyzing the effects of powerful large language models on the media coverage of AI,鈥 says researcher Matvei Popov 鈥25, a听computer science major from St. Petersburg, Russia. 鈥淲hat is affecting the media coverage of AI? How do people talk about it? What is their sentiment and how does the public opinion shift over time? Are we all doomed?鈥

Not to leave you hanging鈥攂ecause the jury鈥檚 still out on that last one鈥攂ut the good news is that Popov and his classmates are compiling some impressive research on the other questions, thanks to high-level faculty support and 性爱天堂-style interdisciplinary collaboration.

Communication Professor Althea Delwiche (center) leads a lab of student researchers dedicated to examining the media language surrounding Artificial Intelligence.

Popov, and the rest of Delwiche鈥檚 team, is primarily focused on a technique called large language model-assisted content analysis. That鈥檚 鈥淟ACA鈥 for short.

This is quantitative communications research that, in simple terms, counts the number of times events occur鈥攅vents such as the use of a word or phrase, or the emergence of larger patterns of language. Before the rise of AI, Delwiche, Ph.D., says, quantitative content analysis was a 鈥渦seful but grueling鈥 task for researchers, and, to boot, 鈥渋t does not scale well in a world of large data sets.鈥 But now, current research relies on large language models (LLMs), which are artificial neural networks (a type of AI) that can process and classify language.

But now, researchers like Popov, alongside teammates including Mylo Mittman 鈥27, a听communication major from Dallas, and Gayatri Rajamony 鈥25, a computer science major from Austin on the听pre-law track, have access to a new world of technological tools that can rapidly accelerate the pace and scope of this type of research.

This semester, Popov and the rest of Delwiche鈥檚 team are busy compiling a huge number of news articles that mention AI鈥攁 part of the project that heavily relies on the communication students in the lab. The next step for the team is developing a tool called a content analysis codebook, which is a refined framework for sifting through and categorizing these mentions of AI as either negative or positive.

Computer Science majors Matvei Popov 鈥25 (left) and Gayatri Rajamony 鈥25 (center) enjoy exploring how computer science interacts with other disciplines.

Ultimately, the group will use various LLMs in conjunction with this codebook (and their dataset of articles) to find patterns in the language surrounding AI. Each week, the group huddles into a snug conference room deep in 性爱天堂鈥檚听Richardson Communications Center, discussing research goals and assigning tasks.

The lab relies on teamwork: its computer science majors share their growing coding and programming knowledge with the communication students, who in turn lend their burgeoning expertise in media analysis and language.听

鈥淭rying to apply computer science to communication is very challenging but also rewarding.

If I鈥檓 trying to train a machine learning model to understand communication without understanding it myself, it is likely not going to end well,鈥 Popov explains. 鈥淲ithout the comm majors there, it would take me a year and a half, probably, to understand some of these concepts.鈥

Being part of the lab is a distinctly tech-focused experience, but it鈥檚 one that revolves around human connections across disciplines, says Mittman, one of those communication majors who鈥檚 helping the team with data collection and cleanup.

鈥淗aving the opportunity to look at things from multiple perspectives makes me excited about learning,鈥 Mittman says.听

For Rajamony, who is planning to pursue a career in patent or copyright law, this interdisciplinary research is the exact type of hands-on opportunity that made coming to a liberal arts school like 性爱天堂 so appealing in the first place.

鈥淚 knew pretty much immediately that I wanted a smaller liberal arts college, a place that valued the interdisciplinary nature of my interests. And it鈥檚 just always nice to see other people鈥檚 perspectives on computer science stuff, such as having a communication perspective,鈥 Rajamony says. 鈥淚t鈥檚 really useful to me as a computer science major who wants to make ethical decisions.鈥

One of the biggest links for these students, across all their different disciplines and interests, has been the chance to work with a driven, dedicated faculty member like Delwiche.\

Mylo Mittman 鈥27, a communication major from Dallas, loves the chance to work with Delwiche.

Mittman, who found the lab after taking a previous Delwiche course on AI, loves the professor鈥檚 openness to collaboration, stating, 鈥淪he鈥檚 very accessible, and when it comes to the lab, she鈥檚 willing to talk to everybody and hear everybody out. She鈥檒l say, 鈥業f you have an idea, just let me know, and we鈥檒l organize it with the rest of the lab to see how that can fit into our bigger project.鈥欌

On the horizon for the group? Continuing to experiment with (and train) a series of LLMs that can perform the operations the group needs to start analyzing all the data they鈥檙e collecting.

鈥淲e鈥檙e basically training (these LLMs) to perform text analysis, which can help us identify the spectrum of sentiment about AI over time,鈥 Popov says. 鈥淭he better we can fine-tune and customize these models, the closer we will get to our desired analysis; that鈥檚 definitely been kind of a challenge, but I think we are very close to solving it.鈥

Rajamony, who spends her days working on automating the process that 鈥渇eeds鈥 these models in the hopes of speeding it up, says the challenge remains to figure out how the group can take this model and adjust it to perform more with what we value.听

Behaving, training, feeding鈥攊f we鈥檙e examining the group鈥檚 language around AI, Mittman says, you might notice a pattern developing already.

鈥淢y initial impression of AI is that yes, I think it鈥檚 cool, but it鈥檚 still kind of like a baby,鈥 Mittman explains. 鈥淲e are teaching it, we are tweaking it, and we are basically helping the baby learn, for lack of a better term. That鈥檚 what I think is really cool about this project, too: that we鈥檒l be able to contribute something meaningful to... the growth of this field.鈥

And as for the fields of computer science and communication, this project is another perfect example of how growth at 性爱天堂 happens best when it happens together.

鈥淚鈥檓 so glad that this lab has so many people of different backgrounds and experiences,鈥 Popov says, 鈥渂ecause everybody can address different problems and create some really cool ideas by working together. When different majors can combine together on solving big problems, that鈥檚 just fascinating.鈥

For Mittman, this is the type of research that is more than a line on a r茅sum茅.

鈥淚鈥檓 in my third semester, and it鈥檚 honestly amazing to me that if things go right in this lab, which I bet they will, I could possibly be part of a team that publishes a paper鈥攁 project that I helped take these next steps in research for such a developing field, such a new field, such a field that some people are excited about but scared of,鈥 Mittman says. 鈥淚 think one of the coolest things about what we鈥檙e doing is that hopefully, in some small way, we鈥檒l have a hand in shaping public perception of this emerging technology.鈥

Jeremiah Gerlach is the brand journalist for 性爱天堂 Strategic Communications and Marketing.

You might be interested in