Study shows AI program could verify Wikipedia citations, improving reliability

Joystiq

Joystiq News
You can't trust everything on a
Please, Log in or Register to view URLs content!
, which is why it's important that you refer to the original sources cited in the footnotes. But sometimes, even the primary sources can
Please, Log in or Register to view URLs content!
. Researchers have developed an AI focused on
Please, Log in or Register to view URLs content!
of Wikipedia references by training the algorithms to identify citations on the website that are questionable.

The program, called SIDE, does two things: check if a primary source is accurate and suggest new ones. However, the AI operates under the assumption that a Wikipedia claim is true. This means that, while it can check for the validity of a source, it can't actually verify claims made in an entry.


In a
Please, Log in or Register to view URLs content!
people preferred the AI’s suggested citations to the original 70 percent of the time. The researchers found that in nearly 50 percent of the cases, SIDE presented a source that was already being used by Wikipedia as the top reference. And 21 percent of the time, SIDE was one step ahead when it churned out a recommendation that was already deemed appropriate by human annotators in the study.

While the AI appears to demonstrate it can effectively help an editor verify Wikipedia claims, the researchers admit that alternative programs could outperform their current design in both quality and speed. SIDE is limited in its capabilities — namely, the program only considers references corresponding to web pages. In reality, Wikipedia cites books, scientific articles and info presented through other media beyond text like images and video. But beyond its technical limits, the whole premise of Wikipedia is that any writer anywhere could assign a reference to a topic. The researchers suggest that the use of Wikipedia itself could be limiting to the study. They allude that individuals who plug citations into the website could permeate bias depending on the nature of the topics in question.

Meanwhile, we all know that any program, especially an AI that is dependent on training, could be prone to the exposure of the
Please, Log in or Register to view URLs content!
. The data used to train and evaluate SIDE’s models could be limited in that regard. But still, the benefits of using AI to streamline fact-checking, or at least use it as a supportive tool, could have reverberating applications elsewhere. Wikipedia and
Please, Log in or Register to view URLs content!
need to contend with bad actors and bots that flood digital town squares with false information. This is especially true and important now more than ever, in the wake of misinformation spreading around the
Please, Log in or Register to view URLs content!
and the
Please, Log in or Register to view URLs content!
in the US. The need to mitigate misinformation online could be catalyzed with AI tools, like SIDE, designed for this exact purpose. But there are still some advances that need to be made before it can.

This article originally appeared on Engadget at
Please, Log in or Register to view URLs content!


Please, Log in or Register to view URLs content!


Console Bang News!
 

Users who are viewing this thread

Top