ChatGPT maker OpenAI has put a tool online that assesses whether a text is probably written by artificial intelligence or not. OpenAI has put the tool online as a ‘starting point in the AI literacy discussion’.
OpenAI calls it AI Text Classifier and has trained the model on 34 models from 5 different organizations, including ChatGPT. The tool returns a probability that a text was written by a human or artificial intelligence, but does not provide any certainty. Moreover, the model is often wrong. In a challenge set of texts on which the model was not trained, AI Text Classifier labeled 30 percent of human-written texts as “maybe” or “probably” AI-generated was.
The tool is not available as an api, but only as a web interface. Moreover, there are the necessary restrictions. For example, the tool works particularly well in English and on adult texts, but children’s texts and other languages work less well. OpenAI also takes into account that models can adapt to the tool, in order to make AI texts appear more human to pass the test. There are many concerns, including in education, about the use of ChatGPT. The chatbot could generate texts that people could then designate as their own.
