User:Cyborgwriter/sandbox3
Working on this page: Artificial intelligence content detection
Artificial intelligence detection software aims to determine whether some content (text, image, video or audio) was generated using artificial intelligence (AI).
As of 2023, the most widely used example of this is GPTZero, which claims to detect if text has been created by artificial intelligence and is sometimes used in colleges and universities to prevent student plagiarism. However, the reliability of such software is a topic of debate,[1] and there are concerns about the potential misapplication of AI detection software by educators.
Accuracy issues
[edit]Multiple AI detection tools have been demonstrated to be unreliable in terms of accurately and comprehensively detecting AI-generated text. In a study conducted by Weber-Wulff et al., and published in 2023, researchers evaluated 14 detection tools including Turnitin and GPT Zero, and found that "all scored below 80% of accuracy and only 5 over 70%."[2]
- ^ "'Don't use AI detectors for anything important,' says the author of the definitive 'AI Weirdness' blog. Her own book failed the test". Fortune. Retrieved 2023-10-21.
- ^ Weber-Wulff, Debora; Anohina-Naumeca, Alla; Bjelobaba, Sonja; Foltýnek, Tomáš; Guerrero-Dib, Jean; Popoola, Olumide; Šigut, Petr; Waddington, Lorna (2023-12-25). "Testing of detection tools for AI-generated text". International Journal for Educational Integrity. 19 (1): 26. arXiv:2306.15666. doi:10.1007/s40979-023-00146-z. ISSN 1833-2595.