{"id":490697,"date":"2023-05-09T08:45:56","date_gmt":"2023-05-09T06:45:56","guid":{"rendered":"https:\/\/mybroadband.co.za\/news\/?p=490697"},"modified":"2023-05-09T08:54:52","modified_gmt":"2023-05-09T06:54:52","slug":"gptzero-anti-cheating-developer-building-detector-for-ai-generated-disinformation","status":"publish","type":"post","link":"https:\/\/mybroadband.co.za\/news\/software\/490697-gptzero-anti-cheating-developer-building-detector-for-ai-generated-disinformation.html","title":{"rendered":"GPTZero anti-cheating developer building detector for AI-generated disinformation"},"content":{"rendered":"<p>Journalists, screenwriters and college professors are among widening groups of people who are concerned about eventually\u00a0losing their livelihoods to artificial intelligence programs like ChatGPT, which can produce copy faster and possibly better than humans.<\/p>\n<p>But one entrepreneur is pursuing technology to make it easier to distinguish between text written by people and that composed by a machine.<\/p>\n<p><strong><a href=\"https:\/\/www.linkedin.com\/in\/ed-tian\/?originalSubdomain=ca\" target=\"_blank\" rel=\"noopener noreferrer\">Edward Tian<\/a><\/strong>, a 22-year-old Princeton University student studying computer science and journalism, developed an app called\u00a0<strong><a href=\"https:\/\/gptzero.me\/\" target=\"_blank\" rel=\"noopener noreferrer\">GPTZero<\/a><\/strong>\u00a0to deter the misuse of the viral chatbot ChatGPT in classrooms. The app has racked up 1.2 million registered users since January.<\/p>\n<p>He\u2019s now launching a new program called Origin aimed at \u201csaving journalism,\u201d by distinguishing AI-generated disinformation from fact in online media.<\/p>\n<p>Tian has secured $3.5 million in funding co-led by Uncork Capital and <strong><a href=\"https:\/\/www.neocapital.co\/\" target=\"_blank\" rel=\"noopener noreferrer\">Neo Capital<\/a><\/strong>, with tech investors including Emad Mostaque, chief executive officer of Stability AI Ltd, and Jack Altman.<\/p>\n<p>GPTZero analyzes the randomness of text, known as perplexity, and the uniformity of this randomness within the text \u2014 called burstiness \u2014 to identify when AI is being used. The tool has an accuracy rate of 99% for human text and 85% on AI text, according to the company.<\/p>\n<p>The 10-person team now wants to empower journalism and is talking with large media organizations like the BBC and industry executives including New York Times former Chief Executive Officer Mark Thompson, to discuss partnerships for AI detection and analysis. The company also sees its technology for use in fields of trust-and-safety, government, copyright, finance, law and more.<\/p>\n<p>\u201cWe believe we can get the smartest people working on AI detection in a room together,\u201d said Tian. \u201cThe field of detection is so new and we believe it deserves more attention and support.\u201d<\/p>\n<h3 class=\"my-4\">Lack of Tools<\/h3>\n<p>Open AI, the company behind ChatGPT, has launched an AI\u00a0<strong><a href=\"https:\/\/openai.com\/blog\/new-ai-classifier-for-indicating-ai-written-text\" target=\"_blank\" rel=\"noopener noreferrer\">text classifier<\/a><\/strong>\u00a0to detect machine-generated content, but it\u2019s far from foolproof. The tool correctly identifies only 26% of AI-written text as \u201clikely AI-written,\u201d while incorrectly labeling human-written text as AI-written 9% of the time. The classifier also works \u201csignificantly worse\u201d in languages other than English and is \u201cunreliable\u201d on code and shorter texts. For inputs that are very different from text in the tool\u2019s training set, the classifier could also be wrong, according to OpenAI.<\/p>\n<p>\u201cOur classifier has a number of important limitations,\u201d the company acknowledges on the website. \u201cIt should not be used as a primary decision-making tool, but instead as a complement to other methods of determining the source of a piece of text.\u201d<\/p>\n<p>The lack of reliability of the detection tool poses a\u00a0dilemma for educators. Even if a teacher finds a suspicious article from a student that\u2019s flagged with a 70% likelihood of being AI-generated, as long as the accuracy of those detection tools isn\u2019t 100%, it\u2019s very hard for teachers to take decisive action.<\/p>\n<p>\u201cI don\u2019t think we know what to do with a flag that says there might be an issue,\u201d said\u00a0<strong><a href=\"https:\/\/cyber.harvard.edu\/people\/jcushman\" target=\"_blank\" rel=\"noopener noreferrer\">Jack Cushman<\/a><\/strong>, director of the Harvard Library Innovative Lab, which explores topics such as the impact of the internet. \u201cAll you can do at that point is talk with a student and say you might have committed academic dishonesty according to this tool.\u201d<\/p>\n<p>Meanwhile, the definition of plagiarism is also evolving with the emergence of AI. \u201cIt is going to challenge the whole notion of academic honesty because sometimes having a tool that recommends a sentence or two or help with citations is going to be legitimate in the same way as using calculator to do math work,\u201d he said. \u201cThe best answer is you shouldn\u2019t let it write the whole thing.\u201d<\/p>\n<h3 class=\"my-4\">Rise of Deepfakes<\/h3>\n<p><strong><a href=\"https:\/\/www.linkedin.com\/in\/nloui\/\" target=\"_blank\" rel=\"noopener noreferrer\">Nick Loui<\/a><\/strong>, co-founder and CEO of PeakMetrics, a startup that helps governments and large companies combat disinformation, said his clients aren\u2019t concerned about the threat of AI-generated texts as much because the potential for harm is less than from the\u00a0proliferation of deepfake\u00a0videos, for example, where there have been more malicious instances of manipulated content.<\/p>\n<p>The technical limitations so far of any detection technology and a lack of a clear path to monetization has made it difficult to attract investment. The current detection tools are transitory products, said Sheila Gulati, managing director at Tola Capital, a VC firm that focuses on AI startups, as blocking new and emergent technology is generally not a great way for people to leverage it. \u201cI think the eventual state of this will just be much more sophisticated.\u201d<\/p>\n<p>Some industry observers say open sourcing, which makes software\u2019s source code publicly available and allows users to view, modify and distribute it freely, is good for large language model products as it reduces costs, increases transparency and promotes innovation.<\/p>\n<p>However, open-source is also more easily hackable and can make the detection tools more prone to exploits. \u201cIt\u2019s a bit like showing a burglar the blueprint for how your home surveillance network is set up,\u201d said Alex Cui, chief technology officer and a co-founder of GPTZero.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The Princeton University computer science and journalism graduate is also launching a program to detect AI-generated disinformation and has secured $3.5 million in funding.<\/p>\n","protected":false},"author":341034,"featured_media":490701,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16],"tags":[83065,86139,84945,86137,45266,21601],"class_list":["post-490697","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-software","tag-chatgpt","tag-edward-tian","tag-generative-pre-trained-transformer-4-gpt-4","tag-gptzero","tag-openai","tag-origin"],"_links":{"self":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/490697"}],"collection":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/users\/341034"}],"replies":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/comments?post=490697"}],"version-history":[{"count":0,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/490697\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media\/490701"}],"wp:attachment":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media?parent=490697"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/categories?post=490697"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/tags?post=490697"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}