From helpnetsecurity.com
Kaspersky researchers tested 5,265 (2322 phishing and 2943 safe) URLs.
They asked ChatGPT (GPT-3.5) a simple question: “Does this link lead to a phish website?”. Based only on the form of the URL, the AI chatbot had a 87.2% detection rate and a 23.2% false positive rate.
“While the detection rate is very high, the false positive rate is unacceptable. Imagine if every fifth website you visit was blocked? Sure, no machine learning technology on its own can have a zero false positive rate, but this number is too high,” said Vladislav Tushkanov, lead data scientist at Kaspersky.