[4] An independent study [12] conducted by Carnegie Mellon University CyLab titled "Phinding Phish: An Evaluation of Anti-Phishing Toolbars" and released November 13, 2006 tested the ability of ten anti-phishing solutions to block or warn about known phishing sites and not block or warn about legitimate sites (not exhibit false-positives), as well as the usability of each solution.
The testing was performed using phishing data obtained from Anti-Phishing Working Group, PhishTank, and an unnamed email filtering vendor.
[citation needed] Another study,[13] conducted by SmartWare for Mozilla and released November 14, 2006, concluded that the anti-phishing filter in Firefox was more effective than Internet Explorer by over 10%.
The study only compared Internet Explorer and Firefox, leaving out (among others) Netcraft Toolbar and the Opera browser, both of which use data from PhishTank in their anti-phishing solutions.
This has led to speculations that, with the limited testing data, both Opera and Netcraft Toolbar would have got a perfect score had they been part of the study.