Behavox, the leading provider of AI-driven compliance solutions, is making its Benchmark Test Datasets available to the industry. The datasets, mapped to specific risks and regulations, are designed to simplify the evaluation process for compliance professionals, monitors, and auditors, while ensuring the effectiveness of their surveillance programs.
The Behavox Benchmark Datasets were created by over 200 compliance professionals and have been carefully reviewed. They incorporate enforcement cases and years of experience, offering a robust dataset for evaluating the performance of AI solutions and lexicon scenarios.
These datasets are accompanied by detailed instructions on how to perform outcomes analysis and calculate recall and precision metrics. The release follows the launch of Behavox LLM, the most powerful domain-specific and task-specific AI for compliance surveillance, delivering unprecedented accuracy of compliance alerts. Behavox LLM captures 84% of risk phrases in the Behavox Benchmark Datasets, compared to mid-teens for lexicon scenarios.
Alex Glasman, Chief Data Scientist at Behavox, said, "Sharing Benchmark Test Datasets is considered best practice in AI, and it is a crucial part of rolling out AI responsibly. By making our Benchmark Test Datasets available, we aim to encourage collaboration and transparency across the industry, as well as improve the overall effectiveness of compliance surveillance."
Fahreen Kurji, Chief Customer Intelligence Officer at Behavox, added, "For years, the industry has been grappling with inconsistent evaluation methodologies for surveillance programs, with the main pain point being the creation of planted content. With Behavox releasing its Benchmark Datasets, planted content can now be done as simply as copy and paste."
With this announcement, Behavox invites consulting firms, regulators, academia, financial institutions, and auditors to review, use, and contribute to the Behavox Benchmark test dataset.
To experience AI for Compliance live in action, join Behavox on April 6th in NYC at their AI Summit. See how and why we have outperformed ChatGPT and learn more about explainable and effective AI compliance solutions.
About Behavox Ltd.
Behavox, the leading provider of AI-driven compliance solutions.
As a market leader in the application of Artificial Intelligence to monitoring of text and voice communications, Behavox’s software protects companies and their employees from bad actors engaged in illegal and malicious activities.
Compliance, surveillance, legal and SOC teams rely on Behavox software to reduce false positives and increase detection rate across a broad range of risks. There are many solutions to protect companies from outside risks; Behavox protects companies from inside risks.
Founded in 2014, Behavox is headquartered in Montreal and has offices in New York City, London, Seattle, Singapore, and Tokyo.
More information about the company is available at www.behavox.com
"With Behavox releasing its Benchmark Datasets, planted content can now be done as simply as copy and paste."