Returns? Many enterprises lack benchmarks for measuring success of AI: Wedbush

As enterprises actively pursue the deployment of artificial intelligence tools, many of these businesses have not created ...
SiliconANGLE

Researchers develop new LiveBench benchmark for measuring AI models’ response accuracy

A group of researchers has developed a new benchmark, dubbed LiveBench, to ease the task of evaluating large language models’ question-answering capabilities. The researchers released the benchmark on ...
SiliconANGLE

MLCommons releases new AILuminate benchmark for measuring AI model safety

MLCommons today released AILuminate, a new benchmark test for evaluating the safety of large language models. Launched in 2020, MLCommons is an industry consortium backed by several dozen tech firms.
VentureBeat

LiveBench is an open LLM benchmark that uses contamination-free test data and objective scoring

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now A team of Abacus.AI, New York University, ...
Communications of the ACM

Technical Perspective: Synthetic Data Needs a Reproducibility Benchmark

Synthetic data is a vital substitute for real sensitive personal data in supporting social science research and policy ...
HotHardware

Geekbench AI Cross-Platform Benchmark Preview: Measuring AI Throughput

The Geekbench suite of system benchmarks have their limitations, but they present a reasonable impression of overall performance for a wide variety of productivity, content creation, and ...
TechCrunch

Why most AI benchmarks tell us so little

On Tuesday, startup Anthropic released a family of generative AI models that it claims achieve best-in-class performance. Just a few days later, rival Inflection AI unveiled a model that it asserts ...