Communications of the ACM

Measuring What Matters in Large Language Model Performance

As large language models (LLMs) gain momentum worldwide, there’s a growing need for reliable ways to measure their performance. Benchmarks that evaluate LLM outputs allow developers to track ...
SDxCentral

Nvidia sets benchmarking performance records with its H200 and TensorRT-LLM software

Nvidia has set new MLPerf performance benchmarking records on its H200 Tensor Core GPU and TensorRT-LLM software. MLPerf Inference is a benchmarking suite that measures inference performance across ...
Developer Tech

Google intros benchmark of AI models for Android development

Google has introduced a leaderboard that benchmarks how well AI models handle Android mobile development tasks.
Semiconductor Engineering

Customizing A LLM Model For VHDL Design of High-Performance MPUs (IBM)

A new technical paper titled “Customizing a Large Language Model for VHDL Design of High-Performance Microprocessors” was published by researchers at IBM. “The use of Large Language Models (LLMs) in ...
VentureBeat

Here are 3 critical LLM compression strategies to supercharge AI performance

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More In today’s fast-paced digital landscape, businesses relying on AI face ...
Semiconductor Engineering

Benchmark and Evaluation Framework For Characterizing LLM Performance In Formal Verification (UC Berkeley, Nvidia)

A new technical paper titled “FVEval: Understanding Language Model Capabilities in Formal Verification of Digital Hardware” was published by researchers at UC Berkeley and NVIDIA. “The remarkable ...
VentureBeat

Teaching the model: Designing LLM feedback loops that get smarter over time

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now Large language models (LLMs) have dazzled ...