dbta

Predibase Inference Engine Offers a Cost Effective, Scalable Serving Stack for Specialized AI Models

Predibase, the developer platform for productionizing open source AI, is debuting the Predibase Inference Engine, a comprehensive solution for deploying fine-tuned small language models (SLMs) quickly ...

GoodVision AI Joins NVIDIA Connect to Advance AI Inference at Scale

GoodVision AI Inc. (GoodVision AI), a company building the global compute architecture for AI inference, today announced it has joined NVIDIA Connect. The program gives solution providers and service ...
VentureBeat

The team behind continuous batching says your idle GPUs should be running inference, not sitting dark

Every GPU cluster has dead time. Training jobs finish, workloads shift and hardware sits dark while power and cooling costs keep running. For neocloud operators, those empty cycles are lost margin.

Why Enterprises Are Rethinking Infrastructure for the AI Inference Era

Enterprise conversations around artificial intelligence are beginning to shift noticeably. For the past few years, much of ...
Barron's

Nvidia Announces New Inference Engine Called Dynamo

Inference, what happens after you prompt an AI model like ChatGPT, has taken on more salience now that traditional model scaling has stalled. To get better responses, model makers like OpenAI and ...
VentureBeat

Pipeshift cuts GPU usage for AI inferences 75% with modular interface engine

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now DeepSeek’s release of R1 this week was a ...
Semiconductor Engineering

What’s The Best Way To Sell An Inference Engine?

The burgeoning AI market has seen innumerable startups funded on the strength of their ideas about building faster, lower-power, and/or lower-cost AI inference engines. Part of the go-to-market ...
SiliconANGLE

Red Hat Expands AI offerings with inference server and validated models

Red Hat Inc. today announced a series of updates aimed at making generative artificial intelligence more accessible and manageable in enterprises. They include the debut of the Red Hat AI Inference ...

Sail Research raises $80M to optimize long-horizon AI agents

Inference startup Sail Research Inc. today announced that it has raised $80 million in funding at a $450 million valuation.
HotHardware

AI Start-Up Axelera Dominates Machine Vision Benchmarks With Efficient, Fast Accelerators

As AI-accelerated workloads proliferate across edge environments—from smart cities to retail and industrial surveillance—choosing the right inference accelerator has become a mission-critical decision ...
Forbes

The New Frontier Of LLM Inference: Where The Next Tenfold Gains Will Come From

Shakti P. Singh, Principal Engineer at Intuit and former OCI model inference lead, specializing in scalable AI systems and LLM inference. Generative models are rapidly making inroads into enterprise ...