The $20 Billion Bet On Inference: What Every AI Infrastructure Team Needs To Get Right

Every ChatGPT query, every AI agent action, every generated video is based on inference. Training a model is a one-time ...

OpenAI ditches Nvidia for faster AI inference chips, threatening chipmaker's dominance

Nvidia remains dominant in chips for training large AI models, while inference has become a new front in the competition.

Microsoft announces powerful new chip for AI inference

Microsoft has announced the launch of its latest chip, the Maia 200, which the company describes as a silicon workhorse ...

AI inference startup Baseten hits $5B valuation in $300M round backed by Nvidia

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities ...

Microsoft Unveils A New AI Inference Accelerator Chip, Maia 200

Microsoft’s new Maia 200 inference accelerator chip enters this overheated market with a new chip that aims to cut the price ...
The News International

OpenAI reportedly explores alternatives to Nvidia for AI inference chips

OpenAI is reportedly looking beyond Nvidia for artificial intelligence chips, signalling a potential shift in its hardware ...
Semiconductor Engineering

Ultra-low-bit LLM Inference Allows AI-PC CPUs And Discrete Client GPUs To Approach High-end GPU-Level (Intel)

A new technical paper titled “Pushing the Envelope of LLM Inference on AI-PC and Intel GPUs” was published by researcher at ...
Electronics For You

Processor Optimised For Large-Scale AI Inference

Microsoft has introduced the Maia 200, its second-generation in-house AI processor, designed for large-scale inference. Maia ...