How the Dell AI Factory and Nvidia Accelerate Enterprise AI

Enterprises rushing to adopt AI run into the same brick wall: the scaling problem.

The Dell AI Factory with Nvidia – created to help enterprises reach the AI finish line safe and fast, with reduced complexity and maximum ROI– has now announced new advancements solidifying the partnership between the two.

With new servers, innovative storage solutions and a powerhouse of Nvidia GPUs, the Dell AI factory cashes out on being an accelerator of Enterprise AI.

Jeff Clarke, Vice Chairman and COO of Dell Technologies, says: “The Dell AI Factory with Nvidia solves the problem every enterprise is facing: how to move from AI pilots to production without rebuilding their infrastructure. 

“We've done the integration work so customers don't have to, which means they can deploy faster and scale with confidence.”  

Nvidia Dynamo integration for 19x faster memory

AI Reasoning models are memory and time intensive as they generate a large number of tokens to solve complex queries.

The Dell ObjectScale and PowerScale – Dell’s storage engines that store unstructured data – will now be integrated with the Nvidia NIXL library, which is part of Nvidia Dynamo. 

Nvidia Dynamo is a distributed framework that intelligently routes requests to appropriate GPUs, to avoid redundant computation, thereby saving memory and cost. 

The integration of Nvidia Dynamo allows KV cache storage, reuse and sharing – meaning that the models can simply retrieve these values instead of having to recompute them, speeding up performance. 

This method offers a one second Time to First Token (TTFT), which means it just takes one second to generate the first characters the user sees as output after entering a prompt. 

This is 19 times faster than regular vLLMs. 

Next generation AI Infrastructure with Nvidia Blackwell Servers 

The Dell AI factories will now include Dell PowerEdge XE7740/XE7745 servers, which are powered by the state of the art Nvidia RTX 6000 Blackwell Server edition GPUs alongside Nvidia’s Hopper GPUs. 

Having recently beaten out competitors with its record breaking performance, Nvidia GPUs will deliver compute power required for advanced AI applications including scalable agentic AI.

An anticipated new addition is the Dell Automation Platform, that can produce optimised solutions with repeatable outcomes within a secure framework.

To get AI into production faster, the AI code assistant with Tabnine and agentic AI platform Cohere North are now automated.  

Justin Boitano, Vice Ppresident of Enterprise AI Products at Nvidia, says: “Enterprise AI is shifting from experimentation to transformation, advancing at unprecedented speed and redefining how businesses operate. 

“Together, Dell and Nvidia are driving this evolution with a fully integrated platform that unites advanced infrastructure, intelligent automation and powerful data engines to help organisations deploy AI at scale and realise measurable impact.”

New advancements set to be released soon include the Dell PowerEdge XE8712 server, with the highest GPU density ever seen in the industry with 144 Nvidia Blackwell GPUs.

The whole range of Enterprise AI advancements offered up by the Dell AI factories shows significant promise for the future of Enterprise AI adoption, made easier, faster and more secure.