How Dell is Utilising AI to Uplift Enterprises
As AI technologies become more sophisticated, companies face challenges in implementing and scaling these solutions effectively.
The integration of AI into existing business operations requires not only robust hardware infrastructure but also software solutions and expert guidance.
Many enterprises struggle with issues ranging from data preparation and model training to deployment and maintenance of AI systems at scale.
In response to this growing demand, technology providers are developing AI platforms and services to support businesses in their AI adoption journey.
Aiming to bridge the gap between AI aspirations and practical deployment, Dell Technologies, has announced significant advancements to its Dell AI Factory, expanding its portfolio of AI solutions for enterprises.
These developments represent a strategic move to democratise AI technology and make it more accessible to businesses of all sizes.
Dell has introduced new infrastructure, solutions and services designed to accelerate, simplify and streamline AI workloads and data management.
High-performance computing for AI workloads
Dell’s new AI infrastructure offers high-density, efficient compute and eases access to data to power AI workloads.
Dell PowerEdge XE9685L
The Dell PowerEdge XE9685L is a high-density, 4U liquid-cooled server designed for AI, machine learning, high performance computing (HPC) and other data-intensive workloads.
“The continued reimagining and improvement of AI and HPC technologies is critical to accelerating discoveries across industries,” emphasises Dan Stanzione, Executive Director, Texas Advanced Computing Center (TACC).
“With Dell’s AI solutions we are building complex HPC systems that allow innovation to thrive in research communities. Ultimately, these advances have the potential to reshape society and drive progress that benefits everyone.”
Additionally, the company has expanded its Integrated Rack Scalable Systems (IRSS) program through this technology, which delivers fully loaded, plug-and-play rack-scale systems with Dell Smart Cooling.
The program now includes the Dell PowerEdge XE9685L and Dell PowerEdge XE7740 servers in the standard 19-inch Dell Integrated Rack 5000 (IR5000).
It features dual 5th Gen AMD EPYC CPUs paired with Nvidia HGX H200 or B200 platforms, offering customisable configurations to meet specific compute needs.
Dell PowerEdge XE7740
The Dell PowerEdge XE7740 is a 4U air-cooled server that uses dual Intel Xeon 6 processors with P-cores and supports up to 8 double-wide accelerators or 16 single-wide accelerators.
- New Dell PowerEdge XE servers and Data Lakehouse upgrades offer scalable, HPC and simplified data management for AI workloads
- Upcoming Dell PowerEdge XE server will support Nvidia GB200 Grace Blackwell NVL4 Superchip, enabling up to 144 GPUs per rack
- Enhanced solutions streamline AI application development and deployment processes
- Dell Professional Services provide expertise in sustainability, data management and networking to accelerate AI adoption and reduce complexity
This flexibility allows enterprises to tailor their server configuration for various AI tasks, from fine-tuning or inferencing Gen AI models to extracting value from large datasets.
Dell PowerEdge XE
Dell has also announced plans to support the upcoming Nvidia GB200 Grace Blackwell NVL4 Superchip with a new Dell PowerEdge XE server designed for the Dell IR7000, supporting up to 144 GPUs per rack in a 50OU standard rack.
Dell Data Lakehouse
Meanwhile, Dell’s updates to the Dell Data Lakehouse, a modern architecture for managing and analysing data efficiently for AI tasks, provide enterprises with modern architectures for efficiently managing and analysing data for AI tasks.
The platform will expand to include Apache Spark for distributed data processing at scale, offering significant efficiency gains for businesses managing massive data volumes.
Nvidia collaborative solutions to accelerate AI adoption
Dell is also working with partners across the AI ecosystem to power and simplify AI deployments.
"Enterprises are pursuing AI to remain competitive in today's digital landscape but they need to harness their proprietary data to differentiate.”
Dell AI Factory with Nvidia
Updates to the Dell AI Factory with Nvidia, known for its graphics processing units (GPUs) and AI computing solutions, deliver accelerated performance and reduced time-to-outcomes for AI operations and use case deployment.
The Nvidia HGX H200 and H100NVL support options provide up to 1.9 times higher performance over Nvidia HGX H1001.
Dell Agentic RAG with Nvidia
Additionally, the Dell Agentic RAG with Nvidia, part of the Dell AI Factory with Nvidia, allows customers to perform complex queries and accelerate their retrieval augmented generation (RAG) operations.
The solution leverages Dell PowerEdge, Dell PowerScale and Nvidia AI Enterprise software and generative AI tools including NeMo Retriever microservices and the Nvidia AI Blueprint for multimodal PDF data extraction.
Dell Validated Designs for AI PCs
Furthermore, the Dell Validated Designs for AI PCs are open-source guides designed to boost the development of AI applications on Dell AI PCs with NPU technology.
Developers can easily customise the modular designs to integrate features like large language models (LLMs), vision, text and speech into applications.
However, despite these AI developments, Arthur Lewis, President of Dell's Infrastructure Solutions Group, highlights the challenges businesses face in implementing AI across their operations: "Getting AI up and running across a company can be a real challenge.
“We're making it easier for our customers with new AI infrastructure, solutions and services that simplify AI deployments, paving the way for smarter, faster ways to work and a more adaptable future".
Professional services for AI implementation
To address the challenge of finding talent to develop strategies and implement AI, Dell Professional Services offers a range of support options. These include:
Advisory and Implementation Services for Sustainable Data Centres: provide expertise to create and implement strategies designed to improve energy efficiency, which can help lower emissions in the data centre with intelligent power and cooling management for sustainability goals.
Data Management Services: deliver an AI-ready catalogue by discovering, classifying and refining data, giving organisations simplified access to organised, high-quality data.
Design Services for AI Networking: provide customers with a network design optimised for AI workloads that delivers faster speeds, reduced latency and enhanced scalability.
Design Services for AI Networking: provide customers with a network design optimised for AI workloads that delivers faster speeds, reduced latency and enhanced scalability.
Implementation Services for ServiceNow Now Assist: integrate GenAI capabilities into service management workflows via Now Assist, which streamlines content gathering through AI-driven summaries to automate outcomes and improve productivity.
Overall, the new offerings from Dell Technologies aim to address key challenges in enterprise AI adoption, including infrastructure scalability, data management and talent acquisition.
"Enterprises are pursuing AI to remain competitive in today's digital landscape but they need to harness their proprietary data to differentiate,” says Dave Vellante, Chief Analyst at theCUBE Research, commenting on the importance of AI infrastructure and services.
"We're seeing a resurgence in interest for offerings like Dell's AI infrastructure, solutions and services that can help customers prepare their data to extract insights, automate tasks and transform processes.
“As we continue into this new era of technological innovation, it will be critical for enterprises to continuously learn and invest in innovation to realise the benefits AI promises".
Make sure you check out the latest edition of Technology Magazine and also sign up to our global conference series - Tech & AI LIVE 2024
Technology Magazine is a BizClik brand