Hewlett Packard, Nvidia Offer Private Cloud for Secure Generative AI Models
Hewlett Packard Enterprise (HPE) is teaming with Nvidia to offer a jointly developed tool for privately running generative AI models and workloads in the cloud.
Announced during HPE’s Discover event, HPE Private Cloud AI integrates Nvidia’s computing and software technologies with HPE’s storage solutions, allowing users to run generative AI workloads efficiently and securely.
The platform enables enterprises to conduct inference and fine-tuning tasks using proprietary data, enabling the development and deployment of flexible and secure generative AI solutions.
“Generative AI and accelerated computing are fueling a fundamental transformation as every industry races to join the industrial revolution,” said Jensen Huang, Nvidia founder and CEO. “Never before have Nvidia and HPE integrated our technologies so deeply, combining the entire Nvidia AI computing stack along with HPE’s private cloud technology, to equip enterprise clients and AI professionals with the most advanced computing infrastructure and services to expand the frontier of AI.”
HPE Private Cloud AI includes Nvidia AI Enterprise software, tools designed to streamline generative AI application development, such as the new NIM microservice, which helps users optimize AI model inference.
HPE software also comes with tools to help monitor the AI model and data compliance. HPE’s GreenLake cloud service lets users automate and manage endpoints and data across hybrid environments.
The new solution also comes with an integrated AI infrastructure stack that allows enterprise users to manage and deploy AI workloads across various platforms, including HPE GreenLake for File Storage, Nvidia Spectrum-X Ethernet networking and powerful GPUs such as Nvidia’s H100 Tensor Cores.
HPE Private Cloud AI will be made generally available in fall 2024.
Other announcements from Discover 2024 include Nvidia extending support to several HPE supercomputing and server solutions, including that Cray XD670 now supports eight Nvidia H200 Tensor Core GPUs, making it an ideal computing solution for companies looking to power large language models.
“Generative AI holds immense potential for enterprise transformation, but the complexities of fragmented AI technology contain too many risks and barriers that hamper large-scale enterprise adoption and can jeopardize a company’s most valuable asset: its proprietary data,” said Antonio Neri, HPE’s president and CEO. “To unleash the immense potential of generative AI in the enterprise, HPE and Nvidia co-developed a turnkey private cloud for AI that will enable enterprises to focus their resources on developing new AI use cases that can boost productivity and unlock new revenue streams.”
