Nutanix has launched the packaged service GPT-in-a-BoxWith which makes various software elements available to companies that want to adopt generative AI. Among them, several foundational models and AI frameworks designed for the scaling of hyperconverged infrastructure (HCI).
With GPT-in-a-Box, consulting services are also offered, with the aim that clients can specify the most suitable infrastructure configuration for them in terms of hardware and software.
At Nutanix they have thought of this package, at the time of its launch, for local customer use cases. However, it includes workloads at the edge. Later they plan to expand it to the cloud.
The company believes that its clients need help getting the infrastructure up and running to embrace generative AI. This is because its implementation can involve a complex combination of software elements, in addition to the need to add hardware components.
In addition, the company believes that this is often compounded by concerns and doubts about privacy, as well as the governance of AI applications.
That’s why Nutanix offers what it calls an “AI-ready full-stack platform,” with which it expects customers to deploy both hardware and software to train models as many times as needed. He also hopes that the package will show results to application developers.
GPT-in-a-Box packages will offer Nutanix HCI, Nvidia GPU hardware (or recommendations on required hardware), the Nutanix AHV hypervisor, a Kubernetes container layer, and AI foundational models. It also has open source AI frameworks, including KubeFlow, Jupiter, and PyTorch, and a large package of carefully selected language models, such as Llama2, Falcom GPT, and MosaicML. All will deliver suitable results for application development.
GPT-in-a-Box will offer ready-to-use AI infrastructure that the customer can control. In principle, designed for the edge and for data centers. With this solution, customers will be able to run and tune GPT and AI models, without losing control over their data. To do this, Nutanix offers a security and data protection plugin specifically designed for the safeguarding of AI-related information.
Thomas Cornely, Vice President of Product Management at Nutanixhas mentioned that “Helping clients address the biggest challenges they face in IT is at the core of what we do, from multicloud management increasing in complexity, to data protection issues, and now the adoption of generative AI solutions. All while maintaining control over compliance and data privacy. Nutanix GPT-in-a-Box is an AI-ready stack, and is intended to address key issues that can occur with generative AI adoption, as well as help jumpstart AI innovation.«.
