Skip to content

Welcome

Introduction

This project will take your through design and hosting AI applications on Nutanix.

Intended to be used by any Nutanix user to setup and run LLMs, LLM with RAG, Support GPT and other AI applications.

This site follows Design > Deploy model.

Design Infra, K8S and AI Apps

  • AI Apps Design on Nutanix

    Start here to read about gathering requirements and considering general design considerations.

    Start designing

    Start sizing

Deploy Infra

Deploy K8S

  • Set up Nutanix Karbon Engine [ NKE ] in 10 minutes

    Setup a NKE K8S cluster in under an hour using Foundation to prepare your infrastructure.

    Setup Nutanix Karbon Engine

  • Set up Nutanix Kubernetes Platform [ NKP ] in 30 minutes

    Setup a Nutanix NKP K8S cluster to deploy your workloads.

    Setup Nutanix Kubernetes Platform

Deploy AI Apps

  • Set up Nutanix Enterprise AI (NAI) in 60 minutes

    Install and host an LLM on Nutanix Enterprise AI (NAI) platform.

    Start

  • Set up Air-gapped Nutanix Enterprise AI (NAI)

    Install and host an LLM on Nutanix Enterprise AI (NAI) platform.

    Start

  • Set up LLM with RAG on Nutanix in 10 minutes - soon to be deprecated

    Install and host a LLM on Nutanix platform using this framework in this repo. Get up and running in minutes.

    This site will also take you through implementation using NKE clusters and GPT-in-a-Box v1 NVD Reference App.

    Start

Others

  • It's just Markdown

    Everything is this site is written in .md file. When you see something in this repo, say something by submitting a PR.

    We review PR on a day-to-day basis.

    Contributing

Nutanix components used in this project

Open Source Tools used in this projects

Appendix

Baremetal servers ... huh?