Popular repositories Loading

1. NV-Kernels NV-Kernels Public

   Forked from NVIDIA/NV-Kernels

   Ubuntu kernels which are optimized for NVIDIA server systems

2. atlas atlas Public

   Forked from Avarok-Cybersecurity/atlas

   Pure Rust Inference Engine

   Rust

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python

5. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python

6. dgx-spark-playbooks dgx-spark-playbooks Public

   Forked from NVIDIA/dgx-spark-playbooks

   Collection of step-by-step playbooks for setting up AI/ML workloads on NVIDIA DGX Spark devices with Blackwell architecture.

   Jupyter Notebook