Popular repositories Loading

1. jan jan Public

   Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

   TypeScript 22.1k 1.3k

2. cortex.cpp cortex.cpp Public

   Run and customize Local LLMs.

   C++ 1.9k 105

3. cortex.tensorrt-llm cortex.tensorrt-llm Public

   Forked from NVIDIA/TensorRT-LLM

   Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU accelerated inference on NVIDIA's GPUs.

   C++ 36 2

4. model-converter model-converter Public archive

   Python 19 5

5. docs docs Public

   Jan.ai Website & Documentation

   MDX 19 8

6. cortex.llamacpp cortex.llamacpp Public

   cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server at runtime.

   C++ 16 3