From d95852777dce40ee24a3c0d7d1a711402820fadc Mon Sep 17 00:00:00 2001 From: "Michael A. Kuykendall" Date: Thu, 9 Oct 2025 16:47:22 -0500 Subject: [PATCH] Add Shimmy - Privacy-focused AI inference server - Python-free Rust implementation for maximum security - OpenAI-compatible API for drop-in ChatGPT replacement - Self-hosted on-premises deployment keeps data private - Zero cloud dependencies protect user privacy - GGUF + SafeTensors support for modern LLM serving --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 765c99e..ab8f6fd 100644 --- a/README.md +++ b/README.md @@ -259,6 +259,7 @@ When using cloud-based AI services, the data you input is often collected and st - [Jan](https://github.com/janhq/jan) - Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. - [LocalAI](https://github.com/go-skynet/LocalAI) - Self-hosted, community-driven simple local OpenAI-compatible API written in go. Can be used as a drop-in replacement for OpenAI, running on CPU with consumer-grade hardware. - [ollama](https://github.com/jmorganca/ollama) - Get up and running with Llama 2 and other large language models locally. +- [Shimmy](https://github.com/Michael-A-Kuykendall/shimmy) - Python-free Rust inference server with OpenAI-compatible API for private on-premises AI without cloud dependencies. #### Copilot