Wheatley
early / alphaChat Interface for Self-Hosted Models
Talk to your own models. Nothing leaves the machines you own.
Overview
Wheatley is a chat interface that points at inference you run yourself instead of somebody else's API. Ask it questions, paste a stack trace, work through a problem — and the conversation stays on your hardware, because the model is on your hardware. We built it for ourselves, use it every day, and open-sourced it because there was no reason not to.
Runs on
Coming soon
Highlights
Cloud option
There is no hosted version and there is not going to be one. The whole point is that the model and the transcripts are on hardware you control — selling you a copy running on ours would be selling the opposite of the product. Self-host it with one container and a database.
Prefer to run your own server? Self-hosting is always free.
Wheatley is open source
Read it, file an issue, or send a patch.