Перейти к содержимому

004: Haruspex Update, still a web researcher, but now a shell and coding agent too.

Spronglehump's Laboratory

0:00 / 0:00

004: Haruspex Update, still a web researcher, but now a shell and coding agent too.

91 просмотр · 2 месяца назад
Spronglehump's Laboratory
115 подписчиков
91 просмотр · 2 месяца назад
Haruspex is an opinionated web researcher, shell, and coding agent that is designed to use a local LLM and will download, manage, and run local inference for you if you like. Designed to work with GPUs with 8GB of VRAM or more. The primary goals of this project are: Privacy - Conversations and inference stay local. Searches themselves hit the web but web proxies and SearXNG are supported to anonymize your web searches. Open Source/Open Weight - Use of open weight local models means no monthly bill. Minimal Hardware Requirements - This project targets 8GB of Unified RAM/VRAM for LLM+Context. Currently the model used is Qwen-3.5-9B (though we do offer Qwen-3.5-4B if you are tight on memory). All project features are built with this target (and the inherit limitations of a small model) in mind. Human Enablement, Not Human Replacement - There are many projects that are building fully autonomous agents, this isn't one of them. This project aims to use AI to assist humans in learning, creation, and troubleshooting; not replace the human element completely. https://github.com/tmac1973/haruspex