Table of Contents
Context and Tokens #
Managing context and understanding tokens are central to controlling bot memory, conversation flow, and resource limits. A number of community authors have broken down these concepts:
- m00nprincess’ What are tokens? What is context? And what happens if you hit it? – A foundational guide that explains what tokens are, how context length works, and what happens when the limit is exceeded.
- Xavierisair’s Guide on How to Use Long-Term Memory – Focuses on methods for extending continuity beyond a single conversation session.
- Iorveth’s Explaining the JLLM + Memory – Breaks down the mechanics of JLLM (Janitor Local Language Model) memory and how it interacts with AI behavior.
- Serious1On’s Chat Memory Trick – Offers a practical workaround for improving conversation recall.
Together, these guides give a comprehensive overview of how JanitorAI handles information retention, limits, and optimization.
APIs #
JanitorAI can be paired with various external APIs and LLMs to expand its capabilities beyond the default environment. Community members have created detailed guides covering integration, proxies, and troubleshooting:
- General API Guides
- Peachpup’s Guide to Using JLLM/GPT/Claude – Introductory guide for beginners.
- Hibikiass’ Claude Proxy for Dummies – Step-by-step proxy setup for Claude.
- Kobold CPP Guide by Hibikiass – Integration with KoboldCPP.
- ObsessiveBG3followr’s Guide on Hermes 3 – Tutorial for Hermes 3 models.
- Ok-foot-4548’s Moonshot Tutorial – Instructions for using Moonshot.
- Mia_Leev’s Guide on OpenRouter – Walkthrough for integrating paid models through OpenRouter.
- DeepSeek Integration
- Saturine/Cheesy’s DeepSeek Masterlist – A centralized masterlist for DeepSeek resources.
- Special-Yam-7069’s DeepSeek FAQ – Common questions and troubleshooting tips.
- kinkyalt_02’s How to Use Gemini 2.5 Flash/Pro with Official Google API – Specific guide on Gemini 2.5 via Google’s API.
- Ladywulf’s Using DeepSeek with Targon and not OpenRouter – Alternative integration paths.
- Kamal965’s Advice on Using the Official DeepSeek API – PSA on avoiding OpenRouter.
- r3dux1337’s Guide to Using DeepSeek Through ChutesAI – Setup through ChutesAI.
- Old_Face9295’s DeepSeek Tutorial for Actual Dummies – Simplified guide for complete beginners.
- Local & Proxy LLMs
- Commitdeleteyougoats’ Guide to Using Local LLMs as a Proxy on Janitor – Instructions for self-hosted local LLM setups.