ReadyLLM
Your inference server should not sit mostly idle while a model crawls along at ten tokens per second, so ReadyLLM gives you a visual way to deploy, watch, and tune LLMs until the hardware is actually earning its keep. Add the machine under your desk or a remote box over SSH, let hardware detection read its GPU, VRAM, CPU, and memory, and get model recommendations that fit what you own instead of wishful downloads. A model store catalogs text, image, and video models with parameter counts, precision, resolutions, and real weight filenames, background downloads from multiple sources, and integrity checks when they land. One click starts or stops llama.cpp, vLLM, or SGLang services, installs a missing engine matched to your GPU backend, and leaves runtime parameters open for manual tweaks. Live curves track GPU utilization, memory, throughput, and latency as requests flow. When speed disappoints, two-phase auto tuning searches the knobs that matter, checks VRAM feasibility before it wastes your time, and benchmarks honestly against latency, throughput, or prefill goals; an AI tuning mode can reason through the same loop across several rounds. Beyond chat models, ComfyUI generation covers text-to-image and text-to-video, storyboards, shot-by-shot long video, and upscaling, with prompts optionally expanded first. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
Deploy