Evidently
Evidently gives your models and LLM apps a proper check-up and keeps every result on one shared dashboard. Project dashboards chart predictions against targets, data drift, and quality scores over time, with counters for model calls and the share of drifted features. A reports page lists every evaluation snapshot with tags, metadata, timestamps, and view or download buttons, and a search box filters them by metadata. Over 100 built-in metrics cover data quality, classification, regression, ranking, recommendations, text descriptors, and LLM judges. Test suites add pass or fail conditions, so a nightly job can flag a drifting feature before customers notice a bad prediction. Datasets, traces, and prompts have their own tabs, which keeps retrieval and generation experiments beside the scores they produced. Reports export as HTML or JSON for sharing outside the dashboard. Results live in a local folder, a SQL database, or S3-compatible storage, and a remote workspace accepts snapshots sent from jobs running anywhere. Built-in demo projects with bike demand forecasting and e-commerce review classification show how a finished dashboard looks before you wire in your own data. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.
Prefect
With 23,600 GitHub stars, 13 million monthly PyPI downloads, and 425+ contributors automating over 200 million data tasks monthly for Fortune 50 companies like Progressive Insurance and disruptors like Cash App, Prefect is the most widely deployed open-source workflow orchestration framework for Python — turning any script into a resilient production pipeline with a single @flow decorator while eliminating rigid DAG structures entirely. The durable execution engine persists task results and automatically resumes from failures without replaying expensive upstream work, guaranteeing exactly-once execution for any Python function. Event-driven automation triggers workflows from webhooks, cloud events, or state changes through a real-time event bus that detects what happens or fails to happen across your entire data platform. Work pools decouple workflow code from infrastructure, enabling seamless switching between Docker, Kubernetes, AWS ECS, Azure Container Instances, GCP Cloud Run, and serverless environments without modifying pipeline logic. Native Ray and Dask task runners extend execution across clusters for compute-intensive workloads. The self-hosted server provides a monitoring dashboard with flow run timelines, task state visualization, scheduling, and automation configuration. The third-generation engine reduces overhead by over 90 percent compared to Prefect 2, supporting batch, event-driven, interactive, and background task workflows. Deploy via Docker Compose with PostgreSQL, Redis, server, background services, and worker containers, or use official Helm charts for production Kubernetes. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
Unsloth
Unsloth puts the whole open-model workflow in one browser tab: pick a model, chat with it, train it, and ship it. Search a model hub, load a GGUF, and talk to it with web search, deep research, file uploads, and sandboxed Python or shell execution that asks before anything risky runs. Line up two models side by side to compare answers, or generate images and video with diffusion models. When a base model is not quite right, a five step wizard sets up fine-tuning with LoRA, QLoRA, FP8, or full training, and a live dashboard charts loss, gradient norm, step progress, and GPU memory. Data Recipes turn PDFs, CSVs, and Word files into question and answer pairs or instruction datasets without hand labeling. Finished models export to GGUF or safetensors for llama.cpp, vLLM, Ollama, and LM Studio. An access token screen exposes an OpenAI-compatible endpoint so Claude Code, Codex, and OpenCode can drive local models. Secure HTTPS links reach the interface from any device. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 and AGPL-3.0 licensed.
GPUStack
GPUStack is a control plane that turns a pile of GPU servers into a model-serving platform, where you pick a model from a catalog and the system decides which machine, engine, and settings run it. Deploy language, embedding, reranker, speech, and image models from the Catalog page, then watch each replica move from downloading to Running on the Deployments screen. A built-in Playground offers chat, side-by-side model comparison, embedding and rerank testing, audio, and image generation and editing, so a model gets judged before it is wired into an app. Add GPU workers with a generated Docker command, register a Kubernetes cluster, or provision cloud machines, and manage several clusters from one server. Create API keys for teammates, apply access control, and read token, GPU-hour, and storage usage by user, key, or model. Auto Tune benchmarking searches for the highest throughput that still meets your latency targets. GPU Instances hand out SSH-accessible machines for fine-tuning and interactive work. Single sign-on works through OIDC or SAML. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.
MLflow
Trusted by thousands of organizations with over 30 million monthly downloads and 20,000+ GitHub stars, MLflow is the largest open-source AI engineering platform providing end-to-end lifecycle management for traditional ML models, LLMs, and AI agents. The OpenTelemetry-based tracing system captures complete request flows through any LLM provider or agent framework — including OpenAI, LangChain, DSPy, Vercel AI, PydanticAI, and smolagents — with one-line auto-instrumentation that tracks inputs, outputs, token usage, and costs at every intermediate step. MLflow's evaluation engine offers 50+ built-in metrics and LLM judges for systematic quality assessment, detecting issues across correctness, latency, adherence, relevance, and safety dimensions before code reaches production. The Prompt Registry versions, tests, and deploys prompts with full lineage tracking while automated optimization algorithms improve prompt performance using evaluation feedback. The AI Gateway provides a unified API endpoint for all LLM providers, enforcing rate limits, cost controls, and access policies across the organization. MLflow 3.0 introduces the LoggedModel abstraction linking traces, metrics, and prompts to specific model versions across Python, TypeScript, Java, and R SDKs. The model registry manages deployment workflows with automated quality gates, while experiment tracking records parameters, metrics, and artifacts across training runs. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache License 2.0 licensed.
OpenLLM
OpenLLM serves any large language model as an OpenAI-compatible API endpoint from a single CLI command, handling model download, backend selection, quantization, and port binding automatically. It supports the full spectrum of popular models including Llama 3.3, Qwen2.5, DeepSeek, Mistral, and Phi3, choosing between vLLM and PyTorch inference backends based on hardware capabilities. When vLLM is available, continuous batching with PagedAttention achieves up to 23x throughput improvement over naive serving, while GPTQ and bitsandbytes quantization reduces memory requirements for GPU-constrained deployments. The server exposes a RESTful API on port 3000 with full OpenAI client library compatibility, enabling drop-in replacement for commercial providers in any application using the standard chat completions format. A built-in web chat UI at the /chat endpoint provides immediate interactive testing without external clients. Custom model repositories allow teams to maintain private catalogs of fine-tuned models alongside the default repository that tracks the latest releases. Deployment workflows generate production-ready Docker images automatically, with Kubernetes manifest support for orchestrated scaling. Native integration with LangChain and LlamaIndex supports RAG pipelines, Transformers Agents enables tool-calling workflows, and HuggingFace Hub handles model discovery. Server-Sent Events enable real-time token streaming across all API endpoints. Backed by BentoML's production ML infrastructure. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.
Netron
Hand Netron an ONNX, TensorFlow Lite, PyTorch, Core ML, or Keras file and the whole network appears as a zoomable graph, with no training framework or inference runtime required to read it. The same viewer opens TorchScript, torch.export, ExecuTorch, TensorFlow, OpenVINO, Caffe, Darknet, Safetensors, and NumPy files, with experimental support for MLIR, JAX, GGUF, RKNN, ncnn, MNN, PaddlePaddle, and scikit-learn. Click a layer to read its type, attributes, inputs, and outputs; click a weight to see its shape, data type, minimum, maximum, mean, standard deviation, and sparsity. Find searches nodes, connections, and weights by name and centers the graph on the match you pick. Toggle attributes, names, and weights on the canvas, flip between vertical and horizontal layouts, and watch light and dark themes follow the system setting. Model and graph panels list the format, producer, imports, graph inputs and outputs, and parameter counts. Any view exports as a PNG or SVG image for documentation, pull requests, and papers. Install with pip, then run netron model.onnx with a host and port, or call netron.start from Python, and the built-in HTTP server delivers the graph to any browser that can reach it. Teams point reviewers at one shared address to check exported models and conversion results. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.
Dagster
With nearly 16,000 GitHub stars, 5.7 million monthly PyPI downloads, and 400+ contributors, Dagster is the most widely adopted asset-centric data orchestration platform — replacing task-oriented schedulers like Apache Airflow with a declarative model where every pipeline is defined as Python functions producing data assets such as tables, datasets, machine learning models, and reports. The built-in asset graph provides automatic lineage tracking across your entire data platform, showing exactly how data flows from ingestion through transformation to downstream consumption in a single unified view. Declarative Automation goes beyond cron scheduling with event-driven conditions that intelligently trigger materializations based on upstream freshness, data quality signals, and dependency state. The integrated data catalog auto-generates documentation from asset metadata, ensuring it never drifts out of sync with production. Native first-class integrations connect dbt, Snowflake, BigQuery, Databricks, Fivetran, Airbyte, Spark, Great Expectations, Tableau, Power BI, AWS, GCP, and Azure without custom glue code. The web UI visualizes asset graphs, run history, schedules, sensors, and partitioned materializations with built-in alerting via Slack and PagerDuty. Dagster Pipes enables executing arbitrary code in external environments including Spark clusters, Kubernetes Jobs, and cloud functions. Deploy via Docker Compose on a single VM with separate containers for the webserver, daemon, and code locations, or use official Helm charts for production Kubernetes with K8sRunLauncher scaling each run as an independent Job. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
SwanLab
Training runs stop being terminal scrollback and become a board you can read at a glance. SwanLab is an open-source experiment tracking and visualization platform for AI model training that records metrics, hyperparameters, logs, and hardware signals from your training code into a modern web dashboard you can self-host. A few lines of Python start an experiment, and the dashboard follows loss curves, learning rates, and custom scalars live, with line chart configuration, smoothing, grouping, and detailed hover inspection for comparing runs. Experiments organize into projects and groups with tags, pinning, filtering, and a table view that sorts and aligns runs against a baseline with difference percentages. Media logging goes far beyond scalars: images, audio, video, text with Markdown rendering, 3D point clouds, molecular structures, and custom ECharts visualizations including PR curves, ROC curves, and confusion matrices. Hardware monitoring records GPU, CPU, memory, disk, and network behavior from NVIDIA, AMD, Ascend, and other accelerators alongside the metrics they produced. Integrations cover more than fifty frameworks, from PyTorch Lightning and Hugging Face Transformers to LLaMA Factory, veRL, and XGBoost, and existing histories migrate in through sync tools for MLflow, TensorBoard, and Weights and Biases. Teams collaborate with organizations, roles, project sharing, webhooks, and notification plugins. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.