An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale
-
Updated
Nov 17, 2026 - Python
An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale
This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.
Self-hosted, OpenAI-compatible inference for the agentic era: reasoning LLMs, universal tool calling, and the Responses API alongside embeddings, speech, and image models — many models sharing your GPUs, one gateway. Powered by Ray Serve.
Batch LLM Inference with Ray Data LLM: From Simple to Advanced
Building Real-Time Inference Pipelines with Ray Serve
BioEngine is a distributed AI platform that brings the power of cloud computing to bioimage analysis.
A Production-Ready, Scalable RAG-powered LLM-based Context-Aware QA App
Multi-node Slurm training + Ray Serve deployment + Prometheus/Grafana monitoring, with NVIDIA NGC container hooks.
Create Context-Aware Q&A Interfaces from Your Own Data with LLMs and Vector Embeddings - Includes an automated embedding pipeline and a model-powered Q&A interface
A comprehensive guide to setting up and managing Raspberry Pi, Ray Clusters, and distributed AI workloads. Includes network troubleshooting, IP configuration, Ray Dashboard, and Python script execution for scalable AI applications.
Serving engine for tabular foundation models (TabICL, TabPFN): fit a table once, keep its encoded context on the GPU, and serve fast repeat predictions to many tenants, with memory-aware admission and multi-GPU placement.
Plugin-first framework for modular Python services with FastAPI ingress and optional Ray execution.
Multi-backend LLM serving and training platform — vLLM/Triton/Ray Serve/KServe/BentoML behind one contract, Kueue/Karpenter GPU orchestration, Ray Train/FSDP/DeepSpeed with LoRA/PEFT and DVC, MLflow/W&B tracking, and a tool-grounded LangGraph advisor — CI-validated without real GPU cost.
Distributed RAG platform on Kubernetes using Ray Serve, FastAPI, vector databases, and LLM orchestration.
Open HPC and scientific-Python notebooks from Eugo: case studies on public NOAA and Copernicus data (GOES-16, National Water Model, Sentinel-2), 44 Ray patterns, and smoke tests for 1,200+ Python packages and 240+ native libraries.
Distributed LLM inference on Kubernetes with KubeRay and Ray Serve.
Production-grade scalable embedding API server using SentenceTransformers "intfloat/multilingual-e5-base" model, powered by Ray Serve for multi-GPU orchestration, with Prometheus & Grafana monitoring.
A distributed ML recommendation system — real-time streaming, multi-node distributed training, and fault-tolerant, scalable serving.
Ray Torch DDP training on large streaming building footprint dataset + Ray serve + Confluent Kafka streams serve
Production LLM serving infrastructure using Triton Inference Server, vLLM, and Ray Serve with OpenAI-compatible endpoints. Includes Kubernetes autoscaling configs driven by DCGM GPU metrics and a BentoML packaging path for portable model deployment.
To associate your repository with the ray-serve topic, visit your repo's landing page and select "manage topics."