ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

llm-numbers

Numbers every LLM developer should know

llm-applications

A comprehensive guide to building RAG-based LLM applications for production.

kuberay

A toolkit to run Ray applications on Kubernetes

ray-llm

RayLLM - LLMs on Ray

tutorial

llmperf

LLMPerf is a library for validating and benchmarking LLMs

tune-sklearn

A drop-in replacement for Scikit-Learn’s GridSearchCV / RandomizedSearchCV -- but with cutting edge hyperparameter tuning techniques.

llmperf-leaderboard

ray-educational-materials

This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.

langchain-ray

Examples on how to use LangChain and Ray

ray_lightning

Pytorch Lightning Distributed Accelerators using Ray