esit-cc-ray

Repository on the use of Ray technology.

This project, proposed by Professor Marcos Colebrook, PhD, showcases the use of Ray in the ESIT Computing Center.

Objectives

• Set up a cluster using Ray technology
• Install a Large Language Model (LLM)
• Retrain an LLM (fine-tunnig)
• Apply Ray to graph processing

Referencia

https://www.anyscale.com/blog/deploying-deepseek-r1-on-anyscale

https://docs.ray.io/en/latest/cluster/vms/user-guides/launching-clusters/on-premises.html#on-prem

https://docs.ray.io/en/latest/data/examples/huggingface_vit_batch_prediction.html

https://docs.vllm.ai/en/latest/index.html