Skip to content

Genius-Society/dyber_genshin_ai_vits

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

30 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Dyber Genshin AI VITS

license itch hf ms bili

DyberPet_GenshinImpact + KimiChat + BertVITS2

DyberPet_GenshinImpact is an open-source desktop pet framework that serves as the foundation for custom virtual companions. We have augmented this framework by integrating a large language model (LLM) alongside a VITS-based (Variational Inference with adversarial learning for end-to-end Text-to-Speech) text-to-speech (TTS) module, which together enable intelligent, context-aware dialogue with designated Genshin Impact characters. VITS is a state-of-the-art, single-stage TTS model that delivers natural, high-quality voice synthesis without external alignment annotations. As such, dyber_genshin_ai_vits represents an AI-enhanced desktop pet game.

Environment

Please note that to achieve real-time or near-real-time voice inference, the application requires an NVIDIA GeForce GTX 1080 Ti or a more powerful GPU; on lesser hardware, audio synthesis latency may become unacceptably high.

conda create -n py311 python=3.11 -y
conda activate py311
pip install -r requirements.txt

Code download

git clone [email protected]:Genius-Society/dyber_genshin_ai_vits.git
cd dyber_genshin_ai_vits

Run

python main.py

Build

python build.py
# Fetch the DyberGenshinAI-win10x64-*.zip from ./dist

Thanks