Skip to content

Can not load tts_models/multilingual TTS models #2327

Open
@edisonzf2020

Description

@edisonzf2020

LocalAI version: 2.15.0

Docker: image: quay.io/go-skynet/local-ai:master-cublas-cuda12-ffmpeg
Environment, CPU architecture, OS, and Version:

Ubuntu 22.04 GPU
Describe the bug

test 3 models :
1: tts_models/multilingual/multi-dataset/xtts_v2
2: tts_models/multilingual/multi-dataset/xtts_v1.1
4: tts_models/multilingual/multi-dataset/bark

curl -L http://192.168.1.19:8090/tts \
    -H "Content-Type: application/json" \
    -d '{
"backend": "coqui",
"input": "Bonjour Madame ! Comment allez-vous ?",
"model": "tts_models/multilingual/multi-dataset/xtts_v2",
"voice": "Ana Florence"
}' | aplay -D pipewire -

To Reproduce

8:25AM ERR Server error error="could not load model (no success): Unexpected err=UnpicklingError(\"invalid load key, '<'.\"), type(err)=<class '_pickle.UnpicklingError'>" ip=172.22.0.1 latency=13.523714559s method=POST status=500 url=/v1/audio/speech
8:25AM INF Loading model 'tts_models/multilingual/multi-dataset/bark' with backend coqui
8:26AM INF Loading model 'tts_models/multilingual/multi-dataset/xtts_v2' with backend coqui
8:26AM ERR Server error error="could not load model (no success): Unexpected err=UnpicklingError(\"invalid load key, '<'.\"), type(err)=<class '_pickle.UnpicklingError'>" ip=172.22.0.1 latency=13.108962696s method=POST status=500 url=/v1/audio/speech
8:26AM INF Loading model 'tts_models/multilingual/multi-dataset/bark' with backend coqui
8:26AM ERR Server error error="could not load model (no success): Unexpected err=RuntimeError('input(): lost sys.stdin'), type(err)=<class 'RuntimeError'>" ip=192.168.1.28 latency=6.335075199s method=POST status=500 url=/tts

Expected behavior

Logs

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions