音频

其他 社区

技能解读

当前原文的自动摘译,尚未人工审校。

二进制文件

{baseDir}/scripts/tts — 使用指定说话者生成文本到语音。 {baseDir}/scripts/voice_clone — 从参考音频文件克隆语音。

型号

{baseDir}/scripts/models/Qwen3-TTS-12Hz-0.6B-CustomVoice — 命名说话人 TTS(0.6B 参数)。 {baseDir}/scripts/models/Qwen3-TTS-12Hz-0.6B-Base — 从参考音频克隆语音(0.6B 参数)。

参考音频

用于语音克隆的预打包参考音频文件可在{baseDir}/scripts/reference_audio/获得。每个扬声器都有两个文件: {baseDir}/scripts/reference_audio/<speaker_name>.wav — 参考音频(单声道 24kHz 16 位 WAV) {baseDir}/scripts/reference_audio/<speaker_name>.txt — 参考音频的转录 可用参考扬声器:trump、elon_musk。

何时使用哪种工具

tts — 当用户想要使用指定说话者(Vivian、Ryan 等)从文本生成语音时。支持英文和中文。 voice_clone — 当用户想要从参考音频文件中克隆特定语音并在该语音中生成新语音时。如果用户要求按说话者姓名克隆语音(例如,“像特朗普一样说话”、“使用埃隆·马斯克的声音”),请检查 {baseDir}/scripts/reference_audio/ 是否有匹配的 <speaker_name>.wav 和 <speaker_name>.txt 对,并对这两个文件使用 ICL 模式。

Linux环境设置

在 Linux 上,二进制文件需要 libtorch 共享库。在运行任何命令之前设置库路径:在 macOS 上,不需要环境设置(二进制文件使用 MLX 后端)。以下所有命令均显示 macOS 形式。在 Linux 上,为每个命令添加前缀 LD_LIBRARY_PATH={baseDir}/scripts/libtorch/lib:$LD_LIBRARY_PATH。

流狐档案 运行与权限由流狐静态检查推断,不代表作者声明或实际测试结果。
领域
通用
作者声明的智能体
未找到明确声明;不据此推断已兼容或已测试
静态检查
88 / 100 · 启发式扫描,不代表运行安全
运行环境证据
未执行;当前没有隔离运行测试证据
作者 / 版本 / 许可证
@second-state · 未声明许可证
上下文用量评级
低消耗
接入复杂程度
即装即用
是否需要外部接口密钥
不需要
兼容的系统
macOS · Linux
运行环境要求
未检出明确要求
检测到的文件与系统行为
  • 只读
  • 允许写入 / 修改
网络行为
仅限本地
安装命令数
无(仅作为资料)

需要注意: 未声明工具权限范围;实际权限由运行环境决定。

作者说明文件(原文) SKILL.md

# Qwen3 TTS — Text-to-Speech and Voice Cloning

Generate speech audio from text, or clone a voice from a reference audio file.

## Binaries

* `{baseDir}/scripts/tts` — Text-to-speech generation with named speakers.
* `{baseDir}/scripts/voice_clone` — Voice cloning from a reference audio file.

## Models

* `{baseDir}/scripts/models/Qwen3-TTS-12Hz-0.6B-CustomVoice` — Named speaker TTS (0.6B parameters).
* `{baseDir}/scripts/models/Qwen3-TTS-12Hz-0.6B-Base` — Voice cloning from reference audio (0.6B parameters).

## Reference Audio

Pre-packaged reference audio files for voice cloning are available at `{baseDir}/scripts/reference_audio/`. Each speaker has two files:

* `{baseDir}/scripts/reference_audio/<speaker_name>.wav` — Reference audio (mono 24kHz 16-bit WAV)
* `{baseDir}/scripts/reference_audio/<speaker_name>.txt` — Transcript of the reference audio

Available reference speakers: `trump`, `elon_musk`.

## When to Use Which Tool

- **`tts`** — When the user wants to generate speech from text using a named speaker (Vivian, Ryan, etc.). Supports English and Chinese.
- **`voice_clone`** — When the user wants to clone a specific voice from a reference audio file and generate new speech in that voice. If the user asks to clone a voice by speaker name (e.g., "speak like Trump", "use Elon Musk's voice"), check `{baseDir}/scripts/reference_audio/` for a matching `<speaker_name>.wav` and `<speaker_name>.txt` pair, and use ICL mode with both files.

## Linux Environment Setup

On Linux, the binaries require libtorch shared libraries. Set the library path before running any command:

```bash
export LD_LIBRARY_PATH={baseDir}/scripts/libtorch/lib:$LD_LIBRARY_PATH
```

On macOS, no environment setup is needed (the binaries use the MLX backend). All commands below show the macOS form. On Linux, prefix each command with `LD_LIBRARY_PATH={baseDir}/scripts/libtorch/lib:$LD_LIBRARY_PATH`.

## Text-to-Speech

Generate speech audio from text with a named speaker.

```bash
{baseDir}/scripts/tts \
  {baseDir}/scripts/models/Qwen3-TTS-12Hz-0.6B-CustomVoice \
  "<text>" \
  <speaker> \
  <language>
```

### Parameters

| Parameter | Required | Description |
|-----------|----------|-------------|
| model_path | Yes | Path to the model directory |
| text | Yes | The text to synthesize as speech |
| speaker | Yes | Speaker name (see Available Speakers below) |
| language | Yes | `english` or `chinese` |

### Available Speakers

Vivian, Serena, Ryan, Aiden, Uncle_fu, Ono_anna, Sohee, Eric, Dylan.

### Output

Generates `output.wav` (24kHz mono WAV) in the current working directory.

### Example

```bash
{baseDir}/scripts/tts \
  {baseDir}/scripts/models/Qwen3-TTS-12Hz-0.6B-CustomVoice \
  "Hello! Welcome to the Qwen3 text-to-speech system." \
  Vivian \
  english
```

## Voice Cloning (ICL Mode)

Clone a voice from a reference audio file using ICL (In-Context Learning). This encodes the reference audio into codec tokens and conditions generation on both the speaker embedding and the reference audio/text transcript, producing high-fidelity voice cloning.

Both a reference audio file and its transcript text are required.

```bash
{baseDir}/scripts/voice_clone \
  {baseDir}/scripts/models/Qwen3-TTS-12Hz-0.6B-Base \
  <reference_audio.wav> \
  "<text>" \
  <language> \
  "<reference_text>"
```

### Parameters

| Parameter | Required | Description |
|-----------|----------|-------------|
| model_path | Yes | Path to the Base model directory |
| reference_audio | Yes | Path to reference WAV file (mono 24kHz 16-bit) |
| text | Yes | The text to synthesize in the cloned voice |
| language | Yes | `english` or `chinese` |
| reference_text | Yes | Transcript of the reference audio |

### Reference Audio Requirements

The reference audio must be a **mono 24kHz 16-bit WAV** file. Convert from other formats with ffmpeg:

```bash
ffmpeg -i input.m4a -ac 1 -ar 24000 -sample_fmt s16 reference.wav
```

### Output

Generates `output_voice_clone.wav` (24kHz mono WAV) in the current working directory.

### Example

```bash
{baseDir}/scripts/voice_clone \
  {baseDir}/scripts/models/Qwen3-TTS-12Hz-0.6B-Base \
  reference.wav \
  "This is a voice cloning test with in-context learning." \
  english \
  "The transcript of what was said in the reference audio."
```

## Workflow

### 1. Determine the Task

- If the user wants to generate speech from text with a named speaker (Vivian, Ryan, etc.), use `tts`.
- If the user wants to clone a voice from an audio file, use `voice_clone`.
- If the user asks to clone a voice by speaker name (e.g., "speak like Trump", "in Elon Musk's voice"), use `voice_clone` with the pre-packaged reference audio.

### 2. Prepare Input

- For `tts`: Identify the text, speaker name, and language from the user's request. Default to `Vivian` and `english` if not specified.
- For `voice_clone` with a named reference speaker:
  1. Look up `{baseDir}/scripts/reference_audio/<speaker_name>.wav` and `{baseDir}/scripts/reference_audio/<speaker_name>.txt`.
  2. Read the transcript from the `.txt` file.
  3. Pass both the `.wav` file and the transcript text.
- For `voice_clone` with a user-provided audio file: Ensure the reference audio is a mono 24kHz 16-bit WAV. Convert if needed using ffmpeg. Ask the user for the transcript of the reference audio.

### 3. Run the Command

Run the appropriate binary using the full paths to the binaries and model directories. On Linux, prefix with `LD_LIBRARY_PATH={baseDir}/scripts/libtorch/lib:$LD_LIBRARY_PATH`.

### Example: Clone by Speaker Name

If the user says "Say hello world in Trump's voice":

```bash
# Read the transcript
REF_TEXT=$(cat {baseDir}/scripts/reference_audio/trump.txt)

# Run voice clone with ICL mode
{baseDir}/scripts/voice_clone \
  {baseDir}/scripts/models/Qwen3-TTS-12Hz-0.6B-Base \
  {baseDir}/scripts/reference_audio/trump.wav \
  "Hello world" \
  english \
  "$REF_TEXT"
```

### 4. Return the Output

The output WAV file will be in the current working directory:
- `tts` produces `output.wav`
- `voice_clone` produces `output_voice_clone.wav`

Inform the user of the output file path.

讨论

基于 GitHub Discussions。登录 GitHub 即可参与讨论、点赞、订阅更新。