口播神器,基于Edge,微软TTS(text-to-speech)文字转语音免费开源库edge-tts实践(Python3.10)

这篇具有很好参考价值的文章主要介绍了口播神器,基于Edge,微软TTS(text-to-speech)文字转语音免费开源库edge-tts实践(Python3.10)。希望对大家有所帮助。如果存在错误或未考虑完全的地方,请大家不吝赐教,您也可以点击"举报违法"按钮提交疑问。

不能否认,微软Azure在TTS(text-to-speech文字转语音)这个人工智能细分领域的影响力是统治级的,一如ChatGPT在NLP领域的随心所欲,予取予求。君不见几乎所有的抖音营销号口播均采用微软的语音合成技术,其影响力由此可见一斑,仅有的白璧微瑕之处就是价格略高,虽然国内也可以使用科大讯飞语音合成进行平替,但我们只想要最好的那一个,本次我们使用免费的开源库edge-tts来实现文本转语音操作,薅微软edge的羊毛。

TTS文本转语音基础使用方式

首先安装edge-tts库:

pip3 install edge-tts

安装成功后,直接在终端运行edge-tts命令:

edge-tts
Downloads edge-tts  
usage: edge-tts [-h] [-t TEXT] [-f FILE] [-v VOICE] [-l] [--rate RATE] [--volume VOLUME] [-O OVERLAPPING]  
                [--write-media WRITE_MEDIA] [--write-subtitles WRITE_SUBTITLES] [--proxy PROXY]

显示支持语音

edge-tts --list-voices
Name: af-ZA-AdriNeural  
Gender: Female  
  
Name: af-ZA-WillemNeural  
Gender: Male  
  
Name: am-ET-AmehaNeural  
Gender: Male  
  
Name: am-ET-MekdesNeural  
Gender: Female  
  
Name: ar-AE-FatimaNeural  
Gender: Female  
  
Name: ar-AE-HamdanNeural  
Gender: Male  
  
Name: ar-BH-AliNeural  
Gender: Male  
  
Name: ar-BH-LailaNeural  
Gender: Female  
  
Name: ar-DZ-AminaNeural  
Gender: Female  
  
Name: ar-DZ-IsmaelNeural  
Gender: Male  
  
Name: ar-EG-SalmaNeural  
Gender: Female  
  
Name: ar-EG-ShakirNeural  
Gender: Male  
  
Name: ar-IQ-BasselNeural  
Gender: Male  
  
Name: ar-IQ-RanaNeural  
Gender: Female  
  
Name: ar-JO-SanaNeural  
Gender: Female  
  
Name: ar-JO-TaimNeural  
Gender: Male  
  
Name: ar-KW-FahedNeural  
Gender: Male  
  
Name: ar-KW-NouraNeural  
Gender: Female  
  
Name: ar-LB-LaylaNeural  
Gender: Female  
  
Name: ar-LB-RamiNeural  
Gender: Male  
  
Name: ar-LY-ImanNeural  
Gender: Female  
  
Name: ar-LY-OmarNeural  
Gender: Male  
  
Name: ar-MA-JamalNeural  
Gender: Male  
  
Name: ar-MA-MounaNeural  
Gender: Female  
  
Name: ar-OM-AbdullahNeural  
Gender: Male  
  
Name: ar-OM-AyshaNeural  
Gender: Female  
  
Name: ar-QA-AmalNeural  
Gender: Female  
  
Name: ar-QA-MoazNeural  
Gender: Male  
  
Name: ar-SA-HamedNeural  
Gender: Male  
  
Name: ar-SA-ZariyahNeural  
Gender: Female  
  
Name: ar-SY-AmanyNeural  
Gender: Female  
  
Name: ar-SY-LaithNeural  
Gender: Male  
  
Name: ar-TN-HediNeural  
Gender: Male  
  
Name: ar-TN-ReemNeural  
Gender: Female  
  
Name: ar-YE-MaryamNeural  
Gender: Female  
  
Name: ar-YE-SalehNeural  
Gender: Male  
  
Name: az-AZ-BabekNeural  
Gender: Male  
  
Name: az-AZ-BanuNeural  
Gender: Female  
  
Name: bg-BG-BorislavNeural  
Gender: Male  
  
Name: bg-BG-KalinaNeural  
Gender: Female  
  
Name: bn-BD-NabanitaNeural  
Gender: Female  
  
Name: bn-BD-PradeepNeural  
Gender: Male  
  
Name: bn-IN-BashkarNeural  
Gender: Male  
  
Name: bn-IN-TanishaaNeural  
Gender: Female  
  
Name: bs-BA-GoranNeural  
Gender: Male  
  
Name: bs-BA-VesnaNeural  
Gender: Female  
  
Name: ca-ES-EnricNeural  
Gender: Male  
  
Name: ca-ES-JoanaNeural  
Gender: Female  
  
Name: cs-CZ-AntoninNeural  
Gender: Male  
  
Name: cs-CZ-VlastaNeural  
Gender: Female  
  
Name: cy-GB-AledNeural  
Gender: Male  
  
Name: cy-GB-NiaNeural  
Gender: Female  
  
Name: da-DK-ChristelNeural  
Gender: Female  
  
Name: da-DK-JeppeNeural  
Gender: Male  
  
Name: de-AT-IngridNeural  
Gender: Female  
  
Name: de-AT-JonasNeural  
Gender: Male  
  
Name: de-CH-JanNeural  
Gender: Male  
  
Name: de-CH-LeniNeural  
Gender: Female  
  
Name: de-DE-AmalaNeural  
Gender: Female  
  
Name: de-DE-ConradNeural  
Gender: Male  
  
Name: de-DE-KatjaNeural  
Gender: Female  
  
Name: de-DE-KillianNeural  
Gender: Male  
  
Name: el-GR-AthinaNeural  
Gender: Female  
  
Name: el-GR-NestorasNeural  
Gender: Male  
  
Name: en-AU-NatashaNeural  
Gender: Female  
  
Name: en-AU-WilliamNeural  
Gender: Male  
  
Name: en-CA-ClaraNeural  
Gender: Female  
  
Name: en-CA-LiamNeural  
Gender: Male  
  
Name: en-GB-LibbyNeural  
Gender: Female  
  
Name: en-GB-MaisieNeural  
Gender: Female  
  
Name: en-GB-RyanNeural  
Gender: Male  
  
Name: en-GB-SoniaNeural  
Gender: Female  
  
Name: en-GB-ThomasNeural  
Gender: Male  
  
Name: en-HK-SamNeural  
Gender: Male  
  
Name: en-HK-YanNeural  
Gender: Female  
  
Name: en-IE-ConnorNeural  
Gender: Male  
  
Name: en-IE-EmilyNeural  
Gender: Female  
  
Name: en-IN-NeerjaExpressiveNeural  
Gender: Female  
  
Name: en-IN-NeerjaNeural  
Gender: Female  
  
Name: en-IN-PrabhatNeural  
Gender: Male  
  
Name: en-KE-AsiliaNeural  
Gender: Female  
  
Name: en-KE-ChilembaNeural  
Gender: Male  
  
Name: en-NG-AbeoNeural  
Gender: Male  
  
Name: en-NG-EzinneNeural  
Gender: Female  
  
Name: en-NZ-MitchellNeural  
Gender: Male  
  
Name: en-NZ-MollyNeural  
Gender: Female  
  
Name: en-PH-JamesNeural  
Gender: Male  
  
Name: en-PH-RosaNeural  
Gender: Female  
  
Name: en-SG-LunaNeural  
Gender: Female  
  
Name: en-SG-WayneNeural  
Gender: Male  
  
Name: en-TZ-ElimuNeural  
Gender: Male  
  
Name: en-TZ-ImaniNeural  
Gender: Female  
  
Name: en-US-AnaNeural  
Gender: Female  
  
Name: en-US-AriaNeural  
Gender: Female  
  
Name: en-US-ChristopherNeural  
Gender: Male  
  
Name: en-US-EricNeural  
Gender: Male  
  
Name: en-US-GuyNeural  
Gender: Male  
  
Name: en-US-JennyNeural  
Gender: Female  
  
Name: en-US-MichelleNeural  
Gender: Female  
  
Name: en-US-RogerNeural  
Gender: Male  
  
Name: en-US-SteffanNeural  
Gender: Male  
  
Name: en-ZA-LeahNeural  
Gender: Female  
  
Name: en-ZA-LukeNeural  
Gender: Male  
  
Name: es-AR-ElenaNeural  
Gender: Female  
  
Name: es-AR-TomasNeural  
Gender: Male  
  
Name: es-BO-MarceloNeural  
Gender: Male  
  
Name: es-BO-SofiaNeural  
Gender: Female  
  
Name: es-CL-CatalinaNeural  
Gender: Female  
  
Name: es-CL-LorenzoNeural  
Gender: Male  
  
Name: es-CO-GonzaloNeural  
Gender: Male  
  
Name: es-CO-SalomeNeural  
Gender: Female  
  
Name: es-CR-JuanNeural  
Gender: Male  
  
Name: es-CR-MariaNeural  
Gender: Female  
  
Name: es-CU-BelkysNeural  
Gender: Female  
  
Name: es-CU-ManuelNeural  
Gender: Male  
  
Name: es-DO-EmilioNeural  
Gender: Male  
  
Name: es-DO-RamonaNeural  
Gender: Female  
  
Name: es-EC-AndreaNeural  
Gender: Female  
  
Name: es-EC-LuisNeural  
Gender: Male  
  
Name: es-ES-AlvaroNeural  
Gender: Male  
  
Name: es-ES-ElviraNeural  
Gender: Female  
  
Name: es-ES-ManuelEsCUNeural  
Gender: Male  
  
Name: es-GQ-JavierNeural  
Gender: Male  
  
Name: es-GQ-TeresaNeural  
Gender: Female  
  
Name: es-GT-AndresNeural  
Gender: Male  
  
Name: es-GT-MartaNeural  
Gender: Female  
  
Name: es-HN-CarlosNeural  
Gender: Male  
  
Name: es-HN-KarlaNeural  
Gender: Female  
  
Name: es-MX-DaliaNeural  
Gender: Female  
  
Name: es-MX-JorgeNeural  
Gender: Male  
  
Name: es-MX-LorenzoEsCLNeural  
Gender: Male  
  
Name: es-NI-FedericoNeural  
Gender: Male  
  
Name: es-NI-YolandaNeural  
Gender: Female  
  
Name: es-PA-MargaritaNeural  
Gender: Female  
  
Name: es-PA-RobertoNeural  
Gender: Male  
  
Name: es-PE-AlexNeural  
Gender: Male  
  
Name: es-PE-CamilaNeural  
Gender: Female  
  
Name: es-PR-KarinaNeural  
Gender: Female  
  
Name: es-PR-VictorNeural  
Gender: Male  
  
Name: es-PY-MarioNeural  
Gender: Male  
  
Name: es-PY-TaniaNeural  
Gender: Female  
  
Name: es-SV-LorenaNeural  
Gender: Female  
  
Name: es-SV-RodrigoNeural  
Gender: Male  
  
Name: es-US-AlonsoNeural  
Gender: Male  
  
Name: es-US-PalomaNeural  
Gender: Female  
  
Name: es-UY-MateoNeural  
Gender: Male  
  
Name: es-UY-ValentinaNeural  
Gender: Female  
  
Name: es-VE-PaolaNeural  
Gender: Female  
  
Name: es-VE-SebastianNeural  
Gender: Male  
  
Name: et-EE-AnuNeural  
Gender: Female  
  
Name: et-EE-KertNeural  
Gender: Male  
  
Name: fa-IR-DilaraNeural  
Gender: Female  
  
Name: fa-IR-FaridNeural  
Gender: Male  
  
Name: fi-FI-HarriNeural  
Gender: Male  
  
Name: fi-FI-NooraNeural  
Gender: Female  
  
Name: fil-PH-AngeloNeural  
Gender: Male  
  
Name: fil-PH-BlessicaNeural  
Gender: Female  
  
Name: fr-BE-CharlineNeural  
Gender: Female  
  
Name: fr-BE-GerardNeural  
Gender: Male  
  
Name: fr-CA-AntoineNeural  
Gender: Male  
  
Name: fr-CA-JeanNeural  
Gender: Male  
  
Name: fr-CA-SylvieNeural  
Gender: Female  
  
Name: fr-CH-ArianeNeural  
Gender: Female  
  
Name: fr-CH-FabriceNeural  
Gender: Male  
  
Name: fr-FR-DeniseNeural  
Gender: Female  
  
Name: fr-FR-EloiseNeural  
Gender: Female  
  
Name: fr-FR-HenriNeural  
Gender: Male  
  
Name: ga-IE-ColmNeural  
Gender: Male  
  
Name: ga-IE-OrlaNeural  
Gender: Female  
  
Name: gl-ES-RoiNeural  
Gender: Male  
  
Name: gl-ES-SabelaNeural  
Gender: Female  
  
Name: gu-IN-DhwaniNeural  
Gender: Female  
  
Name: gu-IN-NiranjanNeural  
Gender: Male  
  
Name: he-IL-AvriNeural  
Gender: Male  
  
Name: he-IL-HilaNeural  
Gender: Female  
  
Name: hi-IN-MadhurNeural  
Gender: Male  
  
Name: hi-IN-SwaraNeural  
Gender: Female  
  
Name: hr-HR-GabrijelaNeural  
Gender: Female  
  
Name: hr-HR-SreckoNeural  
Gender: Male  
  
Name: hu-HU-NoemiNeural  
Gender: Female  
  
Name: hu-HU-TamasNeural  
Gender: Male  
  
Name: id-ID-ArdiNeural  
Gender: Male  
  
Name: id-ID-GadisNeural  
Gender: Female  
  
Name: is-IS-GudrunNeural  
Gender: Female  
  
Name: is-IS-GunnarNeural  
Gender: Male  
  
Name: it-IT-DiegoNeural  
Gender: Male  
  
Name: it-IT-ElsaNeural  
Gender: Female  
  
Name: it-IT-IsabellaNeural  
Gender: Female  
  
Name: ja-JP-KeitaNeural  
Gender: Male  
  
Name: ja-JP-NanamiNeural  
Gender: Female  
  
Name: jv-ID-DimasNeural  
Gender: Male  
  
Name: jv-ID-SitiNeural  
Gender: Female  
  
Name: ka-GE-EkaNeural  
Gender: Female  
  
Name: ka-GE-GiorgiNeural  
Gender: Male  
  
Name: kk-KZ-AigulNeural  
Gender: Female  
  
Name: kk-KZ-DauletNeural  
Gender: Male  
  
Name: km-KH-PisethNeural  
Gender: Male  
  
Name: km-KH-SreymomNeural  
Gender: Female  
  
Name: kn-IN-GaganNeural  
Gender: Male  
  
Name: kn-IN-SapnaNeural  
Gender: Female  
  
Name: ko-KR-InJoonNeural  
Gender: Male  
  
Name: ko-KR-SunHiNeural  
Gender: Female  
  
Name: lo-LA-ChanthavongNeural  
Gender: Male  
  
Name: lo-LA-KeomanyNeural  
Gender: Female  
  
Name: lt-LT-LeonasNeural  
Gender: Male  
  
Name: lt-LT-OnaNeural  
Gender: Female  
  
Name: lv-LV-EveritaNeural  
Gender: Female  
  
Name: lv-LV-NilsNeural  
Gender: Male  
  
Name: mk-MK-AleksandarNeural  
Gender: Male  
  
Name: mk-MK-MarijaNeural  
Gender: Female  
  
Name: ml-IN-MidhunNeural  
Gender: Male  
  
Name: ml-IN-SobhanaNeural  
Gender: Female  
  
Name: mn-MN-BataaNeural  
Gender: Male  
  
Name: mn-MN-YesuiNeural  
Gender: Female  
  
Name: mr-IN-AarohiNeural  
Gender: Female  
  
Name: mr-IN-ManoharNeural  
Gender: Male  
  
Name: ms-MY-OsmanNeural  
Gender: Male  
  
Name: ms-MY-YasminNeural  
Gender: Female  
  
Name: mt-MT-GraceNeural  
Gender: Female  
  
Name: mt-MT-JosephNeural  
Gender: Male  
  
Name: my-MM-NilarNeural  
Gender: Female  
  
Name: my-MM-ThihaNeural  
Gender: Male  
  
Name: nb-NO-FinnNeural  
Gender: Male  
  
Name: nb-NO-PernilleNeural  
Gender: Female  
  
Name: ne-NP-HemkalaNeural  
Gender: Female  
  
Name: ne-NP-SagarNeural  
Gender: Male  
  
Name: nl-BE-ArnaudNeural  
Gender: Male  
  
Name: nl-BE-DenaNeural  
Gender: Female  
  
Name: nl-NL-ColetteNeural  
Gender: Female  
  
Name: nl-NL-FennaNeural  
Gender: Female  
  
Name: nl-NL-MaartenNeural  
Gender: Male  
  
Name: pl-PL-MarekNeural  
Gender: Male  
  
Name: pl-PL-ZofiaNeural  
Gender: Female  
  
Name: ps-AF-GulNawazNeural  
Gender: Male  
  
Name: ps-AF-LatifaNeural  
Gender: Female  
  
Name: pt-BR-AntonioNeural  
Gender: Male  
  
Name: pt-BR-FranciscaNeural  
Gender: Female  
  
Name: pt-PT-DuarteNeural  
Gender: Male  
  
Name: pt-PT-RaquelNeural  
Gender: Female  
  
Name: ro-RO-AlinaNeural  
Gender: Female  
  
Name: ro-RO-EmilNeural  
Gender: Male  
  
Name: ru-RU-DmitryNeural  
Gender: Male  
  
Name: ru-RU-SvetlanaNeural  
Gender: Female  
  
Name: si-LK-SameeraNeural  
Gender: Male  
  
Name: si-LK-ThiliniNeural  
Gender: Female  
  
Name: sk-SK-LukasNeural  
Gender: Male  
  
Name: sk-SK-ViktoriaNeural  
Gender: Female  
  
Name: sl-SI-PetraNeural  
Gender: Female  
  
Name: sl-SI-RokNeural  
Gender: Male  
  
Name: so-SO-MuuseNeural  
Gender: Male  
  
Name: so-SO-UbaxNeural  
Gender: Female  
  
Name: sq-AL-AnilaNeural  
Gender: Female  
  
Name: sq-AL-IlirNeural  
Gender: Male  
  
Name: sr-RS-NicholasNeural  
Gender: Male  
  
Name: sr-RS-SophieNeural  
Gender: Female  
  
Name: su-ID-JajangNeural  
Gender: Male  
  
Name: su-ID-TutiNeural  
Gender: Female  
  
Name: sv-SE-MattiasNeural  
Gender: Male  
  
Name: sv-SE-SofieNeural  
Gender: Female  
  
Name: sw-KE-RafikiNeural  
Gender: Male  
  
Name: sw-KE-ZuriNeural  
Gender: Female  
  
Name: sw-TZ-DaudiNeural  
Gender: Male  
  
Name: sw-TZ-RehemaNeural  
Gender: Female  
  
Name: ta-IN-PallaviNeural  
Gender: Female  
  
Name: ta-IN-ValluvarNeural  
Gender: Male  
  
Name: ta-LK-KumarNeural  
Gender: Male  
  
Name: ta-LK-SaranyaNeural  
Gender: Female  
  
Name: ta-MY-KaniNeural  
Gender: Female  
  
Name: ta-MY-SuryaNeural  
Gender: Male  
  
Name: ta-SG-AnbuNeural  
Gender: Male  
  
Name: ta-SG-VenbaNeural  
Gender: Female  
  
Name: te-IN-MohanNeural  
Gender: Male  
  
Name: te-IN-ShrutiNeural  
Gender: Female  
  
Name: th-TH-NiwatNeural  
Gender: Male  
  
Name: th-TH-PremwadeeNeural  
Gender: Female  
  
Name: tr-TR-AhmetNeural  
Gender: Male  
  
Name: tr-TR-EmelNeural  
Gender: Female  
  
Name: uk-UA-OstapNeural  
Gender: Male  
  
Name: uk-UA-PolinaNeural  
Gender: Female  
  
Name: ur-IN-GulNeural  
Gender: Female  
  
Name: ur-IN-SalmanNeural  
Gender: Male  
  
Name: ur-PK-AsadNeural  
Gender: Male  
  
Name: ur-PK-UzmaNeural  
Gender: Female  
  
Name: uz-UZ-MadinaNeural  
Gender: Female  
  
Name: uz-UZ-SardorNeural  
Gender: Male  
  
Name: vi-VN-HoaiMyNeural  
Gender: Female  
  
Name: vi-VN-NamMinhNeural  
Gender: Male  
  
Name: zh-CN-XiaoxiaoNeural  
Gender: Female  
  
Name: zh-CN-XiaoyiNeural  
Gender: Female  
  
Name: zh-CN-YunjianNeural  
Gender: Male  
  
Name: zh-CN-YunxiNeural  
Gender: Male  
  
Name: zh-CN-YunxiaNeural  
Gender: Male  
  
Name: zh-CN-YunyangNeural  
Gender: Male  
  
Name: zh-CN-liaoning-XiaobeiNeural  
Gender: Female  
  
Name: zh-CN-shaanxi-XiaoniNeural  
Gender: Female  
  
Name: zh-HK-HiuGaaiNeural  
Gender: Female  
  
Name: zh-HK-HiuMaanNeural  
Gender: Female  
  
Name: zh-HK-WanLungNeural  
Gender: Male  
  
Name: zh-TW-HsiaoChenNeural  
Gender: Female  
  
Name: zh-TW-HsiaoYuNeural  
Gender: Female  
  
Name: zh-TW-YunJheNeural  
Gender: Male  
  
Name: zu-ZA-ThandoNeural  
Gender: Female  
  
Name: zu-ZA-ThembaNeural  
Gender: Male

一望而知,几乎支持所有主流的通用语,Gender字段为合成语音的性别,Male代表男性,Female代表女性,zh开头的就是中文语音角色,这里以微软的小伊为例子:

edge-tts --voice zh-CN-XiaoyiNeural --text "你好啊,我是智能语音助手" --write-media hello_in_cn.mp3

该命令含义是通过zh-CN-XiaoyiNeural角色合成语音:"你好啊,我是智能语音助手"的内容,随后将音频流写入hello_in_cn.mp3文件。

程序返回:

Downloads edge-tts --voice zh-CN-XiaoyiNeural --text "你好啊,我是智能语音助手" --write-media hello_in_cn.mp3  
WEBVTT  
  
00:00:00.100 --> 00:00:00.525  
你好  
  
00:00:00.525 --> 00:00:00.91200:00:01.050 --> 00:00:01.23800:00:01.238 --> 00:00:01.37500:00:01.387 --> 00:00:01.700  
智能  
  
00:00:01.700 --> 00:00:02.050  
语音  
  
00:00:02.062 --> 00:00:02.550  
助手

程序会自动将时间轴和语音文本匹配输出,如此一来,连字幕文件也有了,可谓是一举两得,一箭双雕。

与此同时,我们也可以调整合成语音的语速:

edge-tts --rate=-50% --voice zh-CN-XiaoyiNeural --text "你好啊,我是智能语音助手" --write-media hello_in_cn.mp3

–rate参数可以通过加号或者减号同步加快或者减慢合成语音的语速。

亦或者,调整合成语音的音量:

edge-tts --volume=-50%  --voice zh-CN-XiaoyiNeural --text "你好啊,我是智能语音助手" --write-media hello_in_cn.mp3

–volume参数可以调整语音的音量。

遗憾的是,和微软Azure官方的语音合成库相比,开源的语音合成库并不支持基于标记语言 (SSML)的语音调优,比如语调、情绪的调整,但这毕竟是免费的,要求也不能太高了。

Python脚本语音合成

除了通过命令进行语音合成,edge-tts也支持在Python脚本,编辑test.py文件:

import asyncio  
  
import edge_tts  
  
TEXT = "你好哟,我是智能语音助手,小伊"  
VOICE = "zh-CN-XiaoyiNeural"  
OUTPUT_FILE = "/Users/liuyue/Downloads/test.mp3"  
  
  
async def _main() -> None:  
    communicate = edge_tts.Communicate(TEXT, VOICE)  
    await communicate.save(OUTPUT_FILE)  
  
  
if __name__ == "__main__":  
    asyncio.run(_main())

这里我们直接通过异步模式调用communicate实例的save方法,就可以并发异步生成语音合成的音频文件,非常方便。

也可以通过语音管理库来自动寻找我们需要的语言:

import asyncio  
import random  
  
import edge_tts  
from edge_tts import VoicesManager  
  
TEXT = "中文语音测试"  
OUTPUT_FILE ="china.mp3"  
  
  
async def _main() -> None:  
    voices = await VoicesManager.create()  
    voice = voices.find(Gender="Female", Language="zh")  
  
    communicate = edge_tts.Communicate(TEXT, random.choice(voice)["Name"])  
    await communicate.save(OUTPUT_FILE)  
  
  
if __name__ == "__main__":  
    asyncio.run(_main())

这里通过内置的VoicesManager库来随机挑选中文语音角色完成语音合成操作。

除此之外,也可以通过脚本将语音流和字母同步进行生成:

import asyncio  
  
import edge_tts  
  
TEXT = "这里是语音流测试"  
VOICE = "zh-CN-XiaoyiNeural"  
OUTPUT_FILE = "test.mp3"  
WEBVTT_FILE = "test.vtt"  
  
  
async def _main() -> None:  
    communicate = edge_tts.Communicate(TEXT, VOICE)  
    submaker = edge_tts.SubMaker()  
    with open(OUTPUT_FILE, "wb") as file:  
        async for chunk in communicate.stream():  
            if chunk["type"] == "audio":  
                file.write(chunk["data"])  
            elif chunk["type"] == "WordBoundary":  
                submaker.create_sub((chunk["offset"], chunk["duration"]), chunk["text"])  
  
    with open(WEBVTT_FILE, "w", encoding="utf-8") as file:  
        file.write(submaker.generate_subs())  
  
  
if __name__ == "__main__":  
    asyncio.run(_main())

这里异步调用之后,音频会写入test.mp3,而字幕文件则会写入test.vtt。后续则可以通过ffmpeg将生成的字幕文件叠加到视频中即可,请参见:基于Python3(Autosub)以及Ffmpeg配合GoogleTranslation(谷歌翻译)为你的影片实现双语版字幕(逐字稿)

结语

开源语音合成edge-tts库可以提高语音合成效率,并且极大地降低了语音合成门槛,为自动化视频剪辑铺平了道路,未来结合基于Stable-Diffusion算法的AI绘图框架,人工智能AI一键式绘制、配音、上字幕的一条龙服务指日可待。

链接:https://www.jianshu.com/p/dd7ad5c1a778文章来源地址https://www.toymoban.com/news/detail-785931.html

到了这里,关于口播神器,基于Edge,微软TTS(text-to-speech)文字转语音免费开源库edge-tts实践(Python3.10)的文章就介绍完了。如果您还想了解更多内容,请在右上角搜索TOY模板网以前的文章或继续浏览下面的相关文章,希望大家以后多多支持TOY模板网!

本文来自互联网用户投稿,该文观点仅代表作者本人,不代表本站立场。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如若转载,请注明出处: 如若内容造成侵权/违法违规/事实不符,请点击违法举报进行投诉反馈,一经查实,立即删除!

领支付宝红包 赞助服务器费用

相关文章

  • 深度学习神经网络学习笔记-多模态方向-11-Deep Voice: Real-time Neural Text-to-Speech

    本文提出Deep Voice,一种完全由深度神经网络构建的生产质量文本到语音系统。Deep Voice为真正的端到端神经语音合成奠定了基础。该系统由五个主要的构建模块组成:用于定位音素边界的分割模型、字素到音素的转换模型、音素时长预测模型、基频预测模型和音频合成模型。对

    2024年02月06日
    浏览(48)
  • Edge-TTS:微软推出的,免费、开源、支持多种中文语音语色的AI工具

    项目地址:rany2/edge-tts: Use Microsoft Edge\\\'s online text-to-speech service from Python WITHOUT needing Microsoft Edge or Windows or an API key (github.com) Edge-TTS是由微软推出的文本转语音Python库,通过微软Azure Cognitive Services转化文本为自然语音。适合需要语音功能的开发者,GitHub上超3000星。作为国内付费

    2024年04月11日
    浏览(46)
  • ​Edge-TTS:微软推出的,免费、开源、支持多种中文语音语色的AI工具

    Edge-TTS是由微软推出的文本转语音Python库,通过微软Azure Cognitive Services转化文本为自然语音。适合需要语音功能的开发者,GitHub上超3000星。作为国内付费TTS服务的替代品,Edge-TTS支持40多种语言和300种声音,提供优质的语音输出,满足不同开发需求。 Edge-TTS 项目地址: https

    2024年04月26日
    浏览(40)
  • 论文阅读:VITS2: Improving Quality and Efficiency of Single-Stage Text-to-Speech with Adversarial

    论文标题是“ VITS2: Improving Quality and Efficiency of Single-Stage Text-to-Speech with Adversarial Learning and Architecture Design ”,写不下了,是2023.7.31原vits团队刚刚挂在arxiv上的文章,主要基于四个方面对vits做了改动,此篇文章我们就不讲vits,主要分析vits2的部分。 单阶段文本到语音模型最近

    2024年02月07日
    浏览(53)
  • pytong之语音环境:edge-tts and edge-playback

    系统平台:windows10 一、安装python3.x 二、安装edge-tts(文本转换为声音文件)         启动windows命令行(cmd),执行如下命令: 可能会因为网络的问题出现错误。用ping测试pypi.org是否通畅:ping pypi.org,会出现丢包。 安装成功后测试: 命令行测试: 编程代码测试: import subproc

    2024年02月13日
    浏览(44)
  • Python调用edge-tts实现在线文字转语音

    edge-tts是一个 Python 模块,允许通过Python代码或命令的方式使用 Microsoft Edge 的在线文本转语音服务。 GitHub - rany2/edge-tts: Use Microsoft Edge\\\'s online text-to-speech service from Python WITHOUT needing Microsoft Edge or Windows or an API key Use Microsoft Edge\\\'s online text-to-speech service from Python WITHOUT needing Micro

    2024年03月27日
    浏览(58)
  • 语音翻译项目(Whisper,opencc,Baidu翻译API,edge_tts)

    定制程序开发 heguannan @ 163.com 国内天生有墙,海外与国内的视频平台不连通,视频搬运业务应运而生。 通过国内的视频搬运到海外平台或者将海外平台视频搬运到国内,以获得平台的报酬。 当然,可以直接采用成熟的API直接做到 汉语语音-英语语音。然而,大多数API都要收费

    2024年02月12日
    浏览(38)
  • 微软Azure的TTS接口调用

    实习让我学会了很多orz 由于要做公司产品和微软产品的对比,故尝试写一个python代码调用微软Azure语音合成API来实现批处理功能。 要实现批处理功能首先得有一个Azure的账号,且要使用标准计费档,免费档是不能使用批处理功能的,它会返回forbidden,拒绝访问。 首先是引入的

    2024年02月06日
    浏览(56)
  • 微软语音合成(tts)服务申请和调用

    https://azure.microsoft.com/zh-cn/free/ 这里有个视频教程,根据此完成申请流程: https://www.bilibili.com/video/BV15a4y1W7re?vd_source=bf07f28d37849885d215dc3aea189eba 申请完成后,就可以到这里申请资源: https://portal.azure.com/#home 点击资源组,里面就有部署好的服务了 点击这里,可以获取 subscription

    2024年02月11日
    浏览(52)
  • TTS算法笔记:MusicLM- Generating Music From Text(AI生成音乐)

    摘要: 介绍了一个以文本作为条件,生成高保真、长时间片的音乐音频。比如文本为“由扭曲的吉他重复段伴奏的平静的小提琴旋律”,MusicLM可以可以根据文本条件,生成24kHz采样率,分钟级别的连续音乐音频。 从摘要中可以得知,这篇文章解决的根本问题其实可以非常简

    2024年02月12日
    浏览(53)

觉得文章有用就打赏一下文章作者

支付宝扫一扫打赏

博客赞助

微信扫一扫打赏

请作者喝杯咖啡吧~博客赞助

支付宝扫一扫领取红包,优惠每天领

二维码1

领取红包

二维码2

领红包