Show HN: Hurston-1 open source TTS that speak Southern American and Afro-English (huggingface.co)
Since 2021, I’ve been collecting fully consented voice data from over 20,000 people, 1M audio recordings, and over 1,800 hrs of audio captured to date. For this model, I used a small part of the data, 136 hrs, to finetune Maya1 and expand it’s capabilities.
Hurston-1 is a narrowband TTS model that focuses the output on telephone use because that is still where most of these voices will be heard. I’ve used it to support customers such as Amazon and Salesforce and generated over half-mill revenue with it. Now I’m open sourcing it to help unlock opportunities for others as well.
Limitations: this model doesn’t maintain the exact same voice across prompts and doesn’t support voice cloning. For many use cases, this is fine but maybe not so - if you’re creating podcasts.
This is the first release - I’m already working on the next version with improvements.
I would appreciate, if anyone is interested in this space, download the model from huggingface, check it out and let me know any feedback. Also, open to connecting with others in this space as well.
(I imagine that it has the errors and bad pronunciation of a tipical Latam person, that is different for example from the errors and bad pronunciation of a tipical Spanish person)
That said, my hunch is your Africa speicifc datasets might lossy, as entire regions of Africa are very linguistically diverse and someone who speaks Bambara and French will affect a different English accent than someone who speaks Maninka and English.
For example, right now if you say you want a Southern American accent, you might get a voice that is a Black person from Atlanta or Rural Georgia in future versions you will be able to specify Atlanta or rural, etc.. same with the regional African accents.
But tangentially related, for non-English languages of the African continent, the Gates Foundation are pledging some grants to improve AI access outside of English-speaking regions: https://news.bpdata.com/article/gates-foundation-pledges-1-b...
Despite being focused on English, your project could be of interest for their funding. It's probably worth reaching out to let them know about your work.
Food for thought.
I cannot speak to the other accents, but my experience has been that American south accents are really poorly represented in mainstream Speach-To-Text models. If your STT model is pointed at end users, this can cause quite a quality drift when looking at eval vs prod performance depending on who your user base is.
I am not sure what terms you have collected the speach data on, but I am sure there are lots of people working with voice models that would be very interested in this as an eval set.
Are you talking about the English of Africans in different parts of Africa? If so, are you including the voices of white and Mediterranean Africans?
I'm confused. As a black American with roots (going back a couple centuries) in the Ark-La-Tex, I would think our dialects would be covered under "Southern American," which makes me suspect that you were referring to me with all of those references to another continent.
We are calling out Southern American, and the regional African English (e.g. a person with a regional Nigerian (igbo) accent speaking english, or someone with a regional Kenya (Swahili) accent that is still speaking english). Those are all different but all represented well in this model.
Those were not a catch all for black americans.
I also have a demo phone line 678.940.8800 with a few of the voices
Is it likely that they are using a model like this? Or are they actually trying to voice clone the original and then translate to English? I'm not even sure if the few Spanish-accented English auto-dubs I've heard are the same voice or not.
(Actually, that reminds me of growing up in Italy, where for a long time all English movies were shown dubbed, not subtitled, and they had the same lead male voice for all male leads, and the same lead female voice for all female leads, across every movie. I can still hear those voices in my head now thirty years later...)