Utau

From Wikipedia, the free encyclopedia

Template:Short description Script error: No such module "For".

Page Module:Message box/ambox.css has no content.

Template:DMCA

Page Module:Infobox/styles.css has no content.

UTAU
[[Programmer|Original authorTemplate:Pluralize from text]]Ameya/Ayame
[[Programmer|DeveloperTemplate:Pluralize from text]]Ameya/Ayame
Initial releaseMarch 2008; 18 years ago (2008-03)
Template:Infobox software/simple
Written inVisual Basic 6.0[1]
EnginePage Template:Plainlist/styles.css has no content.
Template:EditAtWikidata
Operating systemWindows 2000 / XP / Vista / 7 / 8 / 10 / 11
Mac OS X
PlatformWindows, Mac OS X
Available inJapanese and English (and other languages via patch files)
TypeMusical Synthesizer Application
(Music sequencer)
LicenseShareware (by donations)
Websitehttp://utau2008.xrea.jp/
https://utau-synth.com/
RepositoryPage Template:Plainlist/styles.css has no content.

Script error: No such module "Check for conflicting parameters".

UTAU is a Japanese singing synthesizer application created by Ameya/Ayame (Script error: No such module "Lang".). This program is similar to the Vocaloid software, with the difference being it is shareware instead of under a third party licensing.

Overview

In March 2008, Ameya/Ayame released UTAU, a free, advanced support tool shareware software that was downloadable from its main website. UTAU (Script error: No such module "Lang".), literally meaning 'to sing' in Japanese, has its origin in the activity of Script error: No such module "Nihongo"., where people edit an existing vocal track, extract phonemes, adjust pitch, and reassemble them to create a Vocaloid-esque singing voice. UTAU was originally created to assist this process using concatenative synthesis. UTAU is able to use WAV files provided by the user, so that a singing voice can be synthesized by introducing song lyrics and melody. UTAU came with AQUEST's voice synthesizer "AquesTalk" for synthesizing the voice samples of the default voicebank, Utane Uta (also nicknamed Script error: No such module "Lang"., meaning 'Default Girl' in Japanese) on its initial launch, after which the generator deletes itself. Voices made for the UTAU program are officially called "UTAU" as well, though they are colloquially known as "UTAUloids", a reference to VOCALOID. They are also called "voicebanks" (more common in English-speaking areas) and "(voice) libraries" in Japan. A myriad of voicebanks have been developed by independent users. These voicebanks are normally distributed directly from their creators via internet download, but some are sold as part of commercial projects.

UTAU is mostly a Japanese program and thus many of its voices are created specifically for the Japanese language. However, as users are able to make their own voicebanks, the userbase has devised methods to allow voicebanks to sing in languages other than Japanese. The X-SAMPA format is often used for Italian or other non-Japanese voicebanks, however other phonetic systems are sometimes used, such as ARPABET and any number of custom phonetic systems.[2]

UTAU's project files are saved under the ".ust" (Utau Sequence Text) extension. These files can be freely distributed, allowing different UTAU to sing the same piece. Producers have developed several methods of producing their sound banks and results for the voicebanks vary because of this.[3] UTAU does not support MIDI format and .vsq format.

Ameya/Ayame added support for Unicode in an unreleased newer version of UTAU as per the screenshots posted on Twitter. The corresponding backend support tail fixed region as well as several other audio encodings has already been released, while frontend support is yet to be released as of September 2022. Ameya also updated UTAU to be compatible with 64-bit systems.

Configuration

The editor is capable of placing notes, entering phonemes, and changing pitch and volume on a piano roll. Only one track can be created in UTAU, and notes cannot be placed on top of each other. Because a human cannot say two different things at the same time, this is also true for a Utauloid. By default, only notes are displayed on the piano roll, but display settings can be changed to show the pitch curve, volume intensity, envelope, and flags. UTAU uses flags to change aspects of the voice, such as with low-pass and high-pass filters, and reducing or adding breathiness. These flags differ depending on the resampler used. Score information and data in the voicebank is processed with a resampler and wavtool based on the score created with the editor. Only one resampler can be utilized in a single .ust file. A formant filter is used to control changes in voice quality, which can be turned off.

The audio file to be loaded in is found by matching the symbols on the note with the audio file name in the voice library. However, a prefix.map file can change which subfolder the sample is taken from. The pitch of the synthesized voice is adjusted according to the difference between the original sound file and the pitch of the note in the editor. UTAU uses formant filters to prevent extreme changes in voice quality, which can be disabled. Batch processing is used to generate multiple notes at once. Cache files are created during this process. Depending on the resampler, the amount of cache files may increase. There are settings in the menu to delete cache files when the program is closed, or after a certain period of time.

There are built-in plugins which can automatically merge vowels, and the "Omakase/A la carte" settings which can add automatic pitch and vibrato to an entire file. Other plugins created by users can also be added into the software. The colors of the editor can also be changed in the setting.ini file.

Voices

As mentioned above, WAV files can be ported into UTAU. There can be hundreds, or in some cases, thousands, of these files in a single voicebank. Voices are installed by either placing them in the "voice" folder or dragging and dropping them onto the UTAU icon. These libraries also come with an oto.ini file which determines the timing and configuration of each sample. When outputting audio from the score data in the editor, the program uses the oto.ini to set timing and pronunciation. Oto.ini files can be created using UTAU's GUI, or in third-party software made by users, the most notable of these third party programs being SetParam. Frequency tables (.frq files) are used to process the waveform when changing the pitch in the editor. Some resamplers use other file types instead of .frq. The voices may also come with image files most commonly being the .bmp format and standalone voice dialogues as some Vocaloids do. They also often include readme files which contain software information and terms of use. Character information files, commonly seen as character.txt, are also often included, which hold information that can be viewed in the "Voice preview" section of the GUI which labels the voicebank author, the name, a sample file to be played on click of the "sample" button, and the Voicebank image. It can also contain other parameters specified by the creator, such as "genre".

Some voicebanks are monosyllabic, collectively referred to as "CV" (consonant-vowel), whereas others use triphones to produce a smoother sound. [3] These triphonetic voicebanks are collectively referred to as "VCV" (vowel-consonant-vowel). These take considerably more time and effort to make (being about seven times the size of a CV voicebank, in terms of lines in the oto.ini file), but produce a more natural result.

Later UTAU voices would include phonemes composed of vowels+consonants (VC) to accommodate languages other than Japanese. Methods that employ this include "CVVC" (in which a VC phoneme is placed between two CV phonemes), or a sister method "VCCV", which is based on CVVC, but contains a few differences (differentiation between aspirated and unaspirated VCs, consonant cluster support, etc.). "VCCV" is named the way it is to differentiate itself from its creator's past CVVC lists. Two rarer voice recording methods are CVC, where one phoneme consists of a consonant-vowel-consonant and is split up in the program by using the oto.ini, and a method called Script error: No such module "Lang". (Script error: No such module "Lang".), in which a series of CV syllables are recorded in multiple wav files in order to create a smoother result without resorting to full VCV.

Since the audio files are independent files, they can be used in other software such as a DAW.

Development

The development of UTAU started when Ameya began to use Audacity to recombine samples of other singers, and Melodyne to pitch correct the samples and set them to music. The act of doing this was referred to as "human-powered VOCALOID". LOLI.COM, a musician who posted his own rap music to Nico Nico Douga, used his own voice for human-powered Vocaloid and released an audio editing software which could help users do the same. Since the process of doing "human-powered VOCALOID" by hand took a substantial amount of time and effort, Ameya began to develop a new tool which would aid the process.

The tool was announced on Nico Nico Douga on 11 January 2008. At that time, it was possible to adjust the timing of the sound, change the envelope of a note, and generate batch files. On 5 February 2008, a video was released showing the GUI. Here, it was possible to time stretch samples, create oto.ini files, and adjust the pitch bends of notes.[4] On 5 March 2008, a video explaining the program's specifications was released on Nico Nico Douga,[5] and on 15 March 2008, the tool was renamed UTAU.

The creator was a programmer by trade and not a specialist in vocal synthesis, but used previous knowledge to create UTAU. After its release, Ameya continued to improve UTAU, and started developing it in collaboration with other text-to-speech developers.[6]

In June 2008, Ameya rejected the label of Script error: No such module "Nihongo". for UTAU, calling it singing voice synthesis software instead.[7]

A Mac version called UTAU-Synth was released in 2011.

Since UTAU can create a singing voice using any WAV files, it is possible to take the voice of an existing person and use it as data. Often, actors, singers, and celebrities will have clips of their voices re-purposed for use in UTAU. The creator, Ameya, once created a voice using data from a voice actor's CD.

In May 2008, Ameya decided to stop using audio data without permission for the time being, unless the voice actor allowed it.[8]

Cultural impact

File:Dance Delightful (feat. Adachi Rei).webm Though the software is very popular in Japan, its origins and cultural impact are owed to the already established popularity of the Vocaloid software. UTAU itself was first made famous when the creator of Kasane Teto released the character, posing as a real Vocaloid as part of an April Fool's joke in 2008. The influence of the Vocaloid software also led to both programs commonly being used side by side. Often popular UTAU mascots like Kasane Teto appear in VOCALOID-based media such as Maker Hikōshiki Hatsune Mix or Hatsune Miku: Project DIVA.

Later, the UTAU software would have its own impact on Vocaloid and other vocal synthesizers, with a number of vocals either referencing UTAU or being produced for the engine to begin with. For example, Megurine Luka V4x was influenced by the UTAU vocal Gahata Meiji.[9] Wataru Sasaki, planning and development producer from Crypton Future Media, also spoke to someone very familiar with UTAU and said that the conversation was "very interesting".[10] Macne Nana of the Macne series later would become both a UTAU voice and a Vocaloid voice. The voice provider of English Vocaloid Ruby, Misha, had previously produced a Japanese-language UTAU named Makune Hachi (Script error: No such module "Lang".). In addition, the vocalist for Dex, Kenji-B, created Script error: No such module "Nihongo". for UTAU, and AkiGlancy, the vocalist behind Dex's partner Daina, gave her voice to the UTAU Script error: No such module "Nihongo".. Kikuko Inoue, the voice actress of Macne Coco White and Black (Script error: No such module "Lang".) (see Macne series) went on to voice a Vocaloid5 product by the name of Haruno Sora (Script error: No such module "Lang".). The product came with two voicebanks, Natural and Cool.[11] After the release of Vocaloid 3 vocal Tohoku Zunko, her two sisters Tohoku Itako and Tohoku Kiritan received UTAU vocals.[12] Kiritan would later hold a crowdfunding campaign for her to become a Voiceroid.[13] As well as its influence on Vocaloid, UTAU has served as a development launchpad for other commercial singing voice synthesizers. The most notable of these is Dreamtonics' Synthesizer V, which sprung from the development of the UTAU resampler known as Moresampler, both of which were developed by Kanru Hua.[14][15][16]

Its main attraction is not only based on it being freely distributed on the internet, but because it allowed a user to insert their own voice into the database for use for music, opening the doors for users to further develop their own music. UTAU owes its growing popularity to its ability to provide a free method of creating voices for music use and has established numerous music producers working with the software on sites such as Niconico and YouTube. Users also see it as an alternative to the Vocaloid software, which offers a more limited supply of voices at a high price and may not offer the voice types they are seeking for their music, as the large database of voices often have a much greater chance of offering the voice they seek. However, despite the number of voicebanks offered, the software has overall far fewer producers working with it than Vocaloid.[17]

A radio station set up a 1-hour program containing nothing but Vocaloid and UTAU-based music.[18]

In addition, an event called The UTAU M@STER was held regularly from 19 July 2012 onwards. The event was the main gathering of groups or circles and was held in a similar fashion to the Vocaloid-related event, THE VOC@LOID M@STER, which had existed since 2007.[19]

Unlike Vocaloid, UTAU files are not restrictive as it is not a proprietary based license. Therefore, it is possible to use open-source license products with the UTAU software, such as those produced for the Script error: No such module "Nihongo"., released for the programs Reason 4 and GarageBand. These products were sold by Act2 and by converting their file format, were able to also work with the UTAU program.[20] Later, the Macne packages Whisper☆Angel Sasayaki, Macne Nana 2S and Macne Petit 2S came with pre-built UTAU voicebanks.

The default voicebank "Defoko" (Utane Uta) borrows her voice from the software AquesTalk, specifically the voice "AquesTalk Female-1" produced by A-quest. Permission had been granted for her free distribution with the software.[21] Utane Koe, Uta's sister, also borrows her voice from the AquesTalk software. Namine Ritsu (Script error: No such module "Lang".), a voicebank originally built for UTAU, was also later added to another piece of software called Sinsy as "Namine Ritsu S". Another voicebank originally developed for the UTAU software, Yamine Renri (Script error: No such module "Lang".), was also later added to Synthesizer V. The popular UTAU character Kasane Teto was released as a Synthesizer V AI voice database on 27 April 2023.[22]

Due to the software's own copyright agreement, non-open license software such as VOCALOID are not permitted to be imported into the UTAU software.[23] A number of plug-ins for the software have also been developed by users of the software which add and enhance the vocals of the software. The software program Sugarcape, based on the same freeware intention as UTAU, has already entered beta stage.[24] There was an official Mac version of UTAU released on 27 May 2011, named UTAU-Synth.[25] It has approximately the same features as the Windows version. UTAU-Synth version can import both voices and songs made with the Windows version, but its project files and voicebank configurations are not fully compatible with the Windows version. In late 2017 it was mentioned that Plogue Art et Technologie, Inc. had a working redirect adaptation that would make UTAU vocals appear in its engine Alter/Ego.[26]

OpenUTAU is an unofficial open-source successor to UTAU developed by Vocaloid producer StAkira, with a beta released in November 2021. The software was designed to be compatible with UTAU but with a modern user experience. Unlike UTAU, it does not require a Japanese system locale to function properly.[27]

Usage in music

The first ever UTAU original song to be released was "Kenka Wakare"[28] (Japanese:"けんか別れ"; English: "Fighting and Breaking up") by nwp8861, who was also responsible for "Song of the Eared Robot"[29] sung by Kasane Teto. The song Kenka Wakare was released on Nico Nico Douga on May 10th, 2008 featuring the voicebank Utane Uta[30]; a revised version was released three days later on May 13th, 2008.

The licensed songs from the album Graduation from Lie, featuring Kasane Teto, were released for music downloads from Karen-T, under Crypton Future Media, as a special release. This is the first licensed release of any UTAU.[31]

The voice library Momo Momone is used in the viral YouTube video "Nyan Cat". It is a cover of "Nyanyanyanyanyanyanya!", a song originally composed by daniwellP and using the VOCALOID Hatsune Miku.[32]

See also

References

Page Template:Reflist/styles.css has no content.

  1. ^ Page Module:Citation/CS1/styles.css has no content."歌声合成ツールUTΑU ダウンロードページ" [Singing voice synthesis tool UTAU download page] (in 日本語). Retrieved 31 October 2025. VisualBasic6.0ランタイム [Visual Basic 6.0 Runtime]
  2. ^ Page Module:Citation/CS1/styles.css has no content."Phoneme Chart". ARPAsing. Retrieved 6 April 2024.
  3. ^ a b Page Module:Citation/CS1/styles.css has no content.""Continuous Sound" Recording: UTAU Upgrades Realism – Vocaloidism". Vocaloidism. Archived from the original on 27 March 2012. Retrieved 27 April 2016.
  4. ^ Page Module:Citation/CS1/styles.css has no content."自作ツールを使ってテキスト読み上げソフトに「片道キャッチボール」を". Niconico. 5 February 2008. Retrieved 29 June 2021.
  5. ^ Page Module:Citation/CS1/styles.css has no content."人力ボーカロイド支援ツールらしきものを作ってみた その1 導入編". Niconico. 6 March 2008.
  6. ^ Page Module:Citation/CS1/styles.css has no content."あなたの声で歌うソフト「UTAU」の奇妙な世界". ASCII.jp. Retrieved 29 June 2021.
  7. ^ Page Module:Citation/CS1/styles.css has no content.""真の人力Vocaloid"とは". UTΑUについて. Retrieved 29 June 2021.
  8. ^ Page Module:Citation/CS1/styles.css has no content.Ameya. "テト声の調整に本腰が入った理由 (Why I got serious about adjusting the Teto voice)". Retrieved 31 July 2021.
  9. ^ Page Module:Citation/CS1/styles.css has no content."crypton_wat". Twitter. Retrieved 27 April 2016.
  10. ^ Page Module:Citation/CS1/styles.css has no content."crypton_wat". Twitter. Retrieved 29 April 2016.
  11. ^ Page Module:Citation/CS1/styles.css has no content."井上喜久子のVOCALOID、VOICEROIDがついに登場! 新VOCALOID5に対応! 「VOCALOID 桜乃そら」「VOICEROID2 桜乃そら」 2018年7月26日発売". ahsoft.com. AH-Software. Retrieved 29 June 2021.
  12. ^ Page Module:Citation/CS1/styles.css has no content."東北イタコ、きりたんのUTAU音源". Archived from the original on 24 June 2020. Retrieved 27 April 2016.
  13. ^ Page Module:Citation/CS1/styles.css has no content."クラウド出版". Retrieved 27 April 2016.
  14. ^ Page Module:Citation/CS1/styles.css has no content.Hua, Kanru (23 September 2022), libllsm2, retrieved 3 October 2022
  15. ^ Page Module:Citation/CS1/styles.css has no content."libllsm2 Release – Kanru Hua's Website". 8 October 2018. Archived from the original on 8 October 2018. Retrieved 3 October 2022.
  16. ^ Page Module:Citation/CS1/styles.css has no content."Moresampler – Kanru Hua's Website". 8 October 2018. Archived from the original on 8 October 2018. Retrieved 3 October 2022.
  17. ^ Page Module:Citation/CS1/styles.css has no content."How Big Is The Japanese Vocaloid Community?". Archived from the original on 13 December 2010.
  18. ^ Page Module:Citation/CS1/styles.css has no content."NHK の本気!ボカロラジオ「エレうた」の高き志" [NHK's Determination! High Aspirations with Vocaloid Radio "Ere Uta"] (in 日本語). ASCII Media Works. 5 February 2011. Retrieved 25 February 2011.
  19. ^ Page Module:Citation/CS1/styles.css has no content."「THE UTAU M@STER」UTAU only event". Retrieved 27 April 2016.
  20. ^ Page Module:Citation/CS1/styles.css has no content."Mac音ナナ シリーズ" [Macne Nana Series] (in 日本語). Act2. Archived from the original on 11 May 2011. Retrieved 9 July 2010.
  21. ^ Page Module:Citation/CS1/styles.css has no content."音声合成ライブラリ製品の紹介 - 株式会社アクエスト". Retrieved 27 April 2016.
  22. ^ Page Module:Citation/CS1/styles.css has no content."Synthesizer V AI 重音テト". 2 April 2023. Archived from the original on 3 April 2023. Retrieved 4 April 2023.
  23. ^ Page Module:Citation/CS1/styles.css has no content."Controversy Concerns/POCALOID and illegal modifications". Vocaloid Wiki. Retrieved 1 September 2019.
  24. ^ Page Module:Citation/CS1/styles.css has no content."Macで動くボーカルシンセを作る". Archived from the original on 20 February 2020. Retrieved 27 April 2016.
  25. ^ Page Module:Citation/CS1/styles.css has no content."UTAU for Mac: UTAU-Synth". Vocaloidism. Archived from the original on 27 March 2012. Retrieved 27 April 2016.
  26. ^ Page Module:Citation/CS1/styles.css has no content."@chipspeech 5:19 p.m.—Nov 10, 2017 Tweet". Twitter. Retrieved 1 December 2017.
  27. ^ Page Module:Citation/CS1/styles.css has no content."What is OpenUTAU?". STUDIO OGIEN. 16 November 2021. Archived from the original on 16 November 2021. Retrieved 25 February 2022.
  28. ^ Page Module:Citation/CS1/styles.css has no content."【UTAU】Tried to sing an original song【Kenka Wakare (Fighting and Breaking Up)】". 13 May 2008.
  29. ^ Page Module:Citation/CS1/styles.css has no content."【UTAU】Song of the Eared Robot (Original)【Kasane Teto】". 10 June 2008.
  30. ^ Page Module:Citation/CS1/styles.css has no content."Utane Uta/Defoko UTAU Wiki page".
  31. ^ Page Module:Citation/CS1/styles.css has no content."Kasane Teto "Graduation from Lie"" (in 日本語). Crypton Future Media. Retrieved 2 October 2010.
  32. ^ Page Module:Citation/CS1/styles.css has no content."[Miku Hatsune] Nyanyanyanyanyanyanya! [Original Loop] (the name of the nico nico vid) you can see that in the title stands "Miku Hatsune", which is referring to miku". 25 July 2010.

Lua error in package.lua at line 80: module 'Module:Navbox/configuration' not found.

Retrieved from "http://cosmopedia.co/index.php?title=Utau&oldid=9016003"