Games
My games
Your favourited games will be displayed here
Mods
Mod updates
Explore this month's nominated mods.
The elegant, powerful and open-source mod manager.
Collections
Learn from the community with tutorials and guides.
Images
Videos
Upgrade your account to unlock all media content.
Community
News
Support
Wiki
Vortex
Share your ideas, discuss them with the community, and cast your vote on feedback provided.
Oh dear! Something has gone wrong!
Try reloading the notifications.
No unread notifications right now
You're up to date
All games (3,301)
Recently added (41)
All mods
New
Trending
Most endorsed
Top files
Mod categories
Mods of the month
Recent activity
All collections
Recently added
Highest rated
Media
Latest
Forums
Support authors
All news
Site news
Competitions
Interviews
Help
Contact
Give feedback
FAQ
Game guides
Tutorial
Tools
Vortex help
API documentation
Install Vortex
To enjoy the benefits of Nexus Mods, please log in or register a new account
How to Create AI Voice for Skyrim - Part 1 - XVATrainer Tutorial
A complete guide on how to retrieve voices from Skyrim and how to train your model based on them is in the following video:https://www.youtube.com/watch?v=up3HXCYN1lA&t=785s[size=3]A short version goes as follows: [/size]To train your model you need two things:A dataset to train of and a model to be trained.[b] I) How to set up the XVATrainer Program: [/b]1. Download XVATrainer.2. Download v3 training data PART 1 and PART 2 from:https://www.nexusmods.com/skyrimspecialedition/mods/650223. Open the downloaded archives. Copy the xvapitch folder from them to [XVATrainer]/resources/app/python/(it is important otherwise the program will not work)4. Optionally download OpenAI Whisper Large (v2) Auto-Transcription model.Next your Model needs audio files and text interpretation to train of.[b] II) How to retrieve Skyrim voices from the game: [/b]1. Download and unpack Bethesda Archive Extractor (BSA and BA2):https://www.nexusmods.com/skyrimspecialedition/mods/9742. In your Skyrim folder find ./Data/Skyrim - Voices_en0.bsa (it can be Skyrim - Voices_ru0.bsa or any other language you want).3. Drag and drop [Skyrim - Voices_en0.bsa] to the opened Bethesda Archive Extractor (BSA and BA2).4. Exctract the desired voices to any folder on your PC (the exctracted files will be of .fuz type and that`s OK).5. Download and unpack Yakitori Audio Converter:https://www.nexusmods.com/skyrimspecialedition/mods/177656. Drag and drop your exctracted .fuz files into an opened Yakitori Audio Converter: window.7. Select (ignore lip) mode in the drop down menu on the bottom left. (lip is a lipsync file that comes compressed with .fuz file. Don`t worry, we`ll generate out own lipsync files in a different tutorial).8. Set Output format to be .wav.9. Convert the files to any location (you`ll have one .wav file from each .fuz file).[b] III) How to create a new Dataset: [/b]1. Open XVATrainer.2. Press on (+) button on the top left.3. Create a new Dataset: - Enter the name of the voice. - Game ID is the name of the game (Skyrim) - Game Code is a specified code of your game (sk for Skyrim, f4 for Fallout 4, OB for Oblivion). It is important for you to enter the correct code! - Enter the correct Gender! - Enter the correct Language Code! - Enter your name as Author.4. Click on Submit buttom.5. Click on the red button on the bottom (missing Metadata).6. Check that your entered before data is correct and click Submit.[b] IV) How to fil up your Dataset with audio examples: [/b]1. Click on Open button on the bottom (a new Folder appears).2. Open wav Folder.3. Drag and drop all the .wav files from step II) to this folder.[b] V) How to set the text interpretation for audio examples: [/b]1. In XVATrainer click on any line and write the text interpretation of the audio files which you can listen to.2. Don`t forget to press "SAVE" after each time you`ve edited a line or it will not be saved!You can also automatically Transcribe your audio files:3. Press on the Wrench button on the top right.4. Select Transcribe section in the menu on the left.5. Select your Transcribtion Model (the bigger it is - the more accurate it will be. But it is also slower)6. Select your Language.7. Click on Open input Directory button.8. Copy the .wav files from your dataset Folder to the newly opened transcribe\input folder.9. Click on Run toll button.10. Wait (it took me 1.5 hours to Transcribe 480 audio files with Whisper Medium model. And the result wasn`t ideal.)11. After the Transcription is over click on Open output Directory button.12. Drag and drop the metadata.csv from the newly opened transcribe\output folder to your Dataset Folder (replace the existing file).13. Restart XVATrainer (now you have a filled dataset with audio examples and interpretation). It is better to have as large of a dataset as possible for the best possible results. If your dataset is smaller than 100 examples you can dublicate files using the method that is shown on the video:https://www.youtube.com/watch?v=up3HXCYN1lA&t=785sThe minimum amout of audio examples for the model to train is 10!Also your interpritaion needs to be accurate! Otherwise the quality of your trained model will suffer![b] VI) How to fix your Dataset: [/b]1. Go through your Dataset and check transcription for accuracy and punctuation.2. Be sure to delete all grunts ad cries of pain from your dataset! Otherwise it will mess up the final result!(Just use DELETE function in the program over the selected line and it will delete an instance from the .wav file list and from the excel file as well!)After your Dataset if all nice and well it`s time to train it![b] VII) How to train your Dataset: [/b]1. Select your Dataset in XVATrainer.2. Press the Train button on the buttom.3. Insert the Output Path for the Model Chekpoints to be stored (might fill up some space).4.Select the right Voice Language in the dropdown menu!5. (Optionally you can change the number of CPU workers to slightly increase your training time by sucrifising the accuracy a bit).6. Click Accept.7. Select your model in the list on the left.8. Click on Start button.Training takes 3 stages. Each Stage is completed after 50 checkpoints. There is a Loss Threshold which determines whether the program will go to the next Stage or start over from the last result.After each Stage is completed a checkpoint file is created on your PC.If you exit the program you`ll need to start the training over!To continue the training after one of the Stages is over (and if the program has been closed):1. Select your Dataset in XVATrainer.2. Press the Train button on the buttom.3. Press the Config button of your model in the list of models-to-be-trained on the left.4. Change "xVAPitch Checkpoint path to fine-tune from (built in, or custom)" setting from BaseV3 to Custom.5. Click on the Folder button on the right of it.6. Select you LATEST chekpoint (.pt file).7. (Optionally) Check the ticker on Force Stage box and choose the next Stage to be forced.8. Click the Accept button.9. Click on Start button.It took me 1.5 days on my PC to train a Delphine Voice Model.Not once have I crossed the Threshold, however I was suttysfied with the result and will use it in the mods to come.To complete your training you need to complete all 3 Stages at least once.[b] VIII) How to Export your Model to XVASynth: [/b]1. Select you dataset in XVATrainer.2, Click on Export button on the buttom.3. Select the output Folder.4. Click on Export button.5. Open the file with exported model (there will be 3 files).6. Install XVASynth.7. Drop your model (3 files) to [xVASynth]\resources\app\models\skyrim Folder.8. Start XVASynth and wait for my next Tutorial :)
How to Make a Follower Mod Like Lucien Flavius - Part 0 - Setting Up - Skyrim Creation Kit Tutorials
Watch me live on Twitch: [url=https://www.twitch.tv/josephrusselluk]https://www.twitch.tv/josephrusselluk[/url]Buy Lonely Worlds, my latest novel: [url=https://amzn.to/2wd1Jfl]https://amzn.to/2wd1Jfl[/url]Check out my Patreon: [url=https://www.patreon.com/josephrussellauthor]https://www.patreon.com/josephrussellauthor[/url]The first part of my new Skyrim custom-voiced follower mod tutorial series, where I'll teach you how to make a follower mod of your own with all the bells and whistles Lucien has. In this episode, I'll talk you through all the hardware and software you're going to need.Bethesda Launcher:[url=https://bethesda.net/game/bethesda-launcher] https://bethesda.net/game/bethesda-launcher[/url]SSE Creation Kit Fixes: [url=https://www.nexusmods.com/skyrimspecialedition/mods/20061]https://www.nexusmods.com/skyrimspecialedition/mods/20061[/url]Creation Kit Multiple Masters Fix: [url=https://www.nexusmods.com/skyrimspecialedition/mods/2786]https://www.nexusmods.com/skyrimspecialedition/mods/2786[/url]SSEEdit: [url=https://www.nexusmods.com/skyrimspecialedition/mods/164]https://www.nexusmods.com/skyrimspecialedition/mods/164[/url]TES5Edit: [url=https://www.nexusmods.com/skyrim/mods/25859/]https://www.nexusmods.com/skyrim/mods/25859/[/url]Audacity: [url=https://www.audacityteam.org/]https://www.audacityteam.org/[/url]Yakitori Audio Converter: [url=https://www.nexusmods.com/skyrim/mods/73100]https://www.nexusmods.com/skyrim/mods/73100[/url]Lazy Voice Finder: [url=https://www.nexusmods.com/skyrim/mods/82482]https://www.nexusmods.com/skyrim/mods/82482[/url]Focusrite Scarlett Studio Solo Pack: [url=https://amzn.to/3eCTlXp]https://amzn.to/3eCTlXp[/url]Pop Filter: [url=https://amzn.to/2XkmHE9]https://amzn.to/2XkmHE9[/url]Microphone Stand: [url=https://amzn.to/3gCz06i]https://amzn.to/3gCz06i[/url]Shock Mount: [url=https://amzn.to/3gJDJDp]https://amzn.to/3gJDJDp[/url]Code for CreationKitCustom.ini on SE, or SkyrimEditorCustom.ini on LE:[General] bAllowMultipleMasterLoads=1[Grass]bAllowCreateGrass=1bAllowLoadGrass=0[Localization]iExtendedResponseLength=255bAllowExtendedText=1Chapters:0:00 - Intro0:23 - Lonely Worlds0:44 - Software0:51 - The Creation Kit2:00 - SE Creation Kit on Bethesda.net2:06 - SSE Creation Kit Fixes3:58 - LE Creation Kit on Steam4:09 - CreationKitCustom.ini tweaks5:40 - xEdit6:06 - Audacity6:17 - Yakitori Audio Converter6:34 - Lazy Voice Finder7:03 - Hardware1:40 - Microphone7:37 - Pop Filter7:51 - Shock Mount8:10 - Twitch Modding Workshops8:23 - Outro
Modding with Lucien - Recording Dialogue
[size=3]In this video, I walk through my process of recording dialogue for my custom-voiced follower mod for Skyrim, Lucien Flavius, from conditioning the lines in the Creation Kit to recording them in Cubase, editing them in Audacity, converting them for Skyrim and testing them in-game. Hope it's useful!If you enjoyed the video, please do like it and subscribe to [url=https://www.youtube.com/channel/UCZHJ-nU_UIBpFtfH0XRHZQQ]my channel[/url], and if you have the time, I'd really appreciate it if you could consider checking out my [url=https://www.patreon.com/josephrussellauthor]Patreon[/url] :) [/size]