Overhauled the speech-to-text system to run faster and mistake background noise for speech less frequently
Changed the default speech-to-text model to Moonshine, a fast model with high accuracy
Players can now interrupt NPCs using their mic
Added ability to select a separate vision LLM from the LLM that provides an NPC's response
Added option to narrate contextual updates from LLMs
Reworked narration parsing to better seperate spoken NPC responses from contextual updates
Improved lip sync generation times by using Bethesda's new lip generation tools
The Mantella window is now noisy! Error sounds will play to let you know if something goes wrong, an (optional) startup sound will play when Mantella is ready, and an (optional) coughing sound will play whenever mic input cannot be correctly processed
Have you ever thought that this is a user error and not the fault of the ingenious mod creators giving you something most people only dream of? Just a thought.
I also had this crash as well. But I solved it by adding "Mantella v0.13 - MGO Patch" from here. Someone in previous discussion mentioned that MinAI mod cuases lot of trouble after update Mantella to v13. So I tried it myself and it seem to be working fine.
The same thing happened to me, but it didn't fix it.Neither deleting MantellaSubtitles.dll nor installing Mantella v0.13, and I don't have the fus ro doh either. I think I'll go back to the previous version.
Hello, I recently reinstalled Skyrim and now I'm getting an skse error everytime I try to start a mantella conversation. Where did I mess up? The error message I got in-game was Received skse_http error.
Hi, thank you so much for this awesome mod. I'm using Mantella with Skyrim 1.5.97, and everything works perfectly: the voice is generated, heard, lips move, etc.However, the SKSE_HTTP.dll plugin automatically interrupts the conversation with the error skse_http error, even when I add auto_end_dialogue = false to config.ini. This completely prevents the player from taking a turn responding.
When I disable the plugin, there are no errors, but the player's turn is not triggered either. Is there a way to allow the full flow without automatically cutting off? Perhaps ignore the wait for a response or extend the timeout?
I'm having this issue on the Eldergleam modlist, in case that's related.
Thanks for your time and for this very promising project.
I installed this mod, and it completely broke my game and other mods. I have uninstalled everything then reinstall vanilla skyrim but it causes crashing everytime. So my game is unplayble for now.
1643 comments
Features
- Up to real-time conversations with NPCs: https://youtu.be/OiPZpqoLs4E?si=nhVBDPiMzI1yolrn
- A custom actions framework (https://github.com/Leidtier/MantellaBrawl/tree/main) allows modders to add custom NPC actions
- Overhauled the speech-to-text system to run faster and mistake background noise for speech less frequently
- Changed the default speech-to-text model to Moonshine, a fast model with high accuracy
- Players can now interrupt NPCs using their mic
- Added ability to select a separate vision LLM from the LLM that provides an NPC's response
- Added option to narrate contextual updates from LLMs
- Reworked narration parsing to better seperate spoken NPC responses from contextual updates
- Improved lip sync generation times by using Bethesda's new lip generation tools
- The Mantella window is now noisy! Error sounds will play to let you know if something goes wrong, an (optional) startup sound will play when Mantella is ready, and an (optional) coughing sound will play whenever mic input cannot be correctly processed
- Added support for non-Latin alphabet languages
FixesFor the full list of fixes and quality of life improvements added since v0.12, see here:
https://github.com/art-from-the-machine/Mantella/releases
https://github.com/art-from-the-machine/Mantella-Spell/releases
I see nothing in any troubleshooting section anywhere on this topic.
Consider this worthless mod permanently uninstalled!
For me it just crashes whenever it tries to output audio, everything else works just fine.
Anyone had something like this? If so, managed to fix it?
Changing to xVASynth made me hear a tiny bit of voice before it crashes again. How unfortunate...
Crash handler blames Mantella and nothing else. I don't use fus ro doh.
PROBABLE CALL STACK:
[ 0] 0x7FF8A3C91318 MantellaSubtitles.dll+0031318
[ 1] 0x7FF8A3C7CA60 MantellaSubtitles.dll+001CA60
[ 2] 0x7FF768B34B15 SkyrimVR.exe+03A4B15 -> 24985+0x7955 mov ebp, eax
[ 3] 0x7FF768B35236 SkyrimVR.exe+03A5236 -> 24985+0x8076 nop
[ 4] 0x7FF768B32761 SkyrimVR.exe+03A2761 -> 24985+0x55A1 nop
[ 5] 0x7FF768D0335B SkyrimVR.exe+057335B -> 34413+0x38B mov rbx, [rsp+0x38]
[ 6] 0x7FF768DFDF56 SkyrimVR.exe+066DF56 -> 38568+0x8386 mov rax, [rbx+0x10]
[ 7] 0x7FF768DFDC7C SkyrimVR.exe+066DC7C -> 38568+0x80AC mov rbx, [rbp-0x20]
[ 8] 0x7FF768DDDBDF SkyrimVR.exe+064DBDF -> 38198+0x28F jmp 0x00007FF768DDDD85
[ 9] 0x7FF768DF7E2E SkyrimVR.exe+0667E2E -> 38568+0x225E jmp 0x00007FF768DF7E55
[10] 0x7FF768DF8ACA SkyrimVR.exe+0668ACA -> 38568+0x2EFA test sil, sil
[11] 0x7FF768DDA7F8 SkyrimVR.exe+064A7F8 -> 38141+0x548 jmp 0x00007FF768DDB3CF
[12] 0x7FF768D6F3BF SkyrimVR.exe+05DF3BF -> 36349+0x74F mov rcx, [0x00007FF76A715108]
[13] 0x7FF768E92A92 SkyrimVR.exe+0702A92 -> 40330+0x2762 mov rcx, rbx
[14] 0x7FF768E984FE SkyrimVR.exe+07084FE -> 40396+0x29FE add rsp, 0x28
[15] 0x7FF769407B75 SkyrimVR.exe+0C77B75 -> 67855+0x8775 mov ecx, [rbx+0x0C]
[16] 0x7FF769408020 SkyrimVR.exe+0C78020 -> 67855+0x8C20 mov r14d, eax
[17] 0x7FF769407859 SkyrimVR.exe+0C77859 -> 67855+0x8459 cmp byte ptr [0x00007FF76A655E78], 0x00
[18] 0x7FF768DD91DF SkyrimVR.exe+06491DF -> 38079+0x93F mov rcx, rbx
[19] 0x7FF769407B75 SkyrimVR.exe+0C77B75 -> 67855+0x8775 mov ecx, [rbx+0x0C]
[20] 0x7FF769409E1A SkyrimVR.exe+0C79E1A -> 67855+0xAA1A mov ebp, eax
[21] 0x7FF7693D84ED SkyrimVR.exe+0C484ED -> 66989+0x5D6D mov rcx, [0x00007FF76B853AA8]
[22] 0x7FF8FA14257D KERNEL32.DLL+001257D
[23] 0x7FF8FB4AAA58 ntdll.dll+005AA58
I don't use Fus Ro Doh or any of the modpacks, my stuff is all custom.
So that's odd.
Maybe that fix should be pushed into main, but then again I have no clue.
Thanks!
When I disable the plugin, there are no errors, but the player's turn is not triggered either. Is there a way to allow the full flow without automatically cutting off? Perhaps ignore the wait for a response or extend the timeout?
I'm having this issue on the Eldergleam modlist, in case that's related.
Thanks for your time and for this very promising project.