calibre friday preview releases - Page 6

kovidgoyal · 09-06-2024, 12:46 PM

This should take care of it:
https://github.com/kovidgoyal/calibr...d9760f8d60a963

Let me know how it goes for you.

Comfy.n · 09-06-2024, 12:59 PM

yes, that fixed it

thiago.eec · 09-06-2024, 02:00 PM

Hi, Kovid

Thanks for the new TTS engine. I was having the same problems as @Comfy.n. Now they are fixed.

I noticed another glitch: every other sentence, the last word is not being highlighted. I couldn't find a pattern. Also the Piper voices are not available in my Content Server (using Chrome). I can see Chrome voices and Windows, but not Piper.

Now, two questions:

1) I don't see how I can manage Piper voices data. I mean, how can I delete a voice, if I don't like it?
2) This is not something new, but I just remembered it. Would be possible to have an option to automatically choose the TTS language based on the <dc:language> element for EPUBs (and the equivalent for other formats)?

kovidgoyal · 09-06-2024, 02:18 PM

The content server cant use piper, it can only use whatever voices are available on the device the browser is running on. Piper is *very* CPU intensive I don't think its appropriate to expose it via the server as doing so could lead to the server being DOSed very easily. Just two people using it at the same time would saturate the CPU of most servers.

If a sentence is too long it is split up that is probably the cause of your last word not being selected, this is done so that audio starts playing asap.

1) There is no UI for it, but you can just go in to the calibre cache directory and delete the piper folder or the voice .onnx files inside it, they have proper filenames.

2) The voice is chosen based on calibre UI language not book language. I'm not really a fan of having the voice changed automatically based on book language, but maybe an option for it. SOmeday if I am bored, or a patch is welcome.

thiago.eec · 09-06-2024, 04:50 PM

Quote:

Originally Posted by kovidgoyal

Piper is *very* CPU intensive I don't think its appropriate to expose it via the server as doing so could lead to the server being DOSed very easily. Just two people using it at the same time would saturate the CPU of most servers.

I was monitoring the CPU activity and that's what I saw: there is a peak in CPU usage during about 10-20 seconds (in my case, piper.exe was using 50% of my CPU), then it drops to 0% and stays there. Anytime you click on a new paragraph, pause, or make any configuration change, the peak happens again, but after that it always seat at 0%. Is that expected or maybe the peak repeat itself after sometime (something related to the cache size)?

Quote:

Originally Posted by kovidgoyal

If a sentence is too long it is split up that is probably the cause of your last word not being selected, this is done so that audio starts playing asap.

The weird part is that it is always the last word, never more. It happens even with quite small sentences (10 words or so).

Quote:

Originally Posted by kovidgoyal

1) There is no UI for it, but you can just go in to the calibre cache directory and delete the piper folder or the voice .onnx files inside it, they have proper filenames.

I think it would be good if there was a button to clear a downloaded voice.

Quote:

Originally Posted by kovidgoyal

2) The voice is chosen based on calibre UI language not book language. I'm not really a fan of having the voice changed automatically based on book language, but maybe an option for it. SOmeday if I am bored, or a patch is welcome.

Yes, an option on the dropdown menu would be the best approach, so it is not forced on anyone. I hope you get bored soon enough.

kovidgoyal · 09-06-2024, 11:25 PM

CPU usage will spike when speech starts, that is when the text is being synthesized into audio, the synthesis happens faster than the actual speech (otherwise you would get pauses after every sentence), so once all the text for the current file is synthesized it will idle again.

I cannot reproduce the last word not being highlighted from sentences. If its happening on a particular book open a bug report and attach the book.

Added a button to download/remove voices: https://github.com/kovidgoyal/calibr...1aacbba0a7f8e0

thiago.eec · 09-07-2024, 12:30 PM

Quote:

Originally Posted by kovidgoyal

Added a button to download/remove voices: https://github.com/kovidgoyal/calibr...1aacbba0a7f8e0

kovidgoyal · 09-20-2024, 12:24 AM

Released version 7.18.100 this halves the time the viewer takes to open an EPUB book for the first time (the preparing book for reading thing). It opens a 400K word book for the first time in one second on my laptop. Havent tested non linux OSes yet as am travelling but I expect the improvement to be even better on windows.

Comfy.n · 09-20-2024, 12:51 AM

Wow, indeed I notice the viewer significantly faster on Windows. What a pleasant surprise, thank you!

I have to do more tests tomorrow since I have some env vars in place that might be unneeded after this update, like "sandbox" and "gpu" disabled.

theducks · 09-20-2024, 01:24 AM

Wow, the viewer rock now.

BetterRed · 09-20-2024, 01:44 AM

Much faster on Windows 10

And a big thanks to chaley for this ==>> https://github.com/kovidgoyal/calibr...6b891f27966e5c

BR

DNSB · 09-20-2024, 01:57 AM

On my Windows 11 computer running from source, 7.18.100 broke the Modify ePub plugin when using it's Smarten Punctuation option. I found the issue was with importing from chardet.py. I posted in the Modify ePub plugin thread about the issue and my hack and slash fix. ) <message #1765>

kovidgoyal · 09-20-2024, 02:10 AM

Quote:

Originally Posted by DNSB

On my Windows 11 computer running from source, 7.18.100 broke the Modify ePub plugin when using it's Smarten Punctuation option. I found the issue was with importing from chardet.py. I posted in the Modify ePub plugin thread about the issue and my hack and slash fix. ) <message #1765>

https://github.com/kovidgoyal/calibr...dfe6fd56d2500f

beedaddy · 09-20-2024, 02:45 AM

It's also significantly faster on Linux (tested on Fedora 40).

DNSB · 09-20-2024, 02:52 AM

Quote:

Originally Posted by kovidgoyal

https://github.com/kovidgoyal/calibr...dfe6fd56d2500f

Sadly, you corrected a typo from the old chardet.py. It was originally substitute_entites and was corrected to substitute_entities.

I copied the line and "corrected" the typo and looks happy now.

Code:

substitute_entities = xml_replace_entities  # for plugins that might use this
substitute_entites = xml_replace_entities  # for plugins that might use this

09-06-2024, 11:25 PM	#81
kovidgoyal creator of calibre Posts: 44,556 Karma: 24495948 Join Date: Oct 2006 Location: Mumbai, India Device: Various	CPU usage will spike when speech starts, that is when the text is being synthesized into audio, the synthesis happens faster than the actual speech (otherwise you would get pauses after every sentence), so once all the text for the current file is synthesized it will idle again. I cannot reproduce the last word not being highlighted from sentences. If its happening on a particular book open a bug report and attach the book. Added a button to download/remove voices: https://github.com/kovidgoyal/calibr...1aacbba0a7f8e0 Last edited by kovidgoyal; 09-07-2024 at 12:45 AM.

09-20-2024, 12:24 AM	#83
kovidgoyal creator of calibre Posts: 44,556 Karma: 24495948 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Released version 7.18.100 this halves the time the viewer takes to open an EPUB book for the first time (the preparing book for reading thing). It opens a 400K word book for the first time in one second on my laptop. Havent tested non linux OSes yet as am travelling but I expect the improvement to be even better on windows. Last edited by kovidgoyal; 09-20-2024 at 12:53 AM.

09-20-2024, 01:57 AM	#87
DNSB Bibliophagist Posts: 40,555 Karma: 157444380 Join Date: Jul 2010 Location: Vancouver Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos	On my Windows 11 computer running from source, 7.18.100 broke the Modify ePub plugin when using it's Smarten Punctuation option. I found the issue was with importing from chardet.py. I posted in the Modify ePub plugin thread about the issue and my hack and slash fix. ) <message #1765> Last edited by DNSB; 09-20-2024 at 01:59 AM. Reason: Added Modify ePub plugin thread message #

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Dockerise multiple Calibre releases for plugin development	wolf123	Related Tools	1	02-06-2021 04:12 AM
[Q] How can I check for new releases in a series in calibre or goodreads?	lambstone	Kobo Reader	1	09-09-2016 01:04 AM
CC B4.0.X beta (all releases)	chaley	Calibre Companion	41	07-21-2015 07:53 AM
CC beta releases 3.4.4j, 3.4.4k, 3.4.4l	chaley	Calibre Companion	33	10-21-2014 07:19 AM
dotReader releases first public beta	Alexander Turcic	Reading and Management	4	11-23-2006 02:40 AM

09-06-2024, 12:46 PM	#76
kovidgoyal creator of calibre Posts: 44,556 Karma: 24495948 Join Date: Oct 2006 Location: Mumbai, India Device: Various	This should take care of it: https://github.com/kovidgoyal/calibr...d9760f8d60a963 Let me know how it goes for you.

09-06-2024, 12:59 PM	#77
Comfy.n want to learn what I want Posts: 1,269 Karma: 6433040 Join Date: Sep 2020 Device: Calibre E-book viewer	yes, that fixed it

09-06-2024, 02:00 PM	#78
thiago.eec Wizard Posts: 1,086 Karma: 1221485 Join Date: Dec 2016 Location: Goiânia - Brazil Device: iPad, Kindle Paperwhite	Hi, Kovid Thanks for the new TTS engine. I was having the same problems as @Comfy.n. Now they are fixed. I noticed another glitch: every other sentence, the last word is not being highlighted. I couldn't find a pattern. Also the Piper voices are not available in my Content Server (using Chrome). I can see Chrome voices and Windows, but not Piper. Now, two questions: 1) I don't see how I can manage Piper voices data. I mean, how can I delete a voice, if I don't like it? 2) This is not something new, but I just remembered it. Would be possible to have an option to automatically choose the TTS language based on the <dc:language> element for EPUBs (and the equivalent for other formats)?

09-06-2024, 02:18 PM	#79
kovidgoyal creator of calibre Posts: 44,556 Karma: 24495948 Join Date: Oct 2006 Location: Mumbai, India Device: Various	The content server cant use piper, it can only use whatever voices are available on the device the browser is running on. Piper is very CPU intensive I don't think its appropriate to expose it via the server as doing so could lead to the server being DOSed very easily. Just two people using it at the same time would saturate the CPU of most servers. If a sentence is too long it is split up that is probably the cause of your last word not being selected, this is done so that audio starts playing asap. 1) There is no UI for it, but you can just go in to the calibre cache directory and delete the piper folder or the voice .onnx files inside it, they have proper filenames. 2) The voice is chosen based on calibre UI language not book language. I'm not really a fan of having the voice changed automatically based on book language, but maybe an option for it. SOmeday if I am bored, or a patch is welcome.

09-20-2024, 12:51 AM	#84
Comfy.n want to learn what I want Posts: 1,269 Karma: 6433040 Join Date: Sep 2020 Device: Calibre E-book viewer	Wow, indeed I notice the viewer significantly faster on Windows. What a pleasant surprise, thank you! I have to do more tests tomorrow since I have some env vars in place that might be unneeded after this update, like "sandbox" and "gpu" disabled.

09-20-2024, 01:24 AM	#85
theducks Well trained by Cats Posts: 30,448 Karma: 58055868 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	Wow, the viewer rock now.

09-20-2024, 01:44 AM	#86
BetterRed null operator (he/him) Posts: 21,003 Karma: 27620706 Join Date: Mar 2012 Location: Sydney Australia Device: none	Much faster on Windows 10 And a big thanks to chaley for this ==>> https://github.com/kovidgoyal/calibr...6b891f27966e5c BR

09-20-2024, 02:45 AM	#89
beedaddy Groupie Posts: 183 Karma: 131606 Join Date: Oct 2011 Location: Germany (south-west) Device: Kobo Libra 2 & Clara 2E, Tolino shine 5th Gen	It's also significantly faster on Linux (tested on Fedora 40).

Advert

Advert