[Conversion Output] KePub Output Plugin

[Flip35]

Originally Posted by 7hir7een

I unknowingly updated this plugin and now all of my kepub conversions are failing. Is there any way the previous version could be posted for download?

I found it on jgoguen github page.

[jgoguen]

Version 3.6.9 should be offered by calibre within the next hour or so to fix this ��

[liquidsgi]

This plugin for me is broken. I accidentally installed the version 3.6.9 and all of my Kobo conversions are now broken. Here is the traceback- I am on 7.16.0 Calibre on Sonoma 14.5.

2024-08-02 20:47:35 [ERROR] Failed converting!
Traceback (most recent call last):
File "calibre_plugins.kepubout.conversion.kepub_output" , line 191, in convert
common.modify_epub(
File "calibre_plugins.kepubout.common", line 238, in modify_epub
container.convert()
File "calibre_plugins.kepubout.container", line 398, in convert
self.__run_async_over_content(self.add_kobo_spans)
File "calibre_plugins.kepubout.container", line 394, in __run_async_over_content
self.__run_async(func, names)
File "calibre_plugins.kepubout.container", line 381, in __run_async
raise e
File "calibre_plugins.kepubout.container", line 377, in __run_async
name = future.result(timeout=60)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "concurrent/futures/_base.py", line 449, in result
File "concurrent/futures/_base.py", line 401, in __get_result
File "concurrent/futures/thread.py", line 58, in run
File "calibre_plugins.kepubout.container", line 523, in add_kobo_spans
self._add_kobo_spans_to_node(body, name)
File "calibre_plugins.kepubout.container", line 589, in _add_kobo_spans_to_node
node.append(self._add_kobo_spans_to_node(child, name))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "calibre_plugins.kepubout.container", line 539, in _add_kobo_spans_to_node
special_tag_match = re.search(r"^(?:\{[^\}]+\})?(\w+)$", node.tag)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "re/__init__.py", line 176, in search
TypeError: expected string or bytes-like object, got '_cython_3_0_10.cython_function_or_method'

Traceback (most recent call last):
File "runpy.py", line 198, in _run_module_as_main
File "runpy.py", line 88, in _run_code
File "site.py", line 42, in <module>
File "site.py", line 38, in main
File "calibre/utils/ipc/worker.py", line 215, in main
File "calibre/gui2/convert/gui_conversion.py", line 38, in gui_convert_override
File "calibre/gui2/convert/gui_conversion.py", line 25, in gui_convert
File "calibre/ebooks/conversion/plumber.py", line 1307, in run
File "calibre_plugins.kepubout.conversion.kepub_output" , line 191, in convert
File "calibre_plugins.kepubout.common", line 238, in modify_epub
File "calibre_plugins.kepubout.container", line 398, in convert
File "calibre_plugins.kepubout.container", line 394, in __run_async_over_content
File "calibre_plugins.kepubout.container", line 381, in __run_async
File "calibre_plugins.kepubout.container", line 377, in __run_async
File "concurrent/futures/_base.py", line 449, in result
File "concurrent/futures/_base.py", line 401, in __get_result
File "concurrent/futures/thread.py", line 58, in run
File "calibre_plugins.kepubout.container", line 523, in add_kobo_spans
File "calibre_plugins.kepubout.container", line 589, in _add_kobo_spans_to_node
File "calibre_plugins.kepubout.container", line 539, in _add_kobo_spans_to_node
File "re/__init__.py", line 176, in search
TypeError: expected string or bytes-like object, got '_cython_3_0_10.cython_function_or_method'

[repilo]

Since I updated the plugin the kepub conversion fails. The "normal" epub doesn't fail me, but it fails in the complicated ones with a lot of jpg and footnotes.
Thank God I found the old version (I don't know where you can see the version number) that appears in post #556 and now everything works again.
Here are the first few lines (out of more than 9000) of the Calibre error report log in case it helps:

Spoiler:

calibre, version 7.16.0 (win32, embedded-python: True)
Error de conversión: Fallo: Convertido el libro 1 de 1 (xxx)

Convertido el libro 1 de 1 (xxx)
DeDRM v7.2.1: Trying to decrypt gb8qipc3.epub
DeDRM v7.2.1: Verifying zip archive integrity
DeDRM v7.2.1: “gb8qipc3.epub” is neither an Adobe Adept nor a Barnes & Noble encrypted ePub
Running file type plugin DeDRM failed with traceback:
Traceback (most recent call last):
File "calibre\customize\ui.py", line 199, in _run_filetype_plugins
File "calibre_plugins.dedrm.__init__", line 644, in run
File "calibre_plugins.dedrm.__init__", line 420, in ePubDecrypt
calibre_plugins.dedrm.DeDRMError: DeDRM v7.2.1: Couldn't decrypt after 0.5 seconds. DRM free perhaps?
Conversion options changed from defaults:
epub_version: '2'
verbose: 2
embed_font_family: 'Charter ITC Std boldh1v2'
read_metadata_from_opf: 'C:\\Users\\cactu\\AppData\\Local\\Temp\\calibre_y kyzbui0\\jrot5wdg.opf'
cover: 'C:\\Users\\cactu\\AppData\\Local\\Temp\\calibre_y kyzbui0\\om4x7ja9.jpeg'
remove_fake_margins: False
output_profile: 'kobo'
disable_font_rescaling: True
Resolved conversion options
calibre version: 7.16.0
{'add_alt_text_to_img': False,
'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0.0,
'book_producer': None,
'change_justification': 'original',
'chapter': "//*[((name()='h1' or name()='h2') and re:test(., "
"'\\s*((chapter|book|section|part)\\s+)|((prolog|p rologue|epilogue)(\\s+|$))', "
"'i')) or @class = 'chapter']",
'chapter_mark': 'pagebreak',
'comments': None,
'cover': 'C:\\Users\\cactu\\AppData\\Local\\Temp\\calibre_y kyzbui0\\om4x7ja9.jpeg',

[jgoguen]

Originally Posted by liquidsgi

This plugin for me is broken. I accidentally installed the version 3.6.9 and all of my Kobo conversions are now broken. Here is the traceback- I am on 7.16.0 Calibre on Sonoma 14.5.

I'm not able to reproduce this, but I also don't have a Mac to try it on. Please open a bug on GitHub and attach a full calibre debug log so I can try to dig in more. Based on what I can see, the error seems to be claiming that the string constant is actually a function... which makes no sense at all. When creating the debug log, do the minimum steps necessary to reproduce the bug.

Originally Posted by repilo

Since I updated the plugin the kepub conversion fails. The "normal" epub doesn't fail me, but it fails in the complicated ones with a lot of jpg and footnotes.
Thank God I found the old version (I don't know where you can see the version number) that appears in post #556 and now everything works again.
Here are the first few lines (out of more than 9000) of the Calibre error report log in case it helps:

There's nothing at all useful in these lines. Please open a bug on GitHub, providing as much information as possible, and include or attach a full calibre debug log. When creating the debug log, do only the minimum steps necessary to reproduce the bug. If it only happens with specific books, make sure to include a scrambled epub.

[repilo]

Originally Posted by jgoguen

When creating the debug log, do only the minimum steps necessary to reproduce the bug. If it only happens with specific books, make sure to include a scrambled epub.

OK, I've found the problem.
The problem is with comments of the type:

<!-- COMMENT -->

in the html. If I remove them all, the conversion doesn't give any error.
I attach a minimal file so you can test it.

[DNSB]

Originally Posted by repilo

OK, I've found the problem.
The problem is with comments of the type:

<!-- COMMENT -->

in the html. If I remove them all, the conversion doesn't give any error.
I attach a minimal file so you can test it.

Fails happily here on my Windows 11 system with either the Kepub Output plugin or the KoboTouchExtended driver.

[JSWolf]

Originally Posted by DNSB

Fails happily here on my Windows 11 system with either the Kepub Output plugin or the KoboTouchExtended driver.

Does Kepubify work with the comment?

[DNSB]

Originally Posted by JSWolf

Does Kepubify work with the comment?

Yes but so do the 3.6.7 versions of Kepub Output and KoboTouchExtended.

[JSWolf]

Originally Posted by DNSB

Yes but so do the 3.6.7 versions of Kepub Output and KoboTouchExtended.

Do you think we should go back to 3.6.7 as the official versions until whatever is wrong is fixed?

[jgoguen]

Version 3.6.10 should be offered by calibre within the next hour. This was caused by etree not following their own documentation, which was merry fun trying to chase down. But now there's also a test file including comments.

[jgoguen]

Version 3.6.11 should be offered by calibre in the next hour or so. This fixes an error converting some file types (like PDF).

[jgoguen]

Version 3.7.0 has been posted and should be offered by calibre within the next hour. This release brings an improvement to Kobo span generation and overall presentation by Shiandow.

[jgoguen]

Version 3.7.2 is posted and should be offered by calibre within the next hour. This version attempts to fix highlighting with the new Kobo span generator, and should no longer add spaces around em-dashes during conversion.

[jsnell]

I just found a book with very weird behavior. The EPUB version loads with proper rendering. The converted KEPUB displays incorrectly (I tested on Libra 2 and Libra Colour).

Here's what seems to be happening. This code:

the band ‹span epub:type="pagebreak" id="page_46" role="doc-pagebreak" title="46"/>My Two Hands

is rendered on the Kobo as "the bandMy Two Hands" -- in other words, the space before the span tag is ignored. I can verify that this is not a font rendering artifact, the Kobo actually thinks "bandMy" is a single word. So for some reason, Kobo's kepub parser is ignoring the space before the span tag.

similarly, this code at the beginning of a section with small caps:

‹p class="para-sp"><span class="char-first"><span class="fv-smalLcaps">Whatever. One night, ‹/span></span›Susannah

is rendered as "WHATEVER. ONE NIGHT,Susannah" -- the small caps run into the normal caps with the space before the </span> tag removed.

I have no idea if this is the quirk of one epub or what, but I've never seen it before and wanted to report it in case there's something the kepub translator should be working around. Clearly this goes beyond a CSS style issue, I think it's a bug in Kobo's renderer?!