Catalog generation fails when title contains specific accented characters

riki · 08-13-2011, 01:43 PM

I have generated a catalog of ebooks quite a few times without problems, but after I added a book with an accented character in its title, the process always fails. I made a few tests, and it appears that not all accented characters cause problems - I've found the character "à" to be the culprit.

Here's what Calibre has to report about it.

Code:

calibre, version 0.8.14
ERROR: Conversion Error: <b>Failed</b>: Generate catalog

Generate catalog
 Sections: Authors, Titles, Series, Recently Added, Descriptions
Catalog_EPUB_MOBI(): Generating mobi for kindle in GUI environment
 connected_device: 'None'
 book count: 2
 opts:
  authorClip: 60
  catalog_title: u'My Booklist'
  connected_kindle: False
  descriptionClip: 100
  exclude_book_marker: u':'
  exclude_genre: u'(\\[.+\\])|(book_is_read)'
  exclude_tags: u'~,Catalog,book_check_before_adding'
  header_note_source_field: u'#imported_kindle_collections'
  merge_comments: ':before:True'
  output_profile: 'kindle'
  read_book_marker: u'tag:'
  search_text: None
  sort_by: None
  sort_descriptions_by_author: True
  sync: True
  thumb_width: '1.00'
  wishlist_tag: u'Wishlist'
 existing thumb cache at C:\Documents and Settings\User101\Application Data\calibre\caches\catalog\thumbs.zip, cached_thumb_width: 1.00"
 Begin catalog source generation
     DPI = 168; thumbnail dimensions: 84 x 112
Python function terminated unexpectedly
  'utf8' codec can't decode byte 0xc3 in position 16: unexpected end of data (Error Code: 1)
Traceback (most recent call last):
  File "site.py", line 132, in main
  File "site.py", line 109, in run_entry_point
  File "site-packages\calibre\utils\ipc\worker.py", line 181, in main
  File "site-packages\calibre\gui2\convert\gui_conversion.py", line 68, in gui_catalog
  File "site-packages\calibre\library\catalog.py", line 5110, in run
  File "site-packages\calibre\library\catalog.py", line 1420, in buildSources
  File "site-packages\calibre\library\catalog.py", line 1952, in generateHTMLByTitle
UnicodeDecodeError: 'utf8' codec can't decode byte 0xc3 in position 16: unexpected end of data

kovidgoyal · 08-13-2011, 01:59 PM

Fixed in next release. Though there may well be other bugs that show up on non utf-8 windows systems.

riki · 08-13-2011, 02:25 PM

A huge thank you, Kovid!
I must have been lucky - your replies were as quick as they get...

Manichean · 08-13-2011, 02:41 PM

Moderator Notice
Moved to correct subforum.

Quote:

Originally Posted by riki

I must have been lucky - your replies were as quick as they get...

Actually, that's pretty normal for him

subul15 · 08-23-2011, 03:57 PM

I am using the 8.14 version of calibre. Suddenly it is showing error in generating catalogs. It was working fine up until a few days but now suddenly it has stopped. Don't know what has gone wrong..can someone help me.

Manichean · 08-23-2011, 06:07 PM

Needs more detail. What's the error? What catalog format are you trying to create?

subul15 · 08-24-2011, 12:46 AM

Quote:

Originally Posted by Manichean

Needs more detail. What's the error? What catalog format are you trying to create?

I am getting the error when I try to create in epub or mobi format.

One correction .... I am using 0.8.15 version

This is the msg I am getting with the error..

"Generate catalog
Sections: Authors, Descriptions
Catalog_EPUB_MOBI(): Generating epub for sony in GUI environment
connected_device: 'None'
book count: 24
opts:
authorClip: 100
catalog_title: u'Elizabeth Thornton'
connected_kindle: False
descriptionClip: 380
exclude_book_marker: u':Book'
exclude_genre: u'\\[.+\\]'
exclude_tags: u'~,'
header_note_source_field: ''
merge_comments: '::True'
output_profile: 'sony'
read_book_marker: u'tag:+'
search_text: None
sort_by: None
sort_descriptions_by_author: True
sync: False
thumb_width: '1.00'
wishlist_tag: u'Wishlist'
Python function terminated unexpectedly
'utf8' codec can't decode byte 0xbc in position 45: invalid start byte (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 132, in main
File "site.py", line 109, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 181, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 68, in gui_catalog
File "site-packages\calibre\library\catalog.py", line 5099, in run
File "site-packages\calibre\library\catalog.py", line 1052, in __init__
File "site-packages\calibre\utils\zipfile.py", line 751, in __init__
File "site-packages\calibre\utils\zipfile.py", line 786, in _GetContents
File "site-packages\calibre\utils\zipfile.py", line 847, in _RealGetContents
File "site-packages\calibre\utils\zipfile.py", line 388, in _decodeFilename
File "encodings\utf_8.py", line 16, in decode
UnicodeDecodeError: 'utf8' codec can't decode byte 0xbc in position 45: invalid start byte"

kovidgoyal · 08-24-2011, 02:10 AM

That error indicates a corrupted catalog thumbnail cache. Open the calibre config dir and delete the file caches\catalog\thumbs.zip from it.

subul15 · 08-24-2011, 03:41 AM

Quote:

Originally Posted by kovidgoyal

That error indicates a corrupted catalog thumbnail cache. Open the calibre config dir and delete the file caches\catalog\thumbs.zip from it.

Thank you so much..

Phew!! It's working now...

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Title string in mobi format with accented characters	hiperlink	Recipes	9	02-09-2011 06:39 PM
Sorting with accented characters	chaley	Calibre	20	12-11-2010 08:14 AM
Accented characters on PRS-505	gandalfbp	Calibre	4	04-19-2010 08:48 AM
PRS-500 Accented characters onto reader using Mac	squiggle8	Sony Reader Dev Corner	9	12-06-2007 05:01 PM
Accented characters	bingle	Sony Reader	7	07-25-2007 07:36 AM

08-13-2011, 01:59 PM	#2
kovidgoyal creator of calibre Posts: 44,546 Karma: 24495948 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Fixed in next release. Though there may well be other bugs that show up on non utf-8 windows systems.

08-13-2011, 02:25 PM	#3
riki Member Posts: 17 Karma: 10 Join Date: Aug 2011 Device: kindle	A huge thank you, Kovid! I must have been lucky - your replies were as quick as they get...

08-23-2011, 03:57 PM	#5
subul15 Member Posts: 14 Karma: 10 Join Date: Aug 2009 Device: None	I am using the 8.14 version of calibre. Suddenly it is showing error in generating catalogs. It was working fine up until a few days but now suddenly it has stopped. Don't know what has gone wrong..can someone help me.

08-23-2011, 06:07 PM	#6
Manichean Wizard Posts: 3,130 Karma: 91256 Join Date: Feb 2008 Location: Germany Device: Cybook Gen3	Needs more detail. What's the error? What catalog format are you trying to create?

08-24-2011, 02:10 AM	#8
kovidgoyal creator of calibre Posts: 44,546 Karma: 24495948 Join Date: Oct 2006 Location: Mumbai, India Device: Various	That error indicates a corrupted catalog thumbnail cache. Open the calibre config dir and delete the file caches\catalog\thumbs.zip from it.

Advert

Advert