Full-text indexing - .pdf.error?

ownedbycats · 10-22-2023, 07:48 PM

I was monitoring the Calibre temp folder during a reindex and noticed sometimes a PDF is copied for indexing, it's accompanied by a 0-byte '.pdf.error' file with the same randomized name. This doesn't happen with other filetypes. Does it mean indexing is failing for those books?

kovidgoyal · 10-22-2023, 09:54 PM

no as far as I know calibre doesnt create such a file, it might be coming from the pdftotext process calibre uses to extract the text from the PDF. See pdftotext() function in fts/text.py in the calibre source code. calibre assumes text extractionw as successful if that process exits with 0 exit code.

ownedbycats · 10-22-2023, 11:56 PM

Thanks.

Additionally, since it's related to this: Have you ever seen the full-text index database corrupt? It happened sometime in the last few days but only came up when I was trying to run a search.

kovidgoyal · 10-23-2023, 12:02 AM

No, cant say that I have.

ownedbycats · 10-23-2023, 12:36 AM

Ah, I thought a specific sequence of deleting files, adding a few file, then restoring the format from the trash might've screwed something up - I can't replicate it a second time though. I notice the newly-reindexed database is at least 250mb smaller, so maybe it was just in dire need of a vacuum.

10-22-2023, 07:48 PM	#1
ownedbycats Custom User Title Posts: 8,734 Karma: 62032183 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Full-text indexing - .pdf.error? I was monitoring the Calibre temp folder during a reindex and noticed sometimes a PDF is copied for indexing, it's accompanied by a 0-byte '.pdf.error' file with the same randomized name. This doesn't happen with other filetypes. Does it mean indexing is failing for those books?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Epub to PDF - All Superscripts are Full-Size Text?	Blaineoreski	Conversion	2	05-04-2023 03:29 AM
Full-text search not really full-text	secasa	Library Management	5	10-01-2022 10:11 PM
Re-indexing full text search	jesscat	Calibre	2	08-11-2022 07:55 AM
Forcing indexing to skip a block of text?	andyb	Sigil	15	05-03-2017 08:19 PM
Best practice to convert PDF to simple flowing text? Calibre error	avid01	PDF	6	03-31-2017 03:47 AM

10-22-2023, 09:54 PM	#2
kovidgoyal creator of calibre Posts: 43,934 Karma: 22669822 Join Date: Oct 2006 Location: Mumbai, India Device: Various	no as far as I know calibre doesnt create such a file, it might be coming from the pdftotext process calibre uses to extract the text from the PDF. See pdftotext() function in fts/text.py in the calibre source code. calibre assumes text extractionw as successful if that process exits with 0 exit code.

10-22-2023, 11:56 PM	#3
ownedbycats Custom User Title Posts: 8,734 Karma: 62032183 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Thanks. Additionally, since it's related to this: Have you ever seen the full-text index database corrupt? It happened sometime in the last few days but only came up when I was trying to run a search.

10-23-2023, 12:02 AM	#4
kovidgoyal creator of calibre Posts: 43,934 Karma: 22669822 Join Date: Oct 2006 Location: Mumbai, India Device: Various	No, cant say that I have.

10-23-2023, 12:36 AM	#5
ownedbycats Custom User Title Posts: 8,734 Karma: 62032183 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	Ah, I thought a specific sequence of deleting files, adding a few file, then restoring the format from the trash might've screwed something up - I can't replicate it a second time though. I notice the newly-reindexed database is at least 250mb smaller, so maybe it was just in dire need of a vacuum.

Advert

Advert