Impossible to restore the database

[diane55]

Hi,

OS : Windows 10
Calibre : 7.11.0

Today, I found that Calibre database - which is stored on an external disk (1) - is corrupted.
Yesterday, I have checked it via "Maintenance de la bibliothèque/ Vérifier la bibliothèque" : there was no error.

Traceback (most recent call last):
File "calibre\db\backend.py", line 1560, in read_tables
File "calibre\db\tables.py", line 117, in read
File "C:\t\t\apsw-42s16m2x\src\cursor.c", line 240, in resetcursor
apsw.CorruptError: CorruptError: database disk image is malformed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre\gui2\ui.py", line 951, in library_moved
File "calibre\db\legacy.py", line 196, in __init__
File "calibre\db\cache.py", line 431, in init
File "calibre\db\backend.py", line 1557, in read_tables
apsw.CorruptError: CorruptError: database disk image is malformed

But it is impossible to restore it

Traceback (most recent call last):
File "calibre\db\restore.py", line 329, in replace_db
PermissionError: [WinError 32] Le processus ne peut pas accéder au fichier car ce fichier est utilisé par un autre processus(2): 'G:\\www\\metadata.db' -> 'G:\\xxx\\metadata_pre_restore.db'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre\db\restore.py", line 160, in run
File "calibre\db\restore.py", line 334, in replace_db
PermissionError: [WinError 32] Le processus ne peut pas accéder au fichier car ce fichier est utilisé par un autre processus (2): 'G:\\xxx\\metadata.db'

(1) Unluckily, the backup (on another external disk) is corrupted too because I've made it from the first one which is already corrupted.
(2) translation
"The process is unable to access to the file which already is used by another process"
I've checked : no process was running except Calibre


Thank you in advance for your assistance.
Regards

[JSWolf]

It's most likely your AV getting in the way. I suggest you turn it off or set it to ignore your calibre library directory and all sub-directories.

[kovidgoyal]

Reboot in safe mode and do the restore or alternately use the command line calibredb tool to do the restore.

[diane55]

Thank you for your suggestions.

Originally Posted by JSWolf

It's most likely your AV getting in the way. I suggest you turn it off or set it to ignore your calibre library directory and all sub-directories.

My AV was turned off when the restoring process was done.

Originally Posted by kovidgoyal

Reboot in safe mode and do the restore or alternately use the command line calibredb tool to do the restore.

Restoring in safe mode in uncessful with the same error message : no access to the file which already is used by another process...

Could you please indicate which command I have to write ? I never did it.
Thank you.

[kovidgoyal]

calibredb restore_database -r

[chaley]

What is the G: drive? Is it a network share? Is it connected to some cloud service such as onedrive or dropbox? If so then that is your problem. Copy the library onto a local disk and restore it there.

[diane55]

Originally Posted by chaley

What is the G: drive? Is it a network share? Is it connected to some cloud service such as onedrive or dropbox? If so then that is your problem. Copy the library onto a local disk and restore it there.

G: is a local external disk


I have 2 libraries :
- a big one with ebooks (format : epubs) on internal disk D:
- a smaller one with audiobooks (format : zip or MP3) on local external disk G. It is this one which is corrupted.

I've processed the restoration of the audiobooks library. Using cmd, I entered the following command :

calibredb restore_database -r [g:\XXX\]

I've added [g:\XXX\] because I was unable to access to the library folder on G: with the command "cd g:"
Everytime, I got "g:" but immediately I came back to : "c:\users\***" !


The process was launched and runned for hours and...the final result is deceiving : the audiobooks' database in G : remains corrupted ! :-(


In addition, it appears that the restoration has been done not only for audiobooks, but for both libraries - ebooks and audiobooks.
The final message at the end of the process was :

Restoring database succeeded, old database file saved as: metadata_pre_restore.db, this is saved in ....

I found 2 "metadata_pre_restore.db" files
- the first one in the ebooks library on D:
- the second one in the audiobooks library on G:

Maybe the command I used is not appropriate...

[kovidgoyal]

Then your library is not actually corrupted, but something on your computer is interfering with calibre.

[diane55]

Thank you for your answer.
I think that the database is corrupted because of this message when I try uncessfully to open the library



I can't figure out what can interfere with calibre because I get this message even in safe mode at minimum configuration, without internet...
I continue to dig in the problem.

Thank you all for your assistance.

[JSWolf]

Originally Posted by diane55

Thank you for your answer.
I think that the database is corrupted because of this message when I try uncessfully to open the library



I can't figure out what can interfere with calibre because I get this message even in safe mode at minimum configuration, without internet...
I continue to dig in the problem.

Thank you all for your assistance.

You try ShowWhatProcessLocksFile and see what's locking the database. Download the latest 6.0 version and give it a go.

https://github.com/PolarGoose/ShowWhatProcessLocksFile

[diane55]

I've created a new audios library and tried to import the audiobooks which are in the old libray. I have to do it one by one (the format is ZIP, RAR or MP3).

The cover works but not the opf. I have to recreate all the metadatas and it is a lot of work.
Too bad. I'll keep the library as it is, anyway the audiobooks are still there, sorted by author and series.



EDIT

Originally Posted by JSWolf

You try ShowWhatProcessLocksFile and see what's locking the database. Download the latest 6.0 version and give it a go.

https://github.com/PolarGoose/ShowWhatProcessLocksFile

I'll try this.
Thank you for the suggestion.

[diane55]

Download ShowWhatProcessLocksFile.msi.zip from the latest release.
Run the installer. The installer will install this program to the %AppData%\ShowWhatProcessLocksFile folder and add a Show what locks this file Windows File Explorer context menu element.

I'm trying to install ShowWhatProcessLocksFile but do not know how to do it :-(
In the ZIP file, there is no installer.exe.
The subfolder Installer of the folder SRC contains :
- HeatWaveConvert.log (text document)
- Installer.wixproj (file)
- Product.wxs (file)

I do not know what to do with these files

[Quoth]

You downloaded the wrong thing
Latest (under Releases)
https://github.com/PolarGoose/ShowWh...eases/tag/v6.0
has ShowWhatProcessLocksFile.msi.zip

Unzipping gives a windows .msi which should install.


Edit: The "Latest" / Releases are invisible on some browsers or on some script blocking settings.

[diane55]

Finally, I've installed PowerToys and activated File Locksmith.

It shows that Calibre is the only process working on the database.



I give up.

Thank you all for your patience and assistance.

[jmurphy]

Originally Posted by diane55

I've added [g:\XXX\] because I was unable to access to the library folder on G: with the command "cd g:"
Everytime, I got "g:" but immediately I came back to : "c:\users\***" !

You need to change drives first:

g:
cd xxx

or

CD /D G:\xxx