Amazon Cover Bug Folder Not Populating

[andhistablet]

I am running Calibre 5.44, 64-bit on a 64-bit Win 10 PC. I have 9K+ books on my Kindle Oasis. However, at this point the files are very hit and miss (more miss) when it comes to covers transferring. I am aware of the Calibre cover rebuild feature, which utilizes the Cover Bug folder. However, I am seeing something very strange.

When I upload to the Oasis, I also keep the File Explorer open to the Cover Bug folder on my Kindle where I can see if a file was sent and has a corresponding thumbnail created as well. I did not do this for the first 9K books, but only when I began having the issue.

I can sometimes transfer 1 book at a time and see the cover populate, and when I eject the Kindle I see the book pop up in the library as intended, begin indexing, etc.

Most times, I do the same transfer of the same file format (AZW3) and a file is not created in the Cover Bug folder. Once metadata transfers and I eject the Kindle, the cover predictably does NOT show up in my library. The indexing and file work as intended.

Does anyone know why select files may NOT be transferring cover files? I am changing settings on one book at a time, but have spent a huge amount of time with no results. Any help is appreciated! Thank you.

[kovidgoyal]

right click preferences button, choose restart in debug mode, post the debug log after transferring a file for which the cover doesnt transfer.

[andhistablet]

Thank you Kovid, log below:

Spoiler:

calibre Debug log
calibre 5.44 [64bit] embedded-python: True is64bit: True
Windows-10-10.0.19041 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19041')
Python 3.8.5
Windows: ('10', '10.0.19041', '', 'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Gather KFX-ZIP (from KFX Input) (1, 49, 0) && DeDRM (7, 2, 1) && Package KFX (from KFX Input) (1, 49, 0) && Barnes & Noble (1, 2, 16) && Clean Metadata (0, 0, 6) && Find Duplicates (1, 9, 5) && Generate Cover (2, 1, 0) && Goodreads Sync (1, 15, 1) && KFX metadata reader (from KFX Input) (1, 49, 0) && KFX Input (1, 49, 0) && Set KFX metadata (from KFX Output) (1, 63, 0) && KFX Output (1, 63, 0) && Kindle Collections (1, 7, 29) && Kindle hi-res covers (0, 5, 0) && Language Cleaner (2020, 9, 7) && Obok DeDRM (7, 2, 1) && Prettify Cover (1, 5, 0) && Quality Check (1, 12, 0) && Resize Cover (1, 1, 0)
calibre 5.44 [64bit] embedded-python: True is64bit: True
Windows-10-10.0.19041 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19041')
Python 3.8.5
Windows: ('10', '10.0.19041', '', 'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Gather KFX-ZIP (from KFX Input) (1, 49, 0) && DeDRM (7, 2, 1) && Package KFX (from KFX Input) (1, 49, 0) && Barnes & Noble (1, 2, 16) && Clean Metadata (0, 0, 6) && Find Duplicates (1, 9, 5) && Generate Cover (2, 1, 0) && Goodreads Sync (1, 15, 1) && KFX metadata reader (from KFX Input) (1, 49, 0) && KFX Input (1, 49, 0) && Set KFX metadata (from KFX Output) (1, 63, 0) && KFX Output (1, 63, 0) && Kindle Collections (1, 7, 29) && Kindle hi-res covers (0, 5, 0) && Language Cleaner (2020, 9, 7) && Obok DeDRM (7, 2, 1) && Prettify Cover (1, 5, 0) && Quality Check (1, 12, 0) && Resize Cover (1, 1, 0)
Turning on automatic hidpi scaling
devicePixelRatio: 2.0
logicalDpi: 96.0 x 96.0
physicalDpi: 81.82550335570468 x 81.8865671641791
Using calibre Qt style: True
[0.00] Starting up...
[0.00] Showing splash screen...
[0.48] splash screen shown
[0.48] Initializing db...
[1.48] db initialized
[1.48] Constructing main UI...
DEBUG: 0.0 Goodreads Sync::dialogs.py - loading translations
DEBUG: 0.0 GoodreadsSync::action.py - loading translations
DEBUG: 0.0 obok::utilities.py - loading translations
DEBUG: 0.0 obok::dialogs.py - loading translations
DEBUG: 0.0 obok::config.py - loading translations
DEBUG: 0.0 obok::action_err.py - loading translations
{'width': 450, 'height': 680, 'default': True}
Resize Covers::rebuild_menus - size_data={'width': 450, 'height': 680, 'default': True}
DEBUG: 1.7 HttpHelper::__init__: proxy=None
[3.52] main UI initialized...
[3.52] Hiding splash screen
Starting QuickView
Traceback (most recent call last):
File "calibre\devices\kindle\driver.py", line 465, in post_open_callback
File "calibre\devices\kindle\driver.py", line 567, in sync_cover_thumbnails
PermissionError: [Errno 13] Permission denied: 'E:\\system\\thumbnails\\thumbnail_0eb1cf31-20aa-46d1-93c9-052469e3be17_EBOK_portrait.jpg'
Traceback (most recent call last):
File "calibre\devices\kindle\driver.py", line 487, in upload_cover
File "calibre\devices\kindle\driver.py", line 532, in upload_kindle_thumbnail
PermissionError: [Errno 13] Permission denied: 'E:\\system\\thumbnails\\thumbnail_e8d40faf-0d1d-48ac-90ee-112b4716a7cc_EBOK_portrait.jpg'
Storage number map:
{(7, 0): [(1, 'D'), (2, 'F')], (7, 1): [(4, 'C')], (7, 2): [(1, 'E')]}
Storage number for USBSTOR\DISK&VEN_KINDLE&PROD_INTERNAL_STORAGE&REV_ 0401\G000WM0602770F9J&0: StorageDeviceNumber(type=7, number=2, partition_number=0)
Drive letters for USBDevice(vendor_id=0x1949 product_id=0x4 bcd=0x401 devid=usb\vid_1949&pid_0004&rev_0401 devinst=20)
{'drive_letters': ['E'],
'pnp_id_map': {'E': '\\\\?\\usbstor#disk&ven_kindle&prod_internal_stor age&rev_0401#g000wm0602770f9j&0#{53f56307-b6bf-11d0-94f2-00a0c91efb8b}'},
'readonly_drives': set(),
'sort_map': {'E': (2, 1)}}
Syncing cover thumbnails to workaround amazon cover bug
Restoring cover thumbnail: thumbnail_0eb1cf31-20aa-46d1-93c9-052469e3be17_EBOK_portrait.jpg
Job: 0 Get device information started
DeviceJob: 0 Get device information done, calling callback
DeviceJob: 0 Get device information callback returned
Job: 1 Set library information started
DeviceJob: 1 Set library information done, calling callback
DeviceJob: 1 Set library information callback returned
Job: 2 Get list of books on device started
DEBUG: 0.0 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= None
DEBUG: 0.0 USBMS: dirs are: E:\ documents
Job: 0 Get device information finished
No details available.
Job: 1 Set library information finished
No details available.
DEBUG: 2.8 USBMS: scan from root False E:\documents
[13.45] splash screen hidden
[13.45] Started up in 13.45 seconds with 15908 books
DEBUG: 8.7 USBMS: count found in cache: 10395, count of files in metadata: 10395, need_sync: False
DEBUG: 8.7 USBMS: Finished fetching list of books from device. oncard= None
DEBUG: 8.7 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= carda
DEBUG: 8.7 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= cardb
DeviceJob: 2 Get list of books on device done, calling callback
DeviceJob: metadata_downloaded: Starting set_books_in_library
DeviceJob: set_books_in_library: books to process= 10395
Job: 2 Get list of books on device finished
No details available.
DeviceJob: set_books_in_library finished: time= 0.2839188575744629
DeviceJob: metadata_downloaded: updating views
DeviceJob: metadata_downloaded: syncing
DeviceJob: metadata_downloaded: refreshing ondevice
DeviceJob: metadata_downloaded: sending metadata_available signal
DeviceJob: 2 Get list of books on device callback returned
Job: 3 Send metadata to device started
DEBUG: 10.5 USBMS: starting sync_booklists
Job: 2 Get list of books on device finished
No details available.
DEBUG: 17.1 USBMS: finished sync_booklists
DeviceJob: 3 Send metadata to device done, calling callback
DeviceJob: 3 Send metadata to device callback returned
Job: 3 Send metadata to device finished
No details available.
Job: 4 Upload one book to the device: A Land More Kind Than Home started
Device using plugboard azw3 KINDLE2 None
Setting metadata in: A Land More Kind Than Home at: C:\Users\KCJ\AppData\Local\Temp\calibre_n6je1_jp\8 hlayznhcaltmpfmt.azw3
DEBUG: 27.2 USBMS: uploading 1 books
APNX META: guid: e7d7fabb
APNX META: ASIN: e8d40faf-0d1d-48ac-90ee-112b4716a7cc
APNX META: CDE: EBOK
APNX META: format: MOBI_8
APNX META: Name: A_Land_More_Kind_Than_Home
APNX Content Header: {"contentGuid":"e7d7fabb","asin":"e8d40faf-0d1d-48ac-90ee-112b4716a7cc","cdeType":"EBOK","format":"MOBI_8"," fileRevisionId":"1","acr":"A_Land_More_Kind_Than_H ome"}
DEBUG: 27.5 USBMS: finished uploading 1 books
DeviceJob: 4 Upload one book to the device: A Land More Kind Than Home done, calling callback
DEBUG: 27.5 USBMS: adding metadata for 1 books
DEBUG: 27.5 USBMS: finished adding metadata
DeviceJob: set_books_in_library: books to process= 10396
Job: 4 Upload one book to the device: A Land More Kind Than Home finished
No details available.
DeviceJob: set_books_in_library finished: time= 0.34032225608825684
DeviceJob: 4 Upload one book to the device: A Land More Kind Than Home callback returned
Job: 5 Send metadata to device started
DEBUG: 29.2 USBMS: starting sync_booklists
Job: 4 Upload one book to the device: A Land More Kind Than Home finished
No details available.
DEBUG: 35.1 USBMS: finished sync_booklists
DeviceJob: 5 Send metadata to device done, calling callback
DeviceJob: 5 Send metadata to device callback returned
Job: 5 Send metadata to device finished
No details available.

[kovidgoyal]

There you go: PermissionError: [Errno 13] Permission denied: 'E:\\system\\thumbnails\\thumbnail_e8d40faf-0d1d-48ac-90ee-112b4716a7cc_EBOK_portrait.jpg'

Its permission denied error check the permissions on the cover bug folder. See https://manual.calibre-ebook.com/faq...n-denied-error for all the possible reasons.

[andhistablet]

Thank you Kovid, I am looking into this. I am unable to see the System folder in my File Explorer, even with Show Hidden Folders enabled. I am assuming I will need to see this folder before I can edit permissions on it.

[andhistablet]

Okay, I FINALLY figured this out. The reason this was not working was due to Google Drive backing up my Calibre Library folder, and when Drive accessed the files, some would through and permissions error and some wouldn't, allowing SOME covers to be copied to the Amazon Cover Bug folder.

The Calibre book files were being routed to a standard library folder in my documents folder called "Calibre Library." However, I recently selected that folder as one of the folders for Google Drive desktop app to scan and upload. This background usage/scanning of the folder threw permissions errors and resulted in very sporadic behavior.

Another clue was that when deleting books from my library via the Calibre app, the app would sometimes throw an error that the file was in use by another program, although I had no knowledge of Google Drive performing a scan.

I paused all syncing and removed the Calibre Library folder from the backup options in Drive, and afterwards everything worked perfectly.

The sporadic behavior initially made me look for differences in the book files themselves, then explore permissions issues before FINALLY noticing today that the Cablibre Library folder has recently been added to the backup schedule. Don't make the mistake I did everyone- backup and then turn off automatic syncing!

Thank you Kovid, it was your advice about debug mode that finally lead me down the right path!

[BetterRed]

See ==>> https://manual.calibre-ebook.com/faq...rked-drive-nas

In particular, be aware that Google Drive is incompatible with calibre, if you put your calibre library in Google Drive, you will suffer data loss. See this thread for details.

BR