[GUI Plugin] Mass Search/Replace

[un_pogaz]

No, it's really not a problem to do this repair.

Can tou share the operations list that raise the error with the export tool.

[Vampi2009]

IT WORKS again!
After installing your last test zip I needed to reboot and now it works.
Thank you very much for your work!

[StegBook]

I just started getting this error today. Never had any issues before. Same error with single or multiple books selected

calibre, version 6.28.0
ERROR: Unhandled exception: <span>The Mass Search-Replace plugin has encounter a unhandled exception.<br><b>NotImplementedError</b>: set() cannot be used in this context. ProxyMetadata is read only

calibre 6.28 embedded-python: True
Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19045')
Python 3.10.1
Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: Count Pages (1, 13, 3) && EpubSplit (3, 6, 0) && Extract ISBN (1, 6, 0) && Find Duplicates (1, 10, 8) && Goodreads (1, 7, 9) && Goodreads Sync (1, 16, 3) && Manage Series (1, 5, 1) && Mass Search-Replace (1, 7, 4) && Quality Check (1, 13, 6) && Reading List (1, 15, 1) && WordDumb (3, 29, 6)
Traceback (most recent call last):
File "calibre_plugins.mass_search_replace.action", line 393, in job_progress
File "calibre_plugins.mass_search_replace.SearchReplace ", line 218, in search_replace
File "calibre_plugins.mass_search_replace.SearchReplace Calibre", line 981, in do_search_replace
File "calibre\db\lazy.py", line 411, in set
File "calibre\db\lazy.py", line 379, in _unimplemented_exception
NotImplementedError: set() cannot be used in this context. ProxyMetadata is read only

[un_pogaz]

Oh crap.
Thanks for the report.

[StegBook]

That fixed it.

[DeshaDaine]

Hi, I'm hoping you can help. I've been using Mass Search/Replace without issue, but today, after working fine for a while, I tried to run it through an action chain and I got an error: TypeError:Invalide Column metadata. Now whenever I try to run anything, or even customise the plugin, I always get this error.

I hadn't changed any columns since my last successful run, so all I can think of is that Action Chains has somehow broken it. I have tried restarting Calibre and restarting my PC. This is what I get from the details of the error:

calibre, version 7.17.0
ERROR: Unhandled exception: <span>The Mass Search-Replace plugin has encounter a unhandled exception.<br><b>TypeError</b>: Invalide Column metadata.

calibre 7.17 embedded-python: True
Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.22631')
Python 3.11.5
Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre.exe
Successfully initialized third party plugins: Action Chains (1, 20, 7) && Annotations (1, 17, 13) && Audit Log (1, 0, 19) && Count Pages (1, 13, 6) && EpubMerge (3, 1, 0) && EpubSplit (3, 8, 0) && FanFicFare (4, 38, 0) && Fantastic Fiction (1, 7, 0) && Fantastic Fiction Adults (1, 3, 1) && Favourites Menu (1, 3, 1) && Find Duplicates (1, 10, 9) && Generate Cover (2, 3, 4) && Import List (1, 9, 4) && Kobo Utilities (2, 17, 1) && KoboTouchExtended (3, 6, 11) && Mass Search-Replace (1, 8, 2) && Modify ePub (1, 8, 4) && Quality Check (1, 13, 14) && Reading List (1, 15, 4) && Reformat plugin (2, 4, 0) && Standard Ebooks (1, 0, 0) && View Manager (1, 10, 3)
Traceback (most recent call last):
File "calibre_plugins.mass_search_replace.action", line 330, in job_progress
File "calibre_plugins.mass_search_replace.search_replac e.__init__", line 76, in get_error
File "calibre_plugins.mass_search_replace.common_utils. columns", line 686, in get_possible_fields
File "calibre_plugins.mass_search_replace.common_utils. columns", line 723, in get_columns_where
File "calibre_plugins.mass_search_replace.common_utils. columns", line 718, in get_columns_from_dict
File "calibre_plugins.mass_search_replace.common_utils. columns", line 718, in <listcomp>
File "calibre_plugins.mass_search_replace.common_utils. columns", line 203, in __init__
TypeError: Invalide Column metadata.

[un_pogaz]

Can you restart Calibre in debug mode "Preference>Restart in debug mode" and share me log file that will appear after you close Calibre? Thanks.

Note: Use spoiler to paste the log, and reduce the size.

[DeshaDaine]

I think it may be to do with the Annotations plugin. I used it yesterday, although I'm 99% sure I ran Mass Search/Replace fine after I did that, until I tried to run it through an Action Chain.

Anyway, here's the log. Let me know if you need anything else and thank you for looking into it for me, it's much appreciated.

Spoiler:

ApplicationPaletteChange event ignored
Using calibre Qt style: True
EpubMerge: DEBUG: 2024-09-07 18:45:44,814: calibre_plugins.epubmerge.epubmerge_plugin(156): macmenuhack file_path:C:\Users\USERNAME\AppData\Roaming\calibr e\plugins\fanficfare_macmenuhack.txt
FFF: DEBUG: 2024-09-07 18:45:44,819: calibre_plugins.fanficfare_plugin.fff_plugin(217): Plugin FanFicFare macmenuhack file_path:C:\Users\USERNAME\AppData\Roaming\calibr e\plugins\fanficfare_macmenuhack.txt
calibre Debug log
calibre 7.17 embedded-python: True
Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.22631')
Python 3.11.5
Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: Action Chains (1, 20, 7) && Annotations (1, 17, 13) && Audit Log (1, 0, 19) && Count Pages (1, 13, 6) && EpubMerge (3, 1, 0) && EpubSplit (3, 8, 0) && FanFicFare (4, 38, 0) && Fantastic Fiction (1, 7, 0) && Fantastic Fiction Adults (1, 3, 1) && Favourites Menu (1, 3, 1) && Find Duplicates (1, 10, 9) && Generate Cover (2, 3, 4) && Import List (1, 9, 4) && Kobo Utilities (2, 17, 1) && KoboTouchExtended (3, 6, 11) && Mass Search-Replace (1, 8, 2) && Modify ePub (1, 8, 4) && Quality Check (1, 13, 14) && Reading List (1, 15, 4) && Reformat plugin (2, 4, 0) && Standard Ebooks (1, 0, 0) && View Manager (1, 10, 3)
calibre 7.17 embedded-python: True
Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.22631')
Python 3.11.5
Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: Action Chains (1, 20, 7) && Annotations (1, 17, 13) && Audit Log (1, 0, 19) && Count Pages (1, 13, 6) && EpubMerge (3, 1, 0) && EpubSplit (3, 8, 0) && FanFicFare (4, 38, 0) && Fantastic Fiction (1, 7, 0) && Fantastic Fiction Adults (1, 3, 1) && Favourites Menu (1, 3, 1) && Find Duplicates (1, 10, 9) && Generate Cover (2, 3, 4) && Import List (1, 9, 4) && Kobo Utilities (2, 17, 1) && KoboTouchExtended (3, 6, 11) && Mass Search-Replace (1, 8, 2) && Modify ePub (1, 8, 4) && Quality Check (1, 13, 14) && Reading List (1, 15, 4) && Reformat plugin (2, 4, 0) && Standard Ebooks (1, 0, 0) && View Manager (1, 10, 3)
QPA platform: windows
devicePixelRatio: 2.0
logicalDpi: 96.0 x 96.0
physicalDpi: 92.53889943074003 x 92.67567567567568
[0.00] Starting up...
[0.00] Showing splash screen...
[1.17] splash screen shown
[1.17] Initializing db...
[2.06] db initialized
[2.06] Constructing main UI...
DEBUG: 0.0 Annotations plugin: Error loading libiMobileDevice. This hasn't worked for a while, and is blacklisted in calibre v3.
DEBUG: 0.0 Annotations plugin: Error is: No module named 'calibre.devices.idevice'
DEBUG: 0.0 Annotations::reader_app_support.py - loading translations
DEBUG: 0.0 Annotations::common_utils.py - loading translations
DEBUG: 0.0 Annotations::appearance.py - loading translations
DEBUG: 0.0 Annotations::config.py - loading translations
DEBUG: 0.0 Annotations::annotated_books.py - loading translations
DEBUG: 0.0 Annotations::action.py - loading translations
DEBUG: 0.0 Kobo Utilities Configuration - CreateNewCustomColumn is supported
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 0.0 KoboUtilites::dialogs.py - loading translations
DEBUG: 0.0 KoboUtilites::action.py - loading translations
[75.24] GUI main window shown
DEBUG: 72.0 No Kobo Touch, Glo or Mini appears to be connected
DEBUG: 72.0 rebuild_menus - self.supports_ratings=None, self.supports_tiles=None
DEBUG: 72.0 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG: 72.0 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Driver: KoboTouchExtended'
Mass Search-Replace: Rebuilding menu for: General > Clean
Mass Search-Replace: Rebuilding menu for: [Omitted because there's a lot... all just say the folder and name.]
[75.33] main UI initialized...
[75.33] Hiding splash screen
[75.34] splash screen hidden
[75.34] Started up in 75.34 seconds with 9488 books
calibre 7.17 embedded-python: True
Windows-10-10.0.22631-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.22631')
Python 3.11.5
Windows: ('10', '10.0.22631', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: Action Chains (1, 20, 7) && Annotations (1, 17, 13) && Audit Log (1, 0, 19) && Count Pages (1, 13, 6) && EpubMerge (3, 1, 0) && EpubSplit (3, 8, 0) && FanFicFare (4, 38, 0) && Fantastic Fiction (1, 7, 0) && Fantastic Fiction Adults (1, 3, 1) && Favourites Menu (1, 3, 1) && Find Duplicates (1, 10, 9) && Generate Cover (2, 3, 4) && Import List (1, 9, 4) && Kobo Utilities (2, 17, 1) && KoboTouchExtended (3, 6, 11) && Mass Search-Replace (1, 8, 2) && Modify ePub (1, 8, 4) && Quality Check (1, 13, 14) && Reading List (1, 15, 4) && Reformat plugin (2, 4, 0) && Standard Ebooks (1, 0, 0) && View Manager (1, 10, 3)
Traceback (most recent call last):
File "calibre_plugins.mass_search_replace.action", line 183, in show_configuration
File "calibre\customize\__init__.py", line 160, in do_user_config
File "calibre_plugins.mass_search_replace.__init__" , line 71, in config_widget
File "calibre_plugins.mass_search_replace.config", line 180, in __init__
File "calibre_plugins.mass_search_replace.config", line 279, in __init__
File "calibre_plugins.mass_search_replace.config", line 402, in populate_table
File "calibre_plugins.mass_search_replace.config", line 415, in populate_table_row
File "calibre_plugins.mass_search_replace.config", line 457, in set_editable_cells_in_row
File "calibre_plugins.mass_search_replace.config", line 625, in __init__
File "calibre_plugins.mass_search_replace.config", line 630, in set_menu
File "calibre_plugins.mass_search_replace.config", line 656, in has_error
File "calibre_plugins.mass_search_replace.search_replac e.__init__", line 76, in get_error
File "calibre_plugins.mass_search_replace.common_utils. columns", line 686, in get_possible_fields
File "calibre_plugins.mass_search_replace.common_utils. columns", line 723, in get_columns_where
File "calibre_plugins.mass_search_replace.common_utils. columns", line 718, in get_columns_from_dict
File "calibre_plugins.mass_search_replace.common_utils. columns", line 718, in <listcomp>
File "calibre_plugins.mass_search_replace.common_utils. columns", line 203, in __init__
TypeError: Invalide Column metadata.

[un_pogaz]

Please, share the full log, without ommit anything. Thanks.
It was sincerly very kind and concern of you to try to help me, but precisely, the thing I'm interested in is a large piece of text and you couldn't guess where it is exactly.

[DeshaDaine]

Hi un_pogaz, I would but I tried using Fetch Annotations (experimental) to see if it was an alternative to the Annotations plugin and ended up having to restore my Calibre from a backup because it froze Calibre and proceded to keep refreezing Calibre every time I connected my Kobo... The upside is I backup frequently so I only lost 1 day's worth of edits and now Mass Search/Replace is back to working like it did - in hindsight, that should have been my first port of call, rather than bothering you!

However, I am now 100% sure it was Annotations causing issues. The first import of backup data failed due to the Annotations plugin (worrying for a second because calibre reverted to basics with no plugins, even on my previous library, but it was fixed by importing my backup a second time). I tested restoring a second time with the same results. Therefore, I've deleted Annotations as it's clearly causing errors across Calibre and (due to sad circumstances) it's no longer in development. KoboUtilities has a manual copy of annotations, which isn't as quick/automated, but gets the job done.