[GUI Plugin] Annotations

davidfor · 06-17-2014, 07:08 AM

The Annotations plugin is under new management. With GRiker taking a long vacation, he has passed the development and support for the plugin to me. From now on, this thread will be used for any support questions and to host the plugin. All future questions should be posted here, but the older thread is here for reference.

The Annotations plugin imports annotations from supported ebook readers and applications described in the following table:

Main Features:

Imports annotations from supported eBook reader applications.
Annotations may be added to Comments or a custom column.
Annotation appearance is fully configurable via CSS.
Collect News clippings from periodicals downloaded by Calibre (Kindle).
Extensible architecture allows adding support for other eBook reader applications.
Enables fetching annotations directly from a connected iDevice without additional 3rd party software.
Adds improved support for international Kindle timestamps contributed by @-axel-.
Support for:
- Kindle - annotations fetched from "My Clippings.txt" file.
- Kobo ereaders - annotations fetched from database.
- tolino ereaders - annotations fetched from notes.txt file.
- GoodReader

Installation Steps:

Open Preferences|Plugins|Get new plugins to install the 'Annotations' plugin. Or, download the attached zip file and install the plugin manually, then restart calibre as described in the Introduction to plugins thread.

Plugin configuration:

By default, imported annotations will be added to calibre's Comments column.
If you'd prefer to add imported annotations to a custom column (recommended), open the Customize Annotations dialog by selecting Customize plugin… from the plugin's context menu. Use the custom column wizard in the Annotation options section to create a custom column.
If you choose to use a pre-existing custom column to receive annotations, click on the Annotations plugin icon to open the Configuration dialog, then select the custom column in the Annotation options dropdown list.
See Help in the plugin menu for additional information.

Typical Kindle workflow:

The Kindle UI must be set to English, French, German, Spanish, Italian, Portuguese, Japanese or Chinese for the plugin to be able to retrieve locations and timestamps from your 'My Clippings.txt' file.

Calibre: Transfer books from calibre to Kindle, either via email, Kindle's experimental web browser, or while directly connected to calibre.
Kindle: Create some highlights/notes.
Calibre: Open the Annotations plugin context menu, select Fetch annotations from Amazon Kindle.

Typical GoodReader workflow:

Computer: Transfer books from calibre to GoodReader via iTunes. See this GoodReader explanation of how to transfer books from your computer to GoodReader via USB.
GoodReader: Create some highlights/notes.
GoodReader: While reading a book, tap the center of the screen so that the overlay controls are shown. Tap the Share icon (bottom right). Tap E-mail Summary, then email the annotations to yourself.
Computer: After receiving the emailed annotations summary, select and copy the contents of the annotations summary email.
Calibre: Select the book in your calibre library to receive the imported GoodReader annotations.
Calibre: Open the Annotations plugin context menu, select Import annotations from…GoodReader, then paste the annotations summary into the dialog window.

Modifying the appearance of imported annotations:

Click the Annotations plugin icon, or select Customize plugin from the context menu.
Click Modify appearance…

Spoiler:
The Preview window shows a live preview of the formatting options.
Edit the CSS in the Annotation elements window
To move an element up or down, click the name of the element (Text, Note or Timestamp), then click the up or down arrow to move that element.
To restore an element's CSS to its last saved values, select the element, then click the restore button.
To reset an element's CSS to default values, select the element, then click the recycle button.
To change the format of the timestamp, edit the Timestamp format. Click the Help icon to see formatting values for the timestamp. Click the recycle button to reset the timestamp to its default value.

How the plugin decides where to add imported annotations

Spoiler:

Special Notes:

Requires calibre 1.0.0 or later.

Developer Notes:

The Annotations plugin can be extended to support devices whose annotations can be fetched while connected via USB, or exported via email. If you are a developer interested in adding support for a particular device or reader app meeting these requirements, contact me for more information.

Version History:

Spoiler:

1.17.13 - 19 July 2022

Fix: Qt6 compatibility - Yet another enum issue.

1.17.12 - 17 July 2022

Fix: Qt6 compatibility - Yet another enum issue.

1.17.11 - 14 July 2022

Fix: Qt6 compatibility - Another enum issue.

1.17.10 - 13 July 2022

Fix: Qt6 compatibility - Another enum issue.
New: Enable support for import file chooser - thanks to @stbenjam
Fix: Qt6 compatibility - Check boxes in the annotations import screen were not working.

1.17.8 - 09 July 2022

Fix: Qt6 compatibility - time conversions and column sort order

1.17.6 - 30 June 2022

Change: Remove Qt compileUi as no longer used and blocking calibre6/Qt6.
Fix: Missed a spot where need to use "current_friendly_name" for MTP devices
Fix: PocketBook - Workaround issues with nulls in database and links.
Fix: Change regex used for Kindle "Clippings.txt" to case insensitive. Kindle set to pt_BR uses lower case version of strings.
Fix: Threadsafe method of getting device name for MTP devices on Linux.

1.17.0 - 10 April 2022

New: Added support for AlReaderX reader app on the Boox Android-based devices. Thanks to @aik099.
Change: Some code cleanup.
Fix: Handle change collections library.

1.16.0 - 19 July 2021

New: Add PocketBooks support - Thanks to @wold.
Fix: Error "TypeError: unhashable type: 'SortableTableWidgetItem'" when importing from Kindle.
Fix: Error rendering annotations as HTML.
Fix: Change some handling of confidence generation as some devices have already matched the books.

1.15.0 - 04 April 2021

Fix: Spanish My Clippings.txt has "La" for the annotations.
Fix: Change method of getting books on device to use a search similar to what is used for Kobo and Tolino devices.
Fix: Sorting of annotations for kepubs on Kobo devices.
Fix: Opening My Clippings.txt should have been binary. Missed this when reverted earlier change.
Fix: Display more details of an exception when parsing My Clippings.txt.
Fix: Goodreader import not working.
Fix: Broke Python 2 support with the open when reading My Clippings.txt.
Fix: If already have book id in library, use confidence of 5.
Fix: Encode and decode the title from My Clippings.txt to remove the Unicode BOM character.
Fix: A couple of changes to solve some obvious problems with the Kindle fetch. Plus more logging.
Fix: Python 3 compatibility: Help dialogs.
Fix: Sorting columns in fetched annotations dialog.

1.14.0 - 26 December 2020

Fix: Python 3 compatiblity: Replace use of "file" with "open".
Fix: Python 3 compatiblity: Sorting on the Annotations Import dialog.
Fix: Python 3 compatiblity: Completed work for tolinos and Kindles.
New: Add support for Sony devices. From @Cibes.
Fix: Remove references to older calibre IPC code as that was removed in calibre 5.7.
Update: Various backend changed that should improve performance.

1.13.0 - 18 October 2020

Update: Changes for Python 3 support in calibre.
Update: Internal changes to how dialogs are handled.

1.12.0 - 08 January 2020

Fix: Errors fetching from Kobo devices if the dates in the database were null.

1.11.0 - 3 December 2019

Fix: Problem when couldn't get old annotations.
Fix: Support calibre version 4. Use QTextEdit instead of QWebView. Should be compatible with 3.x.

1.10.0 - 4 October 2019

Change: Add PDF as supported format for Kindle devices.
Fix Kobo: Not getting annotations for kepubs if filename contains spaces.
Internal Change: Use rowfactory and names in database.
Fix: Some issues with merging with existing annotations.

1.9.2 - 25 May 2019

Update: Remove dynamic_property in preparation for change in calibre.

1.9.1 - 5 May 2019

Update: Small change to make plugin backwardly compatible with older versions of calibre.

1.9.0 - 22 April 2019

New: Add support for tolino devices.
Fix: Parsing error when annotations in library missing color attribute.
Fix: Apparently some Kindles use lower case for location and page.
Fix: Was writing empty p-tag after the annotation and note.
New: Change device fetch menu option to the same name all the time.
New: Add some shortcuts.
Update: Internal changes for prints and testing in ParseKindleMyClippingsTxt.py.
Fix: Update to match BeautifulSoup changes in calibre.

Spoiler:

pedrogaza · 06-20-2014, 12:00 PM

Hi,

Would it possible to export annotations to Kobo ? For the ADE annotations it is not a problem, but for annotations stored in Kobo database, it is more difficult to manage it by hand.

I wait for this function since long time... I do not know how to program a plugin, so if I can't find a way to do this before this summer, I will make it in bash script.

Pierre

theducks · 06-20-2014, 01:28 PM

Quote:

Originally Posted by pedrogaza

Hi,

Would it possible to export annotations to Kobo ? For the ADE annotations it is not a problem, but for annotations stored in Kobo database, it is more difficult to manage it by hand.

I wait for this function since long time... I do not know how to program a plugin, so if I can't find a way to do this before this summer, I will make it in bash script.

Pierre

Have you looked at what the Kobo utilities PI can do for you?

davidfor · 06-20-2014, 08:59 PM

Quote:

Originally Posted by pedrogaza

Hi,

Would it possible to export annotations to Kobo ? For the ADE annotations it is not a problem, but for annotations stored in Kobo database, it is more difficult to manage it by hand.

I wait for this function since long time... I do not know how to program a plugin, so if I can't find a way to do this before this summer, I will make it in bash script.

Version 1.4.0 of the plugin added support for the Kobo devices. I still need to update the first post completely. And add it to the help.

There are some alternatives:

As theducks said, the Kobo Utilities plugin includes a function.
Calibre has a a "Fetch annotations" function that gets them and adds them to the comments field.
If you add "ExportHighlights=true" to the "FeatureSettings" section of the devices config file, a menu item will be added to the books menu in in the library list on the device to export them as a text file on the device.
There have been a few scripts or apps posted in the Kobo forum over the years. A search there should find them.

Rains · 06-24-2014, 02:24 PM

Hi! Is this plugin usable in Linux? Because I can't get it to work, it installs fine and then I reboot the program but I can't import annotations from the Kindle and when I try to click on "Customize plugin" it shows me this:

These are the details:

Code:

calibre 1.40  isfrozen: False is64bit: True
Linux-3.15.0-1-mainline-x86_64-with-glibc2.2.5 Linux ('64bit', 'ELF')
('Linux', '3.15.0-1-mainline', '#1 SMP PREEMPT Mon May 26 09:43:21 CEST 2014')
Python 2.7.7
Linux: ('', '', '')
Traceback (most recent call last):
  File "/usr/lib/calibre/calibre/gui2/preferences/plugins.py", line 286, in customize_plugin
    self.modify_plugin(op='customize')
  File "/usr/lib/calibre/calibre/gui2/preferences/plugins.py", line 361, in modify_plugin
    if plugin.do_user_config(self.gui):
  File "/usr/lib/calibre/calibre/customize/__init__.py", line 150, in do_user_config
    config_widget = self.config_widget()
  File "calibre_plugins.annotations.__init__", line 28, in config_widget
  File "calibre_plugins.annotations.config", line 60, in __init__
AttributeError: 'AnnotationsAction' object has no attribute 'opts'

As you can see, my Calibre is in Spanish, but I don't think that's the issue, or is it?

eschwartz · 06-24-2014, 04:01 PM

I do know that according to your error message [isfrozen: False] you do not seem to be running the version that came from Kovid, but are instead using a distro calibre.

It is generally recommended to use the official calibre build. Most distros do not update as frequently as calibre does (weekly) and Kovid prefers to have one self-contained package to support.

The plugin does work on linux -- I use it.

Rains · 06-25-2014, 12:04 AM

You're right. I just removed the version I had installed (which wasn't too old, 1.40) and installed the binary package from Calibre's website and now the plugin works.

Thanks.

eschwartz · 06-25-2014, 12:10 AM

Quote:

Originally Posted by Rains

You're right. I just removed the version I had installed (which wasn't too old, 1.40) and installed the binary package from Calibre's website and now the plugin works.

Thanks.

There are also random ways in which the binaries are not necessarily the same as the distro. For instance, calibre (binary) uses a different version of python (2.7.5) than you seem to have installed (2.7.7).

Perhaps the plugin is written in a way that depends on 2.7.5?

davidfor · 06-25-2014, 12:46 AM

Quote:

Originally Posted by eschwartz

There are also random ways in which the binaries are not necessarily the same as the distro. For instance, calibre (binary) uses a different version of python (2.7.5) than you seem to have installed (2.7.7).

Perhaps the plugin is written in a way that depends on 2.7.5?

To the best of my knowledge it doesn't. Or at least not directly. The plugin is dependent on calibre. And it is packaged with a version of Python, so anything else could cause a problem.

Rain: Where did you try to configure the plugin from? The toolbar button or the plugin list?

eschwartz · 06-25-2014, 12:55 AM

Quote:

Originally Posted by davidfor

To the best of my knowledge it doesn't. Or at least not directly. The plugin is dependent on calibre. And it is packaged with a version of Python, so anything else could cause a problem.

You mean python is installed in the plugin itself??

Doesn't it use calibre's python? Which in this case is updated distro python.

davidfor · 06-25-2014, 01:43 AM

Yes, that was badly phrased. The plugin doesn't have its own version of Python. It is dependent on the version of Python included with calibre.

Rains · 06-25-2014, 08:55 PM

Quote:

Originally Posted by davidfor

Rain: Where did you try to configure the plugin from? The toolbar button or the plugin list?

I'd tried both from the plugin list and the toolbar button and the result was the same.

Digital_Restrict · 06-29-2014, 01:11 AM

I am trying to use this plugin but I'm encountering an error message. I wonder if someone is still providing support for this apparently glorious plugin? If I get a reply, I will post the exact error message and jobs log, and all the relevant details. I would love to be able to use this plugin ! Thanks !

PeterT · 06-29-2014, 01:16 AM

Davidfor is supporting it....

davidfor · 06-29-2014, 02:24 AM

Quote:

Originally Posted by Digital_Restrict

I am trying to use this plugin but I'm encountering an error message. I wonder if someone is still providing support for this apparently glorious plugin? If I get a reply, I will post the exact error message and jobs log, and all the relevant details. I would love to be able to use this plugin ! Thanks !

Yes, post the error and any information that you think could help.

06-20-2014, 12:00 PM	#2
pedrogaza Junior Member Posts: 8 Karma: 112156 Join Date: Dec 2013 Device: Kobo Mini	Export annotations to Kobo Hi, Would it possible to export annotations to Kobo ? For the ADE annotations it is not a problem, but for annotations stored in Kobo database, it is more difficult to manage it by hand. I wait for this function since long time... I do not know how to program a plugin, so if I can't find a way to do this before this summer, I will make it in bash script. Pierre

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[GUI Plugin] KindleUnpack - The Plugin	DiapDealer	Plugins	495	10-19-2024 07:06 AM
[GUI Plugin] Open With	kiwidude	Plugins	403	04-01-2024 09:39 AM
[GUI Plugin] Annotations (closed)	GRiker	Plugins	68	06-17-2014 07:11 AM
[GUI Plugin] KiNotes	-axel-	Plugins	0	07-14-2013 07:39 PM
[GUI Plugin] Plugin Updater Deprecated	kiwidude	Plugins	159	06-19-2011 01:27 PM

06-24-2014, 04:01 PM	#6
eschwartz Ex-Helpdesk Junkie Posts: 19,421 Karma: 85397180 Join Date: Nov 2012 Location: The Beaten Path, USA, Roundworld, This Side of Infinity Device: Kindle Touch fw5.3.7 (Wifi only)	I do know that according to your error message [isfrozen: False] you do not seem to be running the version that came from Kovid, but are instead using a distro calibre. It is generally recommended to use the official calibre build. Most distros do not update as frequently as calibre does (weekly) and Kovid prefers to have one self-contained package to support. The plugin does work on linux -- I use it.

06-25-2014, 12:04 AM	#7
Rains Junior Member Posts: 7 Karma: 10 Join Date: Jun 2014 Device: Kindle Paperwhite 2	You're right. I just removed the version I had installed (which wasn't too old, 1.40) and installed the binary package from Calibre's website and now the plugin works. Thanks.

06-25-2014, 01:43 AM	#11
davidfor Grand Sorcerer Posts: 24,905 Karma: 47303822 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	Yes, that was badly phrased. The plugin doesn't have its own version of Python. It is dependent on the version of Python included with calibre.

06-29-2014, 01:11 AM	#13
Digital_Restrict Junior Member Posts: 8 Karma: 10 Join Date: Apr 2014 Location: Sherbrooke, QC Device: Kindle3, Android, Win7x64	I am trying to use this plugin but I'm encountering an error message. I wonder if someone is still providing support for this apparently glorious plugin? If I get a reply, I will post the exact error message and jobs log, and all the relevant details. I would love to be able to use this plugin ! Thanks !

06-29-2014, 01:16 AM	#14
PeterT Grand Sorcerer Posts: 12,751 Karma: 75000002 Join Date: Nov 2007 Location: Toronto Device: Libra H2O, Libra Colour	Davidfor is supporting it....

Advert

Advert