|
|
Thread Tools | Search this Thread |
11-05-2014, 12:00 PM | #1 |
Hack
Posts: 34
Karma: 12
Join Date: Dec 2009
Device: Kobo Aura HD, Kindle Paperwhite
|
Annotations: Capture/Convert Kobo-Kindle (uses OpenWith and Annotations Plugins)
When I started using both a Kobo and a Kindle I still wanted to be able to upload my Annotations to Clippings.io for sorting and tagging...
This python script can be run using the Calibre OpenWith Plugin. It is dependent on Annotations having been imported into a Calibre column by the Annotations Plugin. By default this script searches first for an Annotations column, and failing that for Annotations in the Comments column. It can be configured for any column. By default the script will, when run from within Calibre, generate a .clip file and insert it into the Calibre database. You can change it to any extension, but I chose clip so that I didn't have conflicts with other .txt files. If you stick with the .clip extension you just need to have your OS associate the file extension with your favorite text editor. There are settings in the script such that you can have it write all exported annotations to a directory of your choice and not update the Calibre database at all. This is what I do when I am converting Kobo annotations for uploading to Clippings.io Also, if you run the script from the command line in the directory where your Calibre database is located, it will export all Annotations found in the database. ~~~~~~~~~ In the future I plan to establish an Annotations database that is independent from the Calibre database because I find that with the volatility of news downloads there is the danger of Highlighted Content being lost. There is the possibility that a Kindle's MyClippings.txt could be recreated from exported Annotations such that when books are removed from a Kindle and then copied back to a Kindle, the annotations could be restored (If the MyClippings.txt file is corrupted or deleted). ~~~~~~~~~ I also noticed a question from turelur about storing annotations within ebook files. I'm going to think about this some more, but off the top of my head I would save an ORIGINAL_EPUB, then generate an EPUB with Annotations from a the .clip file I'm currently generating (or in the future a database) and then use something like EPUB MERGE... Last edited by EnergyLens; 11-05-2014 at 01:06 PM. Reason: fixed spelling errors |
11-07-2014, 01:35 AM | #2 |
Member
Posts: 23
Karma: 10
Join Date: Aug 2014
Device: Kindle Paperwhite
|
Wow! That is a very interesting lead! Thanks!
|
Advert | |
|
11-07-2014, 04:34 PM | #3 |
Ex-Helpdesk Junkie
Posts: 19,421
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
Here is an interesting idea.
Perhaps you could crack the format of the Kindle .mbp1/.azw3r/.azw3f files, extract an up-to-date listing of kindle annotations, and convert it to-from a plaintext representation to keep in a custom column. That would allow syncing annotations between Kindle devices at least, without resorting to My Clippings.txt -- which is nice in terms of listing annotations, but would be even nicer if it was incorporated into the book itself. I think the annotations plugin would really benefit from some serious work done in that area, but no one seems to be interested. (Including me sadly though I would be grateful for anyone else's efforts.) |
11-07-2014, 06:25 PM | #4 |
Grand Sorcerer
Posts: 24,905
Karma: 47303822
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
The intention of the Annotations plugin was purely record the annotations from the devices. It has the ability to merge them from multiple devices, but doesn't collect enough information to restore them anywhere. I have never been happy with that, but as my main use for annotations is to mark errors to fix or something to look up when I'm at my PC, I haven't had much desire to do anything
I have thought about it a little, but haven't been happy with anything I could come up with. If the calibre viewer supported annotations, I would probably use that as the method. At the moment, creating a ADE annotations file is the most attractive method. That might be transportable to other RMDSK based readers. One problem I have is keeping the data associated with the book. I haven't come up with a solution that I like. |
11-07-2014, 07:08 PM | #5 |
Grand Sorcerer
Posts: 24,905
Karma: 47303822
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
EnergyLens: Very nice idea. I hadn't seen that clipping service, but I can see a use for it.
A couple of comments. I have to admit I cringed when I saw the code to get the annotations column. But, I'm so used to writing calibre plugins, hadn't thought about other ways to do this. It would be safer to get the name of the annotations column from the annotations configuration. That is plugins/annotations.json in the calibre configuration directory. This would be great as a plugin. Collecting the annotations and adding the file to calibre can be done with no problems. Doing this for all books in the library is easy. And adding something to collect and upload the files to the service would be easy as well. And when I say that, it would actually be natural to add this to the Annotations plugin. That could generate the file when retrieving the annotations. Or an export function could generate them to be saved elsewhere. In any case, if there is something the annotations plugin could do differently that would help, I am willing to consider it. Especially it come in the form of a patch One thing I don't understand is: How does the news downloads affect this? Unless news articles are being annotated on the devices, there shouldn't be an issue. And if they are, it should only be these annotations that are at risk. |
Advert | |
|
11-08-2014, 02:57 AM | #6 |
Hack
Posts: 34
Karma: 12
Join Date: Dec 2009
Device: Kobo Aura HD, Kindle Paperwhite
|
@ eschwartz
I can't even find the .mbp1/.azw3r/.azw3f files, though I only gave it a squiz. @ davidfor I'm really just a hack, and a green one at that. I do annotate news articles on my devices! Doesn't everyone? The reason I see volatility with annotations is that I follow a number of blogs that have voluminous commentary, which is constantly expanding. I typically download the "news" feed once a day, and I want to be sure to capture the highlights/annotations from each download of the same blog entry. Then after a period of time I download an anthology of the blog and want to merge all of the highlights back into to anthology. My best hack (and longest bit of python code) was to automate the interleaving of author/moderator responses at the correct positions (directly following) comments which was necessary to make sense of the content when reading on an eReader where it is impossible to scroll back and forth constantly. (https://www.mobileread.com/forums/sho...d.php?t=249514) I'd be happy if you were inspired to take any ideas from my annotations hack to extend the Annotations Plugin, because as you say it would be natural to add the generate/export function. With regards to News Article Annotations, I've noticed that the Annotations plugin works great with annotations from News "books" that I read on my Kobo, but that it doesn't find annotations for News "books" that I read on my Kindle. Why is that? My long term goal is to enable some serious natural language processing/phrase frequency analysis of my content, initially in the process of capturing content as it is downloaded, then later within arbitrary books in my Calibre database. I'd like to be able to generate Lombardi networks from book bibliographies and other references (URLs/book titles/Authors) I've pulled from web content. Right now I'm just cutting my teeth. P.S. I lived on several bays around Sydney Harbor for a few years in the late '90s. Wonderful memories of riding the ferries to work every day! |
11-08-2014, 04:45 AM | #7 | ||||||
Grand Sorcerer
Posts: 24,905
Karma: 47303822
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
|
Quote:
Quote:
Quote:
Quote:
Quote:
Quote:
|
||||||
11-09-2014, 02:26 PM | #8 | |
Ex-Helpdesk Junkie
Posts: 19,421
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
Quote:
|
|
11-09-2014, 02:28 PM | #9 |
Ex-Helpdesk Junkie
Posts: 19,421
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
|
11-10-2014, 03:40 PM | #10 |
Hack
Posts: 34
Karma: 12
Join Date: Dec 2009
Device: Kobo Aura HD, Kindle Paperwhite
|
|
11-10-2014, 03:47 PM | #11 |
Ex-Helpdesk Junkie
Posts: 19,421
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
|
11-11-2014, 12:42 AM | #12 |
Hack
Posts: 34
Karma: 12
Join Date: Dec 2009
Device: Kobo Aura HD, Kindle Paperwhite
|
Yes, now I know, and now I do! Thanks again. As I said, I'm an old hack (was always the Strategy/BizDev/Marketing guy). It's only about once a decade I undertake a significant coding project. I've got MacVim all tricked out, but just didn't think about Terminal. Thanks again!
|
03-28-2020, 01:04 PM | #13 |
Junior Member
Posts: 1
Karma: 10
Join Date: Mar 2020
Device: Kobo
|
Hi!
Total noob here. When you say, "This python script can be run using the Calibre OpenWith Plugin. It is dependent on Annotations having been imported into a Calibre column by the Annotations Plugin." What do you mean? I've tried installing Python and setting Python.exe as the app to be opened with but....no luck. Can you please talk me through this part of the instructions step by step? I'm looking to create an annotations file to be uploaded to Clippings.io as I've recently switched from Kindle to Kobo but very much like having my annotations with MLA formatting in Evernote, which Clippings.io facilitates. Thanks!! |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Calibre support for Kobo Annotations | timlegge | Kobo Reader | 29 | 09-09-2016 06:48 AM |
new Tool: Convert annotations from Sony Readers to Adobe Digital Editions | spitfire_ch | Reading and Management | 15 | 09-24-2015 03:31 PM |
PRS-T1 Exporting notes: Convert EPUB with annotations to PDF? | martz | Sony Reader | 7 | 11-29-2012 06:34 AM |
Pdf annotations and Kindle annotations | BranMakMorn | Calibre | 0 | 06-25-2011 02:42 PM |
Convert eBookwise 1150 annotations to iLiad? | nekokami | iRex | 8 | 12-22-2006 03:13 PM |