Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 01-22-2024, 11:19 AM   #361
davidjoseph1
Connoisseur
davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.
 
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
Quote:
Originally Posted by iienderii View Post
Anyone out there have a functioning alternative in the meantime? I'm hopeful that this plugin can be brought back into action, but if not, what else are you using to tie LCC and/or DCC codes to your Calibre library books? If at all possible, I'm hoping to not have to do it manually.
I was playing around with Tellico, which can import and export to calibre, and which can do Z39.50 queries, but it's not as beautifully robust as Library Codes has been. The boolean search language isn't flexible at all. this is Tellico 3.4.4 on Ubuntu 22.04

If I knew what I was doing in python, I would try to code up a decent calibre Z39.50 plugin, but I absolutely do not know what I am doing.
davidjoseph1 is offline   Reply With Quote
Old 02-12-2024, 03:11 PM   #362
webtroter
Junior Member
webtroter began at the beginning.
 
Posts: 6
Karma: 10
Join Date: Jul 2020
Device: Kobo Glo HD
It seems that Classify2 was discontinued on Jan 31st

https://www.oclc.org/go/en/classify-...tinuation.html
webtroter is offline   Reply With Quote
Old 02-16-2024, 10:37 AM   #363
SidJnsn
Member
SidJnsn began at the beginning.
 
Posts: 23
Karma: 10
Join Date: Mar 2022
Device: iPad 8
Well that sucks. I was hoping to get back around to this and update the code to handle the last roadblock that arose, but scratch that.
I see that OCLC has added DDC to their Worldcat records, so that will be worth a look. Also, Anna’s Archive screen-scraped Worldcat sometime back and made the data freely available. I’m wondering if they did it before DDc was added or after.
SidJnsn is offline   Reply With Quote
Old 05-06-2024, 07:34 PM   #364
kokeyama
Junior Member
kokeyama began at the beginning.
 
Posts: 1
Karma: 10
Join Date: May 2024
Device: web, kindle
LOC Z39.50/SRW/SRU Service?

Maybe the library codes plugin can be changed to use the LOC API for metadata access. The vast majority of books have good LCC codes available, and at least half in my manual testing have also shown DCC codes (via the web interface, not the API).

https://catalog.loc.gov/vwebv/ui/en_...elp/index.html
kokeyama is offline   Reply With Quote
Old 05-15-2024, 11:06 PM   #365
davidjoseph1
Connoisseur
davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.
 
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
Quote:
Originally Posted by kokeyama View Post
Maybe the library codes plugin can be changed to use the LOC API for metadata access. The vast majority of books have good LCC codes available, and at least half in my manual testing have also shown DCC codes (via the web interface, not the API).

https://catalog.loc.gov/vwebv/ui/en_...elp/index.html
I tried to update Library Codes to use the modern LC Catalog language, but I found an old metadata source plugin called SRU that did the same thing, and got it working.

https://www.mobileread.com/forums/sh...14&postcount=5
davidjoseph1 is offline   Reply With Quote
Old 05-16-2024, 12:40 PM   #366
davidjoseph1
Connoisseur
davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.
 
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
Quote:
Originally Posted by davidjoseph1 View Post
I tried to update Library Codes to use the modern LC Catalog language, but I found an old metadata source plugin called SRU that did the same thing, and got it working.

https://www.mobileread.com/forums/sh...14&postcount=5
To follow up on this brief post:

Library Codes generated a query based on LCCN, ISBN, or ISSN that returned a page from the OCLC Classify service, stripped the table inside that page, and used BeautifulSoup to scan that table for markup elements denoting the various custom columns (Dewey, LoC classification, etc). I was trying to figure out how to substitute the loc publicly served query page into that beautiful soup protocol that DaltonST coded, but the markup is xml and I didn’t figure out how to do that.

However, DaltonST chose to implement a scraper for a resource that wasn’t optimized for data interchange - namely, whatever html generated by Classify. However, there *are* much more convenient and interpretable data formats that can be called via various services. The Z 39.50 protocol was adapted for service through a Web interface and this protocol is called SRU. The fields are standardized, there are many SRU and Marcxml Services out there can be par by regular expression to extract the data from the labeled fields


Long time ago, more than 11 years, a gentleman In Germany coded the metadata source plugin SRU, Which does exactly that. The parser doesn’t use Beautiful soup, it hits the SRU server with an extremely fast recall time, and the SRU service provides many more data fields than were present on the old class webpage. In addition, SRU Returns, As One of the fields , a static marcxml url that provides the MARCXML extremely efficiently, and I would almost prefer to parse that, But I have no idea how to do that. It does embed a LOC link as an identifier in the calibre book record.

I am trying to do is perform a transplant of the search language and configuration in SRU into Library codes, in order to return the parsed Significant data fields into library codes python routine for updating the custom column.

I’ve never done python before, taught myself everything I needed to learn in order to update SRU for calibre 6.17, and I would welcome any help that people might provide. SRU as written cannot pass custom column information as a metadata source plugin - I tried that already.


Any suggestions?
davidjoseph1 is offline   Reply With Quote
Old 05-24-2024, 11:41 AM   #367
teditor
Junior Member
teditor began at the beginning.
 
Posts: 6
Karma: 10
Join Date: Mar 2017
Device: k4, nook touch
I have no help to give, but I do have cheers, eagerness, and hope! Thanks for continuing to work on a solution.
teditor is offline   Reply With Quote
Old 06-13-2024, 08:51 PM   #368
davidjoseph1
Connoisseur
davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.
 
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
Development efforts update:

DaltonST posted two older versions of Library Codes using the Classify API, and I am dissecting them in order to replace the deprecated Classify lookup with an alternative using SearchRetrieve(over)Url interface language at the Library of Congress SRU server.

I have roughed out two working scripts that return LCCN (card catalog entries) and Dewey and Library of Congress classification codes from fields '010', '050', and '082' of the MARC21 specification implemented in marcxml at the permalink "http://lccn.loc.gov/[LCCNgoeshere]/marcxml" and now I have to process the subject fields found in the '65x' fields. I may end up parsing MODS instead to make my life easier.

I'm trying to recover the VIAF and FAST functionality from the subject and name authorities file at the library of congress name and subject authority databases on the SRU servers.
davidjoseph1 is offline   Reply With Quote
Old 07-11-2024, 06:45 PM   #369
davidjoseph1
Connoisseur
davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.
 
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
WORKING LIBRARY CODES UPDATE

I am happy to report I have modified the Classify scraper to query the SRU server at the library of congress for MODS 3.8 xml and from that return DDC and LCC fields. It's not perfect - I haven't been able to recover the FAST subject heading information yet, and there is no VIAF or author data or oclc-owi information yet, but this is finally working again.
Attached Files
File Type: zip Library_Codes_SRU-working.zip (310.5 KB, 553 views)
davidjoseph1 is offline   Reply With Quote
Old 07-12-2024, 04:29 AM   #370
pdurrant
The Grand Mouse 高貴的老鼠
pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.
 
pdurrant's Avatar
 
Posts: 72,750
Karma: 311192104
Join Date: Jul 2007
Location: Norfolk, England
Device: Kindle Voyage
Quote:
Originally Posted by davidjoseph1 View Post
I am happy to report I have modified the Classify scraper to query the SRU server at the library of congress for MODS 3.8 xml and from that return DDC and LCC fields. It's not perfect - I haven't been able to recover the FAST subject heading information yet, and there is no VIAF or author data or oclc-owi information yet, but this is finally working again.
As the original author hasn't been active on MobileRead for a year now, and this looks like more than a minor modification, perhaps you could start a new plugin thread, with a link back to this one, of course.

That way your new, working, plugin would be available through the calibre plugin interface.
pdurrant is online now   Reply With Quote
Old 07-12-2024, 08:51 AM   #371
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
PeterT's Avatar
 
Posts: 12,904
Karma: 76440364
Join Date: Nov 2007
Location: Toronto
Device: Libra H2O, Libra Colour
Quote:
Originally Posted by pdurrant View Post
As the original author hasn't been active on MobileRead for a year now, and this looks like more than a minor modification, perhaps you could start a new plugin thread, with a link back to this one, of course.



That way your new, working, plugin would be available through the calibre plugin interface.
Wouldn't this also need a new name for the plug-in to differentiate it from the existing one?

Sent from my Pixel 7a using Tapatalk
PeterT is offline   Reply With Quote
Old 07-12-2024, 08:55 AM   #372
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 76,965
Karma: 138588794
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
Quote:
Originally Posted by PeterT View Post
Wouldn't this also need a new name for the plug-in to differentiate it from the existing one?

Sent from my Pixel 7a using Tapatalk
Why not just replace the version in the first post? It's been done in other threads when mods were made that fix something or added new feature(s).
JSWolf is online now   Reply With Quote
Old 07-12-2024, 11:34 AM   #373
davidjoseph1
Connoisseur
davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.davidjoseph1 can tell if an avocado is ripe without touching it.
 
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
thanks for the suggestion, I have posted a new thread.
davidjoseph1 is offline   Reply With Quote
Old 07-12-2024, 12:04 PM   #374
pdurrant
The Grand Mouse 高貴的老鼠
pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.pdurrant ought to be getting tired of karma fortunes by now.
 
pdurrant's Avatar
 
Posts: 72,750
Karma: 311192104
Join Date: Jul 2007
Location: Norfolk, England
Device: Kindle Voyage
Quote:
Originally Posted by JSWolf View Post
Why not just replace the version in the first post? It's been done in other threads when mods were made that fix something or added new feature(s).
It rather depends on whether the function has changed or not, and whether the maintainer seems keen to continue with tweaks.

New thread here: https://www.mobileread.com/forums/sh...d.php?t=362404

I've also added a link in the first post of this thread. A one-off update I can do.
pdurrant is online now   Reply With Quote
Reply

Tags
ddc, dewey decimal, lcc, library of congress, oclc


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 495 10-19-2024 07:06 AM
[GUI Plugin] SmartEject JimmXinu Plugins 105 08-15-2024 11:29 AM
[GUI Plugin] Consolidate All Library Metadata (CALM) DaltonST Plugins 333 12-15-2023 09:40 PM
[GUI Plugin] Astro-ph iatheia Plugins 14 07-26-2015 12:41 AM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 01:27 PM


All times are GMT -4. The time now is 05:41 PM.


MobileRead.com is a privately owned, operated and funded community.