01-22-2024, 11:19 AM | #361 | |
Connoisseur
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
|
Quote:
If I knew what I was doing in python, I would try to code up a decent calibre Z39.50 plugin, but I absolutely do not know what I am doing. |
|
02-12-2024, 03:11 PM | #362 |
Junior Member
Posts: 6
Karma: 10
Join Date: Jul 2020
Device: Kobo Glo HD
|
It seems that Classify2 was discontinued on Jan 31st
https://www.oclc.org/go/en/classify-...tinuation.html |
02-16-2024, 10:37 AM | #363 |
Member
Posts: 23
Karma: 10
Join Date: Mar 2022
Device: iPad 8
|
Well that sucks. I was hoping to get back around to this and update the code to handle the last roadblock that arose, but scratch that.
I see that OCLC has added DDC to their Worldcat records, so that will be worth a look. Also, Anna’s Archive screen-scraped Worldcat sometime back and made the data freely available. I’m wondering if they did it before DDc was added or after. |
05-06-2024, 07:34 PM | #364 |
Junior Member
Posts: 1
Karma: 10
Join Date: May 2024
Device: web, kindle
|
LOC Z39.50/SRW/SRU Service?
Maybe the library codes plugin can be changed to use the LOC API for metadata access. The vast majority of books have good LCC codes available, and at least half in my manual testing have also shown DCC codes (via the web interface, not the API).
https://catalog.loc.gov/vwebv/ui/en_...elp/index.html |
05-15-2024, 11:06 PM | #365 | |
Connoisseur
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
|
Quote:
https://www.mobileread.com/forums/sh...14&postcount=5 |
|
05-16-2024, 12:40 PM | #366 | |
Connoisseur
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
|
Quote:
Library Codes generated a query based on LCCN, ISBN, or ISSN that returned a page from the OCLC Classify service, stripped the table inside that page, and used BeautifulSoup to scan that table for markup elements denoting the various custom columns (Dewey, LoC classification, etc). I was trying to figure out how to substitute the loc publicly served query page into that beautiful soup protocol that DaltonST coded, but the markup is xml and I didn’t figure out how to do that. However, DaltonST chose to implement a scraper for a resource that wasn’t optimized for data interchange - namely, whatever html generated by Classify. However, there *are* much more convenient and interpretable data formats that can be called via various services. The Z 39.50 protocol was adapted for service through a Web interface and this protocol is called SRU. The fields are standardized, there are many SRU and Marcxml Services out there can be par by regular expression to extract the data from the labeled fields Long time ago, more than 11 years, a gentleman In Germany coded the metadata source plugin SRU, Which does exactly that. The parser doesn’t use Beautiful soup, it hits the SRU server with an extremely fast recall time, and the SRU service provides many more data fields than were present on the old class webpage. In addition, SRU Returns, As One of the fields , a static marcxml url that provides the MARCXML extremely efficiently, and I would almost prefer to parse that, But I have no idea how to do that. It does embed a LOC link as an identifier in the calibre book record. I am trying to do is perform a transplant of the search language and configuration in SRU into Library codes, in order to return the parsed Significant data fields into library codes python routine for updating the custom column. I’ve never done python before, taught myself everything I needed to learn in order to update SRU for calibre 6.17, and I would welcome any help that people might provide. SRU as written cannot pass custom column information as a metadata source plugin - I tried that already. Any suggestions? |
|
05-24-2024, 11:41 AM | #367 |
Junior Member
Posts: 6
Karma: 10
Join Date: Mar 2017
Device: k4, nook touch
|
I have no help to give, but I do have cheers, eagerness, and hope! Thanks for continuing to work on a solution.
|
06-13-2024, 08:51 PM | #368 |
Connoisseur
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
|
Development efforts update:
DaltonST posted two older versions of Library Codes using the Classify API, and I am dissecting them in order to replace the deprecated Classify lookup with an alternative using SearchRetrieve(over)Url interface language at the Library of Congress SRU server. I have roughed out two working scripts that return LCCN (card catalog entries) and Dewey and Library of Congress classification codes from fields '010', '050', and '082' of the MARC21 specification implemented in marcxml at the permalink "http://lccn.loc.gov/[LCCNgoeshere]/marcxml" and now I have to process the subject fields found in the '65x' fields. I may end up parsing MODS instead to make my life easier. I'm trying to recover the VIAF and FAST functionality from the subject and name authorities file at the library of congress name and subject authority databases on the SRU servers. |
07-11-2024, 06:45 PM | #369 |
Connoisseur
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
|
WORKING LIBRARY CODES UPDATE
I am happy to report I have modified the Classify scraper to query the SRU server at the library of congress for MODS 3.8 xml and from that return DDC and LCC fields. It's not perfect - I haven't been able to recover the FAST subject heading information yet, and there is no VIAF or author data or oclc-owi information yet, but this is finally working again.
|
07-12-2024, 04:29 AM | #370 | |
The Grand Mouse 高貴的老鼠
Posts: 72,749
Karma: 311192104
Join Date: Jul 2007
Location: Norfolk, England
Device: Kindle Voyage
|
Quote:
That way your new, working, plugin would be available through the calibre plugin interface. |
|
07-12-2024, 08:51 AM | #371 | |
Grand Sorcerer
Posts: 12,904
Karma: 76440364
Join Date: Nov 2007
Location: Toronto
Device: Libra H2O, Libra Colour
|
Quote:
Sent from my Pixel 7a using Tapatalk |
|
07-12-2024, 08:55 AM | #372 |
Resident Curmudgeon
Posts: 76,963
Karma: 138588794
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
Why not just replace the version in the first post? It's been done in other threads when mods were made that fix something or added new feature(s).
|
07-12-2024, 11:34 AM | #373 |
Connoisseur
Posts: 53
Karma: 130472
Join Date: May 2011
Device: Onyx Boox M90, M92 (*3),M96, N96,I86ml,C67ml,Kepler,Poke,Poke2,Nova3
|
thanks for the suggestion, I have posted a new thread.
|
07-12-2024, 12:04 PM | #374 | |
The Grand Mouse 高貴的老鼠
Posts: 72,749
Karma: 311192104
Join Date: Jul 2007
Location: Norfolk, England
Device: Kindle Voyage
|
Quote:
New thread here: https://www.mobileread.com/forums/sh...d.php?t=362404 I've also added a link in the first post of this thread. A one-off update I can do. |
|
Tags |
ddc, dewey decimal, lcc, library of congress, oclc |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
[GUI Plugin] KindleUnpack - The Plugin | DiapDealer | Plugins | 495 | 10-19-2024 07:06 AM |
[GUI Plugin] SmartEject | JimmXinu | Plugins | 105 | 08-15-2024 11:29 AM |
[GUI Plugin] Consolidate All Library Metadata (CALM) | DaltonST | Plugins | 333 | 12-15-2023 09:40 PM |
[GUI Plugin] Astro-ph | iatheia | Plugins | 14 | 07-26-2015 12:41 AM |
[GUI Plugin] Plugin Updater **Deprecated** | kiwidude | Plugins | 159 | 06-19-2011 01:27 PM |