[Metadata Source Plugin] Kobo Metadata

[DNSB]

Originally Posted by NotSimone

I did actually find one book that had two separate entries in the kobo store but with the same isbn. The plugin did not like that every much but it was the only one out of the thousand or so I've tagged so I'm not too fussed.

I ran into an ISBN issue once with a library loan that downloaded the wrong ebook from Kobo. Evidently some of their indie authors are adding ISBNs to their books and these can be the same as a legitimately issued ISBN.

[theducks]

Originally Posted by DNSB

I ran into an ISBBN issue once with a library loan that downloaded the wrong ebook from Kobo. Evidently some of their indie authors are adding ISBNs to their books and these can be the same as a legitimately issued ISBN.

Not surprising
Fake UPC on imported (grocery) goods was a pain.
Some of the fakes were even in the wrong family (the first digit). The store would call, It won't take (or find at checkout) when we enter these items.
Some of the reason is $$ to register your Publisher #. Others is just ignorance that the code needs to be unique (or not likely to ever be seen at that type of business: Walmart types make this less possible)
And then, there are printing errors. Books issued with the wrong UPC (Bookman).

[ownedbycats]

Originally Posted by theducks

And then, there are printing errors. Books issued with the wrong UPC (Bookman).

I have a physical book somewhere that has one. The ISBN gets me a completely different book from a different author (same publisher, at least). The copyright page had the right one.

[JSWolf]

Yes, it is available in the US. https://www.kobo.com/us/en/ebook/dawn-136

It does download the cover correctly when I manually add the ISBN to the ID fiield.

Here is the log.

Spoiler:

Starting cover download for: Dawn
Query: Dawn ['Octavia E. Butler'] {}

****************************** Barnes & Noble Covers ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36')]
Downloaded cover: 459x700
Took 3.248767137527466 seconds
No cached cover found, running identify
Querying: https://www.barnesandnoble.com/s?sto...Octavia+Butler
match location: 'https://www.barnesandnoble.com/w/dawn-octavia-e-butler/1001891191?ean=9781538753712'
B&N url: https://www.barnesandnoble.com/w/daw...=9781538753712
Downloading cover from: http://prodimage.images-bn.com/lf?source=url[file:images/Images/pimages/3712/9781538753712_p0.jpg]&sink

************************************************** ******************************

****************************** Kindle hi-res covers Covers ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko')]
Failed to download valid cover
Took 3.299517869949341 seconds
ASIN not present in metadata
Goodreads id not present in metadata
ISBN not present in metadata
Searching Goodreads for book: https://www.goodreads.com/search?q=D...avia+E.+Butler
Fetching book details: https://www.goodreads.com/book/show/...ccU5iAx&rank=1
Cover URLs: []

************************************************** ******************************

****************************** Kobo Metadata Covers ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36')]
Downloaded cover: 1809x2560
Took 1.69828462600708 seconds
KoboMetadata::download_cover: No cached url found, running identify
KoboMetadata::identify: title: Dawn, authors: ['Octavia E. Butler'], identifiers: {}
KoboMetadata::identify: Searching with query: Dawn Octavia Butler
KoboMetadata::identify: Searching for book with url: https://www.kobo.com/us/en/search?qu...Octavia+Butler
KoboMetadata::identify: Looking up metadata with url: https://www.kobo.com/us/en/ebook/the...octavia-butler
KoboMetadata::_lookup_metadata: Got title: The Role of Nature in the Works of Octavia Butler
KoboMetadata::_lookup_metadata: Got authors: ['Robin Rockensüß']
KoboMetadata::_lookup_metadata: Got publisher: GRIN Verlag
KoboMetadata::_lookup_metadata: Got pubdate: 2008-12-09 00:00:00+00:00
KoboMetadata::_lookup_metadata: Got isbn: 9783640228645
KoboMetadata::_lookup_metadata: Got language: English
KoboMetadata::_lookup_metadata: Got tags: {'Drama', 'Anthologies', 'Nonfiction', 'Entertainment'}
KoboMetadata::_lookup_metadata: Got comments: b'
Examination Thesis from the year 2008 in the subject American Studies - Literature, grade: 1,3, University of Dortmund, 67 entries in the bibliography, language: English, abstract: The science fiction (SF) writer Octavia Estelle Butler (1947-2006) was a pioneer in many ways. She won several Hugo and Nebula awards and was critically acclaimed as the most successful and most gifted female African-American author in a genre that is still mostly dominated by white males. Butler had been publishing stories since the early 1970s, imaginatively addressing issues such as slavery, race and gender in a science fiction environment - including elements of time traveling as in Kindred (1979) and telepathy and extraterrestrials in the Patternist series (1976-1984), which is made up of five novels and was republished in 2007 as the compilation Seed to Harvest. The Patternist stories already contain references to biological alterations of bodies and somatic mutations. 1987 marks the publication of Dawn, the first volume of the Xenogenesis triology which was also republished after Butler\'s death in the compilation Lilith\'s Brood. The series advances the idea of biological engineering to modern genetics in the same year when a committee of the National Academy of Sciences stated that organisms altered or created by the combination of genes between species pose no hazards to the natural environment and are \'virtually risk free or have risk-to-benefit ratios well within acceptable bounds\' (Schmeck 1987). Within the next two years, Dawn was followed by the sequels Adulthood Rites (1988) and Imago (1989). The two novels continued the scenario of a post-apocalyptic civilization and a world controlled by peaceful, yet intrusive extraterrestrial hybrids. In the trilogy Butler considered the overall consequences for nature, humanity and civilization by extrapolating from actual scientific and social developments. This approach can also be detected in the near-future dystopia of the Parable series.
\n
\r\n '
KoboMetadata::_lookup_metadata: Got cover: https://cdn.kobo.com/book-images/fb8...via-butler.jpg
KoboMetadata::_check_title_blacklist: blacklisted title words: {''}
KoboMetadata::_check_tag_blacklist: blacklisted tags: blacklisted_tags

************************************************** ******************************

****************************** Google Images Covers ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36')]
Failed to download valid cover
Took 0.38666629791259766 seconds
Search URL: https://www.google.com/search?as_st=...,iar:t,ift:jpg
No images found for, title: 'Dawn' and authors: ['Octavia E. Butler']

************************************************** ******************************

****************************** Amazon.com Covers ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:84.0) Gecko/20100101 Firefox/84.0'), ('Accept', 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8'), ('Upgrade-insecure-requests', '1'), ('Referer', 'https://www.google.com/search?q=Dawn+Octavia+Butler+site%3Awww.amazon.com ')]
Downloaded cover: 328x500
Took 5.174229145050049 seconds
No cached cover found, running identify
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:84.0) Gecko/20100101 Firefox/84.0
Server: auto
Making google query: https://www.google.com/search?q=Dawn...www.amazon.com
Ignoring 'Images for Dawn Octavia Butler site:www.amazon.com' as it has no cached page
Ignoring 'Images for Dawn Octavia Butler site:www.amazon.com' as it has no cached page
Ignoring 'Images for Dawn Octavia Butler site:www.amazon.com' as it has no cached page
Ignoring 'Images for Dawn Octavia Butler site:www.amazon.com' as it has no cached page
Ignoring 'Images for Dawn Octavia Butler site:www.amazon.com' as it has no cached page
Ignoring div with no main result link
Ignoring 'xenogenesis trilogy' as it has no cached page
Ignoring 'xenogenesis trilogy' as it has no cached page
Ignoring 'xenogenesis trilogy' as it has no cached page
Downloading details from: https://webcache.googleusercontent.c...&ct=clnk&gl=uk
Found image: https://m.media-amazon.com/images/I/...,350_QL50_.jpg
Downloading details from: https://webcache.googleusercontent.c...&ct=clnk&gl=uk
Failed to find product description for url: 'https://webcache.googleusercontent.com/search?q=cache:Y99SkQZofcUJ:https://www.amazon.com/Dawn-Octavia-...&ct=clnk&gl=uk'
Downloading details from: https://webcache.googleusercontent.c...&ct=clnk&gl=uk
Found image: https://m.media-amazon.com/images/I/...,350_QL50_.jpg
Downloading cover from: https://m.media-amazon.com/images/I/517jA3V7ZeL.jpg

************************************************** ******************************

[JSWolf]

Originally Posted by ownedbycats

I have a physical book somewhere that has one. The ISBN gets me a completely different book from a different author (same publisher, at least). The copyright page had the right one.

I once download an eBook from overdrive that had the wrong ISBN. It was an eBook from Tor.

[ownedbycats]

Possible bug: Incorrect ISBNs prevent metadata download.

Steps to replicate.

1. Set metadata providers to only Kobo Metadata.

2. Set country to Canada. (May not be necessary.)

3. Add this book:

Title: Halo: Contact Harvest
Author: Joseph Staten
ID: kobo:halo-contact-harvest-8

4. Attempt to download metadata. It should fetch it.

5. Now add isbn:9784878920110 to the IDs field. (Note: This is actually an ISBN for a completely different book; a character has a military service number '48789-20114' which coincidentally is a valid ISBN-10. ISBN Extract picked it up and my metadata processing converted it to the 13 form.)

6. Now the metadata fails to download.

The Kobo Books plugin downloads the metadata with an incorrect ISBN.

[NotSimone]

Originally Posted by ownedbycats

Possible bug: Incorrect ISBNs prevent metadata download.

Steps to replicate.

1. Set metadata providers to only Kobo Metadata.

2. Set country to Canada. (May not be necessary.)

3. Add this book:

Title: Halo: Contact Harvest
Author: Joseph Staten
ID: kobo:halo-contact-harvest-8

4. Attempt to download metadata. It should fetch it.

5. Now add isbn:9784878920110 to the IDs field. (Note: This is actually an ISBN for a completely different book; a character has a military service number '48789-20114' which coincidentally is a valid ISBN-10. ISBN Extract picked it up and my metadata processing converted it to the 13 form.)

6. Now the metadata fails to download.

The Kobo Books plugin downloads the metadata with an incorrect ISBN.

This is intended behaviour. The Kobo id tag comes from the previous plugin but I'm using the ISBN to id the books instead. Tbh I have noticed a small number of edge cases where this doesn't work completely correctly (Kobo having the wrong isbn or two books with the same isbn), but this seems fairly rare.

I actually ran into a very similar issue with the ISBN extractor plugin. One of the series I was trying to tag had every single ISBN from the series in the copyright section for some reason so every book in that series got the exact same ISBN. I suggest you let this plugin write the ISBN id for you instead.

[theducks]

WHY! are you using Get ISBN on a EPUB? They were published with the correct one in the books metadata.

The plugin (my interpretation) was mostly for PDF and other documents that do not have well defined metadata (identifiers)

As you discovered, you run the risk of corrupting valid metadata.

FWIW My Service number was 7 digits: nnn-nn-nn then some idjut decide stenciling my SSAN all over my gear was a brilliant idea

[ownedbycats]

Originally Posted by theducks

WHY! are you using Get ISBN on a EPUB? They were published with the correct one in the books metadata.

There was no ISBN when I added it to Calibre, and I ran my 'cleanup' action chain (which includes the ISBN-extract) before downloading any metadata.

[JSWolf]

How well does ISBN Extract work when the eBook has multiple ISBN (Hardcover, paperback, eBook)?

[ownedbycats]

Originally Posted by JSWolf

How well does ISBN Extract work when the eBook has multiple ISBN (Hardcover, paperback, eBook)?

It depends on the publisher. I noticed that the plugin checks the ISBNs in reverse, so if the eBook ISBN is the last one listed it'll be properly selected. I usually do a manual check while checking the chapter count.

[iupiter]

Could you add a feature that allows as to select a primary country but also multiple (or all) other countries for cover search?
I find, that a single country often fails but if I manually search with US, Canada and Germany I often find the missing covers, but i have to change the country each time.

[iupiter]

Originally Posted by iupiter

Could you add a feature that allows as to select a primary country but also multiple (or all) other countries for cover search?
I find, that a single country often fails but if I manually search with US, Canada and Germany I often find the missing covers, but i have to change the country each time.

This was one of the covers I was not able to find at all, even though it is from kobo.
https://cdn.kobo.com/book-images/d31...-star-wars.jpg

[ownedbycats]

How do I remove the 'Kobo Metadata' from the identifiers of every book that has an ISBN?

[theducks]

identifiers:"=isbn:" and  identifiers:"=kobo:"

Select all
Now you should be able to make a temp VL, use the tag browser to remove those