06-21-2024, 02:55 PM | #121 |
Junior Member
Posts: 2
Karma: 10
Join Date: Sep 2017
Device: Kobo Libra 2, Boox Page
|
It seems if a search only return 1 result e.g. search with ISBN then Kobo will redirect to the book page instead of the search page, maybe that's the reason?
|
06-23-2024, 07:48 AM | #122 |
Book Enjoyer
Posts: 60
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
I've noticed this too and I think the javascript engine isn't fully loading before it parses the page. I'll have a play around with this in the next few days to see what we can do about it, but in the meantime, retry the search until it goes through.
|
Advert | |
|
06-27-2024, 03:42 PM | #123 |
Enthusiast
Posts: 33
Karma: 102928
Join Date: Apr 2018
Location: France
Device: Kobo Glo (kobo4) / Kobo Libra Colour (kobo11)
|
Hi NotSimone
There is a thing I find very cool in the "Kobo Books" plugin ( https://www.mobileread.com/forums/sh...d.php?t=253838 ) It add a value ( kobo: ) in the ids field of calibre with the ending part of the url on the kobo web site. Example For "Cooking with Wild Game: Volume 24" the plug in adds the id : kobo:cooking-with-wild-game-volume-24 which matchs with the link : https://www.kobo.com/ebook/cooking-w...game-volume-24 Is there any way you can reuse the same thing to match the book in kobo store to get metadata ? thx for the plugin |
06-27-2024, 04:37 PM | #124 | |
Custom User Title
Posts: 9,589
Karma: 65099765
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
There's some issues with the kobo: id that makes NotSimone reluctant to use it:
Quote:
|
|
07-03-2024, 10:03 AM | #125 |
Book Enjoyer
Posts: 60
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
I've just pushed a new version which will retry if it detects a failure to defeat the Cloudflare protection up to 10 times. From just playing around, it seems about half the time it takes 0 attempts, and the other half around 3/4. I haven't seen more than 5 yet though.
Give it a try and let me know how it goes Yep that's pretty much it - the identifier isn't reliable. |
Advert | |
|
07-23-2024, 04:03 AM | #126 |
Member
Posts: 10
Karma: 10
Join Date: Mar 2021
Device: Kobo Libra H2O
|
Unfortunately, this plugin hasn't worked for me in some time. I am currently on v1.6.3 of this plugin on Calibre 7.15, and I am still getting unyielding 403 errors, like the following:
Code:
Running identify query with parameters: {'title': 'Nostalgia', 'authors': ['Mircea Cǎrtǎrescu'], 'identifiers': {}, 'timeout': 30} Using plugins: Kobo Books (1, 10, 2), Google (1, 1, 1), Amazon.com (1, 3, 9) The log from individual plugins is below ****************************** Kobo Books (1, 10, 2) ****************************** Found 0 results Downloading from Kobo Books took 0.17281770706176758 identify - title: "Nostalgia" authors= "['Mircea Cǎrtǎrescu']" create_query - title: "Nostalgia" create_query - after decode title: "Nostalgia" create_query - title_tokens: "['Nostalgia']" Querying: https://www.kobo.com/search?query=Nostalgia+Mircea+C%C7%8Ert%C7%8Erescu&fcmedia=Book&fclanguages=all Failed to make identify query: 'https://www.kobo.com/search?query=Nostalgia+Mircea+C%C7%8Ert%C7%8Erescu&fcmedia=Book&fclanguages=all' Traceback (most recent call last): File "calibre_plugins.kobobooks.__init__", line 222, in identify response = br.open_novisit(query, timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "mechanize/_mechanize.py", line 241, in open_novisit File "mechanize/_mechanize.py", line 313, in _mech_open mechanize._response.get_seek_wrapper_class.<locals>.httperror_seek_wrapper: HTTP Error 403: Forbidden ******************************************************************************** |
07-23-2024, 06:25 AM | #127 |
Resident Curmudgeon
Posts: 76,533
Karma: 136565488
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
I'm not able to download covers from Kobo.
Code:
****************************** Kobo Metadata Covers ****************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:127.0) Gecko/20100101 Firefox/127.0')] Failed to download valid cover Took 3.3782670497894287 seconds KoboMetadata::download_cover: No cached url found, running identify KoboMetadata::get_cover_url: title: The Long Walk, authors: ['Stephen King'], identifiers: {'isbn': '9781501141324'} KoboMetadata::perform_isbn_search: Getting metadata with isbn: 9781501141324 KoboMetadata::perform_query: Searching for book with url: https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - giving up for https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::perform_query: Could not get url: https://www.kobo.com/us/en/search?query=9781501141324&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_cover_url:: No identifier - performing search KoboMetadata::perform_search: Searching with query: The Long Walk Stephen King KoboMetadata::perform_query: Searching for book with url: https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - trying again for https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_webpage: Could not defeat cloudflare protection - giving up for https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::perform_query: Could not get url: https://www.kobo.com/us/en/search?query=The+Long+Walk+Stephen+King&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::get_cover_url:: No search results KoboMetadata::download_cover: Could not get cover Last edited by JSWolf; 07-23-2024 at 06:30 AM. |
07-23-2024, 10:52 AM | #128 |
Grand Sorcerer
Posts: 12,783
Karma: 75641916
Join Date: Nov 2007
Location: Toronto
Device: Libra H2O, Libra Colour
|
The problem is the CloudFlare protection on the web site.
Sent from my Pixel 7a using Tapatalk |
07-23-2024, 11:14 PM | #129 | |
Book Enjoyer
Posts: 60
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
Quote:
Last edited by NotSimone; 07-23-2024 at 11:18 PM. |
|
07-23-2024, 11:16 PM | #130 | |
Book Enjoyer
Posts: 60
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
Quote:
|
|
07-24-2024, 04:56 PM | #131 | |
Resident Curmudgeon
Posts: 76,533
Karma: 136565488
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
Quote:
Enjoy your vacation. |
|
10-28-2024, 01:12 AM | #132 |
Book Enjoyer
Posts: 60
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
Kobo has updated their bot challenge page and renamed isbn to book id - I've updated the plugin to handle this properly. I'm fully expecting them to randomly go fiddling with the pages again so lmk if this doesn't work properly with any pages.
|
10-28-2024, 01:13 AM | #133 | |
Book Enjoyer
Posts: 60
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
Quote:
|
|
11-06-2024, 09:35 PM | #134 |
Member
Posts: 10
Karma: 10
Join Date: Mar 2021
Device: Kobo Libra H2O
|
I'm just here to say that I have found the covers search (and, to a further extent, high resolution covers) far more reliable since the upgrade to 1.7.0. Thank you!
|
11-11-2024, 07:28 AM | #135 |
Book Enjoyer
Posts: 60
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
I noticed that recently its been more difficult to beat the cloudflare bot protection so I've just pushed another update that *should* improve the chances of getting through - its still not a sure thing though unfortunately.
No problem |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
[Metadata Source Plugin] Kobo Books | davidfor | Plugins | 201 | 10-17-2023 12:19 PM |
[Metadata Source Plugin] BOL.com (DE) | Pr.BarnArt | Plugins | 52 | 06-01-2023 05:50 PM |
How do I know which Metadata Source Plugin was called from fetch-ebook-metadata? | eryMpexI | Library Management | 6 | 04-22-2023 09:58 AM |
Read a book's metadata in a Metadata source plugin? | J-H | Development | 2 | 03-30-2021 10:08 AM |
[Metadata Source Plugin] Empty Plugin? (Fake Identifier) | mneimeyer | Plugins | 3 | 11-11-2019 09:07 PM |