![]() |
#106 |
Book Enjoyer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 56
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
I’ve noticed that cloudflare seems to let certain request through if you’ve done a similar request through the browser already - but only if it’s from the same device. I think there’s some kind of whitelist period after you hit it with a browser, which makes this incredibly annoying to test with actually.
Taking the cookie from a browser and sending along with the calibre plugin request doesn’t seem to work either ![]() Re: Firefox - it wouldn’t be able to fill in the calibre metadata. If all you wanted was the cover, it’s not too difficult to grab it manually from the page with the browser. |
![]() |
![]() |
![]() |
#107 | |
Resident Curmudgeon
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 75,652
Karma: 134254544
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
Quote:
Last edited by JSWolf; 06-05-2024 at 06:39 AM. |
|
![]() |
![]() |
Advert | |
|
![]() |
#108 |
Book Enjoyer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 56
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
As an update - I've gotten past the cloudflare bot protection with cloudscraper. All it needed was a different javascript interpreter and it started going. Hopefully I'll get a fixed version out in the next few days after I figure out how to get everything to import.
|
![]() |
![]() |
![]() |
#109 | |
Resident Curmudgeon
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 75,652
Karma: 134254544
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
Quote:
|
|
![]() |
![]() |
![]() |
#110 |
Book Enjoyer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 56
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
I just updated with version 1.6.0 which should be able to bypass the cloudflare protection. It involves a decent refactor so let me know if something doesn't work.
And also note - if you recently updated, you may need to wait a little bit for cloudflare to let you in. If it doesn't work, give it a day and try again later. |
![]() |
![]() |
Advert | |
|
![]() |
#111 | |
Resident Curmudgeon
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 75,652
Karma: 134254544
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
Quote:
Code:
****************************** Kobo Metadata Covers ****************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36')] Failed to download valid cover Took 1.3365850448608398 seconds KoboMetadata::download_cover: No cached url found, running identify KoboMetadata::get_cover_url: title: Exit Strategy, authors: ['Martha Wells'], identifiers: {'isbn': '9781250185464'} KoboMetadata::get_cover_url: Getting metadata with isbn: 9781250185464 KoboMetadata::identify: Searching for book with url: https://www.kobo.com/us/en/search?qu...clanguages=all KoboMetadata::parse_search_page: Detected old search page KoboMetadata::parse_search_page: Detected old search page KoboMetadata::parse_search_page: Detected old search page KoboMetadata::get_cover_url: Searching with query: Exit Strategy Martha Wells KoboMetadata::identify: Searching for book with url: https://www.kobo.com/us/en/search?qu...clanguages=all KoboMetadata::parse_search_page: Detected old search page KoboMetadata::parse_search_page: Detected old search page KoboMetadata::parse_search_page: Detected old search page KoboMetadata::get_cover_url:: No search results KoboMetadata::download_cover: Could not get cover ******************************************************************************** |
|
![]() |
![]() |
![]() |
#112 |
Enthusiast
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 33
Karma: 102928
Join Date: Apr 2018
Location: France
Device: Kobo Glo (kobo4) / Kobo Libra Colour (kobo11)
|
Hi,
Also seems to have problems, launching the research but when I want to check the metadata nothing appends, no windows and log seem weird. Metadata fetch fail with an error "Could not get url: h" But in the cover search part plugin seems to have the info Code:
#################### Log for Cooking with Wild Game: Volume 24 #################### Running identify query with parameters: {'title': 'Cooking with Wild Game: Volume 24', 'authors': ['EDA'], 'identifiers': {'isbn': '9781718334465', 'kobo': 'cooking-with-wild-game-volume-24'}, 'timeout': 30} Using plugins: Kobo Metadata (1, 6, 0) The log from individual plugins is below ****************************** Kobo Metadata (1, 6, 0) ****************************** Found 0 results Downloading from Kobo Metadata took 3.777388095855713 KoboMetadata::identify: title: Cooking with Wild Game: Volume 24, authors: ['EDA'], identifiers: {'isbn': '9781718334465', 'kobo': 'cooking-with-wild-game-volume-24'} KoboMetadata::identify: Getting metadata with isbn: 9781718334465 KoboMetadata::identify: Searching for book with url: https://www.kobo.com/fr/en/search?query=9781718334465&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::identify: Searching with query: Cooking with Wild Game: Volume 24 EDA KoboMetadata::identify: Searching for book with url: https://www.kobo.com/fr/en/search?query=Cooking+with+Wild+Game%3A+Volume+24+EDA&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::parse_search_page: Detected new search page KoboMetadata::identify: Looking up metadata with url: h KoboMetadata::get_webpage: Got exception while opening url: Invalid URL 'h': No scheme supplied. Perhaps you meant https://h? KoboMetadata::identify: Could not get url: h ******************************************************************************** The identify phase took 3.81 seconds The longest time (3.777388) was taken by: Kobo Metadata Merging results from different sources We have 0 merged results, merging took: 0.00 seconds Failed to download metadata for Cooking with Wild Game: Volume 24 ****************************** Kobo Metadata Covers ****************************** Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36 Edg/125.0.0.0')] Downloaded cover: 1400x2056 Took 3.557833671569824 seconds KoboMetadata::download_cover: No cached url found, running identify KoboMetadata::get_cover_url: title: Cooking with Wild Game: Volume 24, authors: ['EDA'], identifiers: {'isbn': '9781718334465', 'kobo': 'cooking-with-wild-game-volume-24'} KoboMetadata::get_cover_url: Getting metadata with isbn: 9781718334465 KoboMetadata::identify: Searching for book with url: https://www.kobo.com/fr/en/search?query=9781718334465&fcmedia=Book&pageNumber=1&fclanguages=all KoboMetadata::parse_book_page: Got title: Cooking with Wild Game: Volume 24 KoboMetadata::parse_book_page: Got authors: ['Eda'] KoboMetadata::parse_book_page: Got series: Cooking with Wild Game KoboMetadata::parse_book_page: Got series_index: 24 KoboMetadata::parse_book_page: Got publisher: J-Novel Club KoboMetadata::parse_book_page: Got pubdate: 2024-06-03 00:00:00+00:00 KoboMetadata::parse_book_page: Got isbn: 9781718334465 KoboMetadata::parse_book_page: Got language: English KoboMetadata::parse_book_page: Got tags: {'Science Fiction & Fantasy', 'Comics Graphic Novels & Manga', 'Fiction & Literature', 'Fantasy', 'Manga'} KoboMetadata::parse_book_page: Got comments: b' Things have been exciting recently for the people of the forest’s edge: Shin Ruu has been crowned the victor in the Genos swordsmanship tournament, Lem Dom has earned the right to walk the path toward becoming a hunter, and the smaller clans surrounding the Fa have held their joint festival of the hunt at the start of a new break period. \n With all the time off they now have, the clans are now working together to finally show the last holdouts at the forest’s edge how to make delicious food. But will everyone they’re trying to teach appreciate their efforts? Also, what has happened to Myme and Mikel? And perhaps most importantly of all, when a familiar face returns to Genos for the first time in half a year, will things with Vina Ruu work out the way he hopes? \n See all this and more in the exciting twenty-fourth volume of Cooking with Wild Game! \n \r\n ' KoboMetadata::parse_book_page: Got cover: https://cdn.kobo.com/book-images/ca6295db-71c9-42a0-9f1e-7c8b18298a14/cooking-with-wild-game-volume-24.jpg ******************************************************************************** Last edited by nAhu; 06-18-2024 at 03:02 PM. |
![]() |
![]() |
![]() |
#113 | ||
Book Enjoyer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 56
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
Quote:
Quote:
|
||
![]() |
![]() |
![]() |
#114 |
Book Enjoyer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 56
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
Ahh actually I found the issue and it should be fixed now in 1.6.2.
|
![]() |
![]() |
![]() |
#115 |
Enthusiast
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 33
Karma: 102928
Join Date: Apr 2018
Location: France
Device: Kobo Glo (kobo4) / Kobo Libra Colour (kobo11)
|
|
![]() |
![]() |
![]() |
#116 |
Resident Curmudgeon
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 75,652
Karma: 134254544
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
|
![]() |
![]() |
![]() |
#117 |
Book Enjoyer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 56
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
|
![]() |
![]() |
![]() |
#119 | |
Book Enjoyer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 56
Karma: 704770
Join Date: Sep 2023
Device: Kobo Libra 2
|
Quote:
![]() |
|
![]() |
![]() |
![]() |
#120 |
Junior Member
![]() Posts: 2
Karma: 10
Join Date: Sep 2017
Device: Kobo Libra 2, Boox Page
|
Sometimes the plugin gets the "Please turn on Javasciprt and Cookie" page when searching for a book, is there a fix for it or am I doing something wrong?
|
![]() |
![]() |
![]() |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
[Metadata Source Plugin] Kobo Books | davidfor | Plugins | 201 | 10-17-2023 11:19 AM |
[Metadata Source Plugin] BOL.com (DE) | Pr.BarnArt | Plugins | 52 | 06-01-2023 04:50 PM |
How do I know which Metadata Source Plugin was called from fetch-ebook-metadata? | eryMpexI | Library Management | 6 | 04-22-2023 08:58 AM |
Read a book's metadata in a Metadata source plugin? | J-H | Development | 2 | 03-30-2021 09:08 AM |
[Metadata Source Plugin] Empty Plugin? (Fake Identifier) | mneimeyer | Plugins | 3 | 11-11-2019 08:07 PM |