[Metadata Source Plugin] BOL.com (NL)

[Pr.BarnArt]

Originally Posted by willempie

kan geen contact meer maken met BOL.COM. om gegevens te importeren naar Calibre.

I don't have problems connecting and retrieving data.
If you have problems, please add a book and author name

[willempie]

Kan in Calibre geen gegevens meer binnenhalen via Bol.nl.

[willempie]

Kan geen gegevens van boeken binnen halen via BOL.COM met Calibre.
Ook al heb ik het isbn nummer ingevoerd en druk ik op metagegevens invoeren krijg ik de boodschap: Fout: geen zoekresultaten. Kan geen boeken vinden die overeenkomen met uw zoekopdracht enz.
Kunt u mij helpen met dit vervelende probleem?
Alvast bedankt.
M.v.g. Wim Kuijlen

[Pr.BarnArt]

Originally Posted by willempie

Kan geen gegevens van boeken binnen halen via BOL.COM met Calibre.
Ook al heb ik het isbn nummer ingevoerd en druk ik op metagegevens invoeren krijg ik de boodschap: Fout: geen zoekresultaten. Kan geen boeken vinden die overeenkomen met uw zoekopdracht enz.
Kunt u mij helpen met dit vervelende probleem?
Alvast bedankt.
M.v.g. Wim Kuijlen

I have sent you a pm.

[janvm]

Hi Pr.BarnArt,
I'd like to inform you that plugin reports this error:
[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired
hope you can look into it,
kind regards

calibre, version 6.28.1
FOUT: Geen zoekresultaten gevonden: <p>Kan geen boeken vinden die overeenkomen met uw zoekopdracht. Probeer de zoekopdracht <b>minder specifiek</b> te maken. Gebruik bijvoorbeeld alleen de achternaam van de auteur en een enkel onderscheidend woord uit de titel.<p>Klik op 'Details weergeven' om het volledige logbestand weer te geven.

Running identify query with parameters:
{---knip---}
Using plugins: BOL_NL (5, 1, 3)
The log from individual plugins is below

****************************** BOL_NL (5, 1, 3) ******************************
Found 0 results
Downloading from BOL_NL took 0.08600211143493652
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
Plugin BOL_NL failed
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1282, in request
File "http\client.py", line 1328, in _send_request
File "http\client.py", line 1277, in endheaders
File "http\client.py", line 1037, in _send_output
File "http\client.py", line 975, in send
File "http\client.py", line 1454, in connect
File "ssl.py", line 512, in wrap_socket
File "ssl.py", line 1070, in _create
File "ssl.py", line 1341, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:997)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\identify.py", line 47, in run
File "calibre_plugins.BOL_NL.__init__", line 302, in identify
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 28, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:997)>

************************************************** ******************************
The identify phase took 0.21 seconds
The longest time (0.086002) was taken by: BOL_NL
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

[Pr.BarnArt]

Originally Posted by janvm

Hi Pr.BarnArt,
[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired

You have had this problem before, way back on 2016,24 march , see your post here https://www.mobileread.com/forums/showthread.php?
p=3286763&highlight=ssl#post3286763

The problem is not related to the plugin . It has to do with valid certificates , which seems missing on your computer. Do not know what operating system you use ( osX, windows or Linux)?

Originally Posted by JimmXinu

SSL problems are generally not the plugins fault. On windows they tend to be issues with the OS cert base.

Take a look at the solution from this earlier report of a similar problem.

and your solution was

Originally Posted by janvm

mine is windows 8.1
I made sure that ALL (optional) updates are installed, that didn't solve the SSL-verification-failed troubles.

Started certlm.msc from the command line
Cleared the profile (certlm.msc|opties|Bestanden verwijderen), and now the plugin returns info from the BOL-plugin.

I'm cluesless what caused the error to be honest, anyway, it works, yeah :-)

https://www.mobileread.com/forums/sh...sl#post3289531

[janvm]

This error is apparently due to an expired root certificate from Let’s Encrypt that might be stored in your Windows.

Calibre uses the Mechanize library to create a browser object and downloads pages using that. That object uses the root certificates from Windows and so is affected by the expired root certificate. The browsers have their own certificate store and so they are unaffected.

To delete the expired certificate:

Open the Certificates Manager by starting certmgr.msc. This shows the certificates in the stores on your Windows.
In the left pane, choose Intermediate Certification Authorities -> Certificates.
In the right pane, choose the R3 certificate from Let’s Encrypt. Make sure that its Expiration Date is in the past. If so, delete it.
Close the Certificates Manager.

After this, Calibre should be able to download the news.

source: https://codeyarns.com/tech/2022-03-1...html#gsc.tab=0

works for me

[leokennis]

Hi! Since some time the plugin fails to find book covers from Bol, I get this error in the log:

****************************** BOL_NL Covers ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36')]
Failed to download valid cover
Took 1.3092751502990723 seconds
No cached cover found, running identify
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
BOL_NL url: 'https://www.bol.com/nl/nl/p/de-nadagen/9200000091698478/'
Error parsing cover for url: 'https://www.bol.com/nl/nl/p/de-nadagen/9200000091698478/'
Traceback (most recent call last):
File "calibre_plugins.BOL_NL.worker", line 203, in parse_details
self.cover_url = self.parse_cover(root)
File "calibre_plugins.BOL_NL.worker", line 965, in parse_cover
raw = response.decode('utf-8', errors='replace')
UnboundLocalError: local variable 'response' referenced before assignment

No cover found

************************************************** ******************************

[Pr.BarnArt]

Originally Posted by leokennis

Hi! Since some time the plugin fails to find book covers from Bol, I get this error in the log:

Can you try again, I myself have no problems getting the cover

[willempie]

Running identify query with parameters:
{'title': 'Huwelijk als prijs', 'authors': ['Madeleine Ker'], 'identifiers': {'isbn': '9789034706195'}, 'timeout': 30}
Using plugins: BOL_NL (5, 1, 3)
The log from individual plugins is below

****************************** BOL_NL (5, 1, 3) ******************************
Found 0 results
Downloading from BOL_NL took 0.19214987754821777
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
Plugin BOL_NL failed
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1286, in request
File "http\client.py", line 1332, in _send_request
File "http\client.py", line 1281, in endheaders
File "http\client.py", line 1041, in _send_output
File "http\client.py", line 979, in send
File "http\client.py", line 1458, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1108, in _create
File "ssl.py", line 1379, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1006)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre\ebooks\metadata\sources\identify.py", line 47, in run
File "calibre_plugins.BOL_NL.__init__", line 302, in identify
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 28, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1006)>

************************************************** ******************************
The identify phase took 0.20 seconds
The longest time (0.192150) was taken by: BOL_NL
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds

[Pr.BarnArt]

Originally Posted by willempie

Running identify query with parameters:
{'title': 'Huwelijk als prijs', 'authors': ['Madeleine Ker'], 'identifiers': {'isbn': '9789034706195'}, 'timeout': 30}
Using plugins: BOL_NL (5, 1, 3)
The log from individual plugins is below

****************************** BOL_NL (5, 1, 3) ******************************
Found 0 results
Downloading from BOL_NL took 0.19214987754821777
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
Plugin BOL_NL failed
File "ssl.py", line 1379, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1006)

File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1006)>

Did you try this https://www.mobileread.com/forums/sh...&postcount=502 ?

[Lehkz]

@Pr.BarnArt, is the plugin broken? For me it stopped working suddenly, unable to retrieve any metadata info from Bol.com using ISBN numbers. Is it still working for everyone? Below is the Download Log.

Any idea why it stopped working for me? I removed the plugin, restarted everything and then installed it again but it is still not working.

Running identify query with parameters:
{'title': 'Het raadsel literatuur', 'authors': ['Karina van Dalen-Oskam'], 'identifiers': {}, 'timeout': 30}
Using plugins: BOL_NL (5, 1, 3), Google (1, 1, 1), Amazon.com (1, 3, 10)
The log from individual plugins is below

****************************** BOL_NL (5, 1, 3) ******************************
Found 0 results
Downloading from BOL_NL took 0.34008002281188965
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
Plugin BOL_NL failed
Traceback (most recent call last):
File "calibre/ebooks/metadata/sources/identify.py", line 47, in run
File "calibre_plugins.BOL_NL.__init__", line 302, in identify
response = br.open_novisit(query, timeout=timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "mechanize/_mechanize.py", line 241, in open_novisit
File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 403: Forbidden

************************************************** ******************************

****************************** Google (1, 1, 1) ******************************
Found 1 results
Downloading from Google took 0.6695940494537354


---
Title : Het raadsel literatuur: is literaire kwaliteit meetbaar?
Author(s) : Karina van Dalen-Oskam & Klazina Harmke Dalen-Oskam
Publisher : Amsterdam University Press
Languages : nld
Published : 2021-10-15T16:21:30.504467+00:00
Identifiers : googleg3FzgEACAAJ, isbn:9789463724975
Comments : <p>Wat is literatuur? Is literaire kwaliteit meetbaar? Karina van Dalen-Oskam vroeg duizenden lezers welke romans ze recent hadden gelezen, wat ze ervan vonden, hoe ze oordeelden over de kwaliteit en waar ze hun oordeel op baseerden. Deze oordelen worden vergeleken met de resultaten van een doormeting van 401 moderne Nederlandse en vertaalde romans met behulp van tekstanalysesoftware. Door meningen en fragmenten uit romans met elkaar te vergelijken wordt duidelijk wat een boek moet hebben om literair gevonden te worden. Genre heeft een meetbare invloed: boeken gelabeld als Literaire roman hebben grotere kans op hoge scores voor literaire kwaliteit dan Spanning of Romantiek. Gender speelt op verschillende manieren eveneens een rol. Ook het taalgebruik in de romans en het prestige van de auteur zijn van belang. Het gebruik van tekstanalysemethoden uit de computationele literatuurwetenschap leidt op deze manier tot nieuwe inzichten in oordelen én vooroordelen over het raadsel literatuur. Bron: Flaptekst, uitgeversinformatie.</p>
Making query: https://books.google.com/books/feeds...ewability=none

************************************************** ******************************

****************************** Amazon.com (1, 3, 10) ******************************
Found 0 results
Downloading from Amazon.com took 4.009262800216675
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:126.0) Gecko/20100101 Firefox/126.0
Server: auto
Making bing query: https://www.bing.com/search?q=Het+ra...www.amazon.com
Downloading details from: https://cc.bingj.com/cache.aspx?q=He...LPucbbMG71TVob
Ignoring result: Dictionaries of Medieval Germanic Languages: A Survey of Current Lexicographical Projects as its title does not match
Downloading details from: https://cc.bingj.com/cache.aspx?q=He...W7WitpJtg4QSRc
Ignoring result: Bijbels Lexicon: Woorden en Uitdrukkingen Uit De Bijbel in Het Nederlands Van Nu as its title does not match
Downloading details from: https://cc.bingj.com/cache.aspx?q=He...3S70VvK2_f4LQf
Ignoring result: The Bloomsbury Handbook to the Digital Humanities as its title does not match

************************************************** ******************************
The identify phase took 4.07 seconds
The longest time (4.009263) was taken by: Amazon.com
Merging results from different sources
We have 1 merged results, merging took: 0.00 seconds



Starting cover download for: Het raadsel literatuur: is literaire kwaliteit meetbaar?
Query: Het raadsel literatuur ['Karina van Dalen-Oskam'] {'google': 'pg3FzgEACAAJ', 'isbn': '9789463724975'}

****************************** BOL_NL Covers ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36')]
Failed to download valid cover
Took 0.36072301864624023 seconds
No cached cover found, running identify
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
Failed to download cover from BOL_NL
Traceback (most recent call last):
File "calibre/ebooks/metadata/sources/covers.py", line 46, in run
File "calibre_plugins.BOL_NL.__init__", line 561, in download_cover
self.identify(log, rq, abort, title=title, authors=authors,
File "calibre_plugins.BOL_NL.__init__", line 302, in identify
response = br.open_novisit(query, timeout=timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "mechanize/_mechanize.py", line 241, in open_novisit
File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 403: Forbidden

************************************************** ******************************

****************************** Amazon.com Covers ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36 Edg/125.0.0.0'), ('Accept', 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8'), ('Upgrade-insecure-requests', '1'), ('Referer', 'https://www.bing.com/search?q=%289789463724975+or+978-9463724975%29+site%3Awww.amazon.com')]
Failed to download valid cover
Took 3.947514057159424 seconds
No cached cover found, running identify
User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36 Edg/125.0.0.0
Server: auto
Making bing query: https://www.bing.com/search?q=%28978...www.amazon.com
Downloading details from: https://cc.bingj.com/cache.aspx?q=%2...uUO_K28TmoM0RX
Ignoring result: Educated: A Memoir as its title does not match
Downloading details from: https://cc.bingj.com/cache.aspx?q=%2...O2BWuKBlaqxjgI
Ignoring result: Siddhartha as its title does not match
Downloading details from: https://cc.bingj.com/cache.aspx?q=%2...tGpRB_vUkbtEoy
Ignoring result: Psychological Science as its title does not match
No cover found

************************************************** ******************************

****************************** Open Library Covers ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.0.0 Safari/537.36')]
Failed to download valid cover
Took 1.9073486328125e-06 seconds

************************************************** ******************************

[Lehkz]

Also on Linux Mint Calibre is unable to retrieve anything from Bol.com using the plug-in.

Running identify query with parameters:
{'title': 'De geschiedenis van mijn seksualiteit', 'authors': ['Tobi Lakmaker'], 'identifiers': {'isbn': '9789493168640', 'amazon': 'B08VJ4ZZT1', 'google': 'eb3gzQEACAAJ'}, 'timeout': 30}
Using plugins: BOL_NL (5, 1, 3), Google (1, 1, 1), Amazon.com (1, 3, 10)
The log from individual plugins is below

****************************** BOL_NL (5, 1, 3) ******************************
Found 0 results
Downloading from BOL_NL took 1.5191314220428467
Querying: https://www.bol.com/nl/s/?searchtext...text=media_all
Plugin BOL_NL failed
Traceback (most recent call last):
File "/usr/lib/calibre/calibre/ebooks/metadata/sources/identify.py", line 47, in run
self.plugin.identify(self.log, self.rq, self.abort, **self.kwargs)
File "calibre_plugins.BOL_NL.__init__", line 302, in identify
response = br.open_novisit(query, timeout=timeout)
File "/usr/lib/python3/dist-packages/mechanize/_mechanize.py", line 241, in open_novisit
return self._mech_open(
File "/usr/lib/python3/dist-packages/mechanize/_mechanize.py", line 313, in _mech_open
raise response
mechanize._response.get_seek_wrapper_class..httper ror_seek_wrapper: HTTP Error 403: Forbidden

[Pr.BarnArt]

Originally Posted by Lehkz

Also on Linux Mint Calibre is unable to retrieve anything from Bol.com using the plug-in.

The plugin is ok, I get the results you search for without errors.
Maybe it is a cloudfare issue. Dont know if bol.nl is deploying that.
Cloudfare issues are difficukt to tackle, besides installing extra software like flaresolverr, the pugin must be rewritten. I didnot do that before norevhave i test it . I had te deprecate The plugin bol.de for the same reason, some time before.

[Lehkz]

Could they "target" cloudflare only to me, my IP? I am still unable to use the plug-in. It fails each time. I also tried using a VPN but same result.