[Metadata Source Plugin] Goodreads

[kiwidude]

Originally Posted by Falafelteller

When downloading metadata and putting 'Goodreads:60929' in the id field and clearing everything else. metadata.db books table gets the timestamp field wrong showing '0101-01-01 00:00:00+00:00' instead of the added time. Reproducible on macOS.
Timestamp field was correct before downloading metadata from GR

I have no clue what the Timestamp field is or why you would be even looking at it in metadata.db. On Windows I've just done a metadata download on an empty book with that goodreads id and it all worked fine. Whatever your issues are this plugin specifically is not the cause of them.

[Falafelteller]

Originally Posted by kiwidude

I have no clue what the Timestamp field is or why you would be even looking at it in metadata.db. On Windows I've just done a metadata download on an empty book with that goodreads id and it all worked fine. Whatever your issues are this plugin specifically is not the cause of them.

I spun up a windows VM to test
I can reproduce it on a fresh calibre install, Installed no plugin but goodreads.
The Bug does not occur if you add an empty book but if you drag an epub into calibre (still has proper timestamp), then edit metadata individually, clear everything and under id enter 'goodreads:60929' and download metadata. This happens with 1 out of 10 books I add this way.
Removing the goodreads plugin and downloading metadata fixes the issue. It only occurs if goodreads plugin is installed.

[dunhill]

Originally Posted by Falafelteller

I spun up a windows VM to test
I can reproduce it on a fresh calibre install, Installed no plugin but goodreads.
The Bug does not occur if you add an empty book but if you drag an epub into calibre (still has proper timestamp), then edit metadata individually, clear everything and under id enter 'goodreads:60929' and download metadata. This happens with 1 out of 10 books I add this way.
Removing the goodreads plugin and downloading metadata fixes the issue. It only occurs if goodreads plugin is installed.

I've never had any problems with the goodreads metadata plugin.
In the ids field it is correct to put the goodreads id which in this way marks the book when using the goodreads sync plugin

[Falafelteller]

Originally Posted by dunhill

I've never had any problems with the goodreads metadata plugin.
In the ids field it is correct to put the goodreads id which in this way marks the book when using the goodreads sync plugin

You are missing the point.

[Blue Muffin]

Hi!
I seem to have a problem with this plugin, namely when I try to download metadata if repeatedly says it "... failed to dowload metadata". I was last doing that sometime last month and dont recall any problems. Calibre was updated two times I think since then but even reverting to previous versions didnt help. Removing/adding plugin doesnt help either.

I got this error details:

calibre, version 7.17.0
BŁĄD: Brak pasujących wyników: <p>Nie udało się znaleźć żadnej książki pasującej do zapytania. Spróbuj podać <b>mniej szczegółowe</b> dane. Możesz na przykład podać tylko nazwisko autora i jedno słowo z tytułu.<p>Aby zobaczyć więcej informacji, naciśnij „Pokaż szczegóły”.

(^using polish version, this here basically says "no matching results found, no book fitting the search and to try adding less specific data, which I did with ony "BURIED" from title and the last name of author, same reslut)

Running identify query with parameters:
{'title': 'Buried Too Deep', 'authors': ['Karen Rose'], 'identifiers': {}, 'timeout': 30}
Using plugins: Goodreads (1, 8, 2)
The log from individual plugins is below

****************************** Goodreads (1, 8, 2) ******************************
Found 0 results
Downloading from Goodreads took 3.097860336303711
identify - start. title=Buried Too Deep, authors=['Karen Rose'], identifiers={}
Querying: https://www.goodreads.com/search?sea...e=books&search[query]=Buried+Too+Deep+Karen+Rose
No goodreads id via ISBN
Found match: 0 Buried Too Deep (New Orleans, #3; Romantic Suspense, #30) ['Karen Rose']
_parse_search_results: trying to get editions...
_parse_search_results: looping on editions_text=7 editions
_parse_search_results: editions_url= https://www.goodreads.com/work/editi...ic-suspense-30
Examining up to 7 editions: https://www.goodreads.com/work/editi...ic-suspense-30
_parse_editions_for_book: Start
title: 'buried too deep (new orleans, #3; romantic suspense, #30)'
title: 'buried too deep (romantic suspense, #30; new orleans, #3)'
title: 'buried too deep (romantic suspense, #30; new orleans, #3)'
title: 'buried too deep (romantic suspense, #30; new orleans, #3)'
title: 'buried too deep (romantic suspense, #30; new orleans, #3)'
Get details attempt #1
Goodreads book url: 'https://www.goodreads.com/book/show/202101988-buried-too-deep'
Get details attempt #1
Goodreads book url: 'https://www.goodreads.com/book/show/202241027-buried-too-deep'
Get details attempt #1
Goodreads book url: 'https://www.goodreads.com/book/show/202286287-buried-too-deep'
Get details attempt #1
Goodreads book url: 'https://www.goodreads.com/book/show/208983161-buried-too-deep'
Get details attempt #1
Goodreads book url: 'https://www.goodreads.com/book/show/208983142-buried-too-deep'
Failed to make details query: 'https://www.goodreads.com/book/show/202101988-buried-too-deep'
Traceback (most recent call last):
File "calibre_plugins.goodreads.worker", line 81, in get_details
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 403: Forbidden

Failed to make details query: 'https://www.goodreads.com/book/show/202241027-buried-too-deep'
Traceback (most recent call last):
File "calibre_plugins.goodreads.worker", line 81, in get_details
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 403: Forbidden

Failed to make details query: 'https://www.goodreads.com/book/show/202286287-buried-too-deep'
Traceback (most recent call last):
File "calibre_plugins.goodreads.worker", line 81, in get_details
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 403: Forbidden

Failed to make details query: 'https://www.goodreads.com/book/show/208983161-buried-too-deep'
Traceback (most recent call last):
File "calibre_plugins.goodreads.worker", line 81, in get_details
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 403: Forbidden

Failed to make details query: 'https://www.goodreads.com/book/show/208983142-buried-too-deep'
Traceback (most recent call last):
File "calibre_plugins.goodreads.worker", line 81, in get_details
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 403: Forbidden

************************************************** ******************************
The identify phase took 3.21 seconds
The longest time (3.097860) was taken by: Goodreads
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds



Any help with this please? Is this from the plugin end or from Goodreads itself maybe...?

I really dont want to fall bck to amazon - it doesnt seem to get series and tags and lot of other stuff I got from goodreads...

Cheers <3

[kiwidude]

Originally Posted by Blue Muffin

Hi!
I seem to have a problem with this plugin, namely when I try to download metadata if repeatedly says it "... failed to dowload metadata". I was last doing that sometime last month and dont recall any problems. Calibre was updated two times I think since then but even reverting to previous versions didnt help. Removing/adding plugin doesnt help either.

Turn off the "Scan multiple editions for title/author searches (slower)" option in the configuration dialog for the goodreads plugin.

While it is working ok for me, I can imagine the Goodreads website perhaps seeing those http requests as potential suspicious traffic they should block.

[Bozana]

Originally Posted by kiwidude

Turn off the "Scan multiple editions for title/author searches (slower)" option in the configuration dialog for the goodreads plugin.

While it is working ok for me, I can imagine the Goodreads website perhaps seeing those http requests as potential suspicious traffic they should block.

It's been iffy in the last few days. And today, it refused to work. I did as suggested but it's not that either. I even tried VPN... it's not that either. This started not long after I installed the new Calibre. So... my question is:

Is it broken or blocked?

Error

Running identify query with parameters:
{'title': 'Caelum', 'authors': [I deleted the author's name'], 'identifiers': {'amazon': 'I removed asin', 'mobi-asin': 'I removed asin'}, 'timeout': 30}
Using plugins: Goodreads (1, 8, 2)
The log from individual plugins is below

****************************** Goodreads (1, 8, 2) ******************************
Found 0 results
Downloading from Goodreads took 0.19893956184387207
[GoodreadsMoreTags] Integration active
identify - start. title=Caelum, authors=['Serena Akeroyd'], identifiers={'amazon': 'I removed asin', 'mobi-asin': 'I removed asin'}
get_goodreads_id_using_asin - identifier_name=amazon, identifier=I removed asin
get_goodreads_id_using_api - identifiers=I removed asin
Querying using autocomplete API: https://www.goodreads.com/book/auto_...ormat=json&q=I removed asin
Failed to make identify query: 'https://www.goodreads.com/book/auto_complete?format=json&q=I removed asin'
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1286, in request
File "http\client.py", line 1332, in _send_request
File "http\client.py", line 1281, in endheaders
File "http\client.py", line 1041, in _send_output
File "http\client.py", line 979, in send
File "http\client.py", line 1458, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1108, in _create
File "ssl.py", line 1379, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.goodreads.__init__", line 150, in get_goodreads_id_using_api
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 29, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)>

Failed to trying to get Goodreads id using auto_complete API
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1286, in request
File "http\client.py", line 1332, in _send_request
File "http\client.py", line 1281, in endheaders
File "http\client.py", line 1041, in _send_output
File "http\client.py", line 979, in send
File "http\client.py", line 1458, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1108, in _create
File "ssl.py", line 1379, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "calibre_plugins.goodreads.__init__", line 213, in identify
File "calibre_plugins.goodreads.__init__", line 191, in get_goodreads_id_from_identifiers
File "calibre_plugins.goodreads.__init__", line 170, in get_goodreads_id_using_asin
File "calibre_plugins.goodreads.__init__", line 150, in get_goodreads_id_using_api
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 29, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)>

[Terisa de morgan]

Currently, I'm getting "ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006) " every time I try to download data from goodreads. And I'm authorized in the website as I've connected to it in Chrome. Same is happening with FatasticFiction plugin, so I don't know if it's somthing which has been messed in my installation.

[SASSBS]

same getting the SSL error since yesterday

[Wiggo]

Do I understand correctly that you can't sync 'date started' from GR to Calibre?

[SASSBS]

In my case it's from Calibre to Goodreads

[chaley]

Originally Posted by Terisa de morgan

Currently, I'm getting "ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006) " every time I try to download data from goodreads. And I'm authorized in the website as I've connected to it in Chrome. Same is happening with FatasticFiction plugin, so I don't know if it's somthing which has been messed in my installation.

This error says that goodreads is using a new root or intermediate SSL certificate that you don't have. This is a reasonable explanation of the error.

One possible fix on Windows is to open the failing URL in Microsoft Edge. As described here, it will download any new root certificates from a trusted source.

If the above doesn't work then I am out of ideas. It could be that Goodreads is using an invalid certificate, in which case there isn't a fix.

[Terisa de morgan]

Originally Posted by chaley

This error says that goodreads is using a new root or intermediate SSL certificate that you don't have. This is a reasonable explanation of the error.

One possible fix on Windows is to open the failing URL in Microsoft Edge. As described here, it will download any new root certificates from a trusted source.

If the above doesn't work then I am out of ideas. It could be that Goodreads is using an invalid certificate, in which case there isn't a fix.

A couple of things (although it has dissapeared now, I think due to the rubber chicken because I don't know...):

• goodreads wasn't the only source that was failing. Fantastic Fiction was failing with the same error. Kobo and Amazon failed too, with error 503.
• Goodreads was open in my browser (Chrome) and failed too.

As I say, it's solved now after:

• Deactivate and activate again Windows Defecder
• Deactivate the firewall for the dominion
• Close calibre, open Chrome, open goodreads, close Chrome and open calibre
• Add B&N source
• Trye one failing goodreads url with curl (it worked)

No idea which of the previous items (if any) solved the issuye, but it's still solved (fingers crossed).

[Comfy.n]

Originally Posted by chaley

This error says that goodreads is using a new root or intermediate SSL certificate that you don't have. This is a reasonable explanation of the error

Self-Signed Certificate

A self-signed certificate is signed by the entity that generated the certificate rather than a trusted certificate authority. Browsers do not inherently trust self-signed certificates, so they will show the “unable to get local issuer certificate” error. The website needs to install a valid SSL certificate signed by a trusted authority.

I find it funny that google can trust itself using googletrustservices, and goodreads certificate is issued by Amazon, with amazontrust being the certificate authority.

Shouldn't that be considered a self-signed certificate?

Originally Posted by Terisa de morgan

No idea which of the previous items (if any) solved the issuye, but it's still solved (fingers crossed).

I've tried most of those items and also downgrading to Calibre 7.16 from current preview release, as well as the Edge certificate "fix". No joy

B&N works but I miss the ratings and votes from GR.

[kovidgoyal]

If I had to guess it will likely be that *some* GR servers have an invalid certificate and some do not. Depending on which you connect to, you get working or not. Hopefully they will fix it.