[GUI Plugin] LibraryThing Match

[Wiggo]

Originally Posted by Bradles

I've uploaded a new version which fixes the 403 Forbidden error. As I suspected, Cloudflare was blocking the request due to the user agent, so it was simply a matter of adding a header to the request.

calibre should recognize there's an updated version in the fullness of time.

Error is back

[Bradles]

Thanks for bringing that to my attention Wiggo. It seems the user agent needed to be changed again. I've uploaded a new version that should fix the error. If not, let me know...

[Wiggo]

Works again.

Thank you so much, Bradles!

[tlwright]

Not sure if it's from the update or an older version but I'm unable to load my LT books to match in Calibre. Gives me an error

" JSONDecodeError('Expecting value: line 1 column 1 (char 0)')

I went to make sure my username was correct and I was signed into the site. I have my settings as a screenshot if that helps.

[Bradles]

Originally Posted by tlwright

JSONDecodeError

Some possibilities with this error:

• Max results is not filled in.
• Your config file is empty or corrupt. Physically check the file in the calibre config file location, which for me is

  C:\Users\(username)\AppData\Roaming\calibre\plugins

• There's a non-printing character in a book title. try changing to the "sample" library (user: sample, collection empty and taglist empty) and doing a test connection

If no luck I'll look into it further.

[tlwright]

Sorry it took me so long to reply, I hadn't opened calibre in a week, and didn't remember to check here earlier.

{
  "librarything_coll": "All collections",
  "librarything_id_column": "#librarything_id",
  "librarything_key": "not required",
  "librarything_rating_column": "#librarything_rating",
  "librarything_sort": "author,title",
  "librarything_taglist": "",
  "librarything_user": "tlwright",
  "max_results": "100",
  "probable_match_threshold": "90",
  "use_calibre_identifier": true
}

is the contents of my file, and I've attached a screenshot of the error message plus what it looks like after I click the LT match icon in my toolbar.

[Bradles]

tlwright:

I strongly suspect that the issue is weird characters in one or more book titles or author fields in LT. For example, you have this book in your collection:



Note that foreign language characters (Unicode) and accents (ë, õ, â, etc.) should be fine.

The method I am using to retrieve your LT books is "all or nothing". I either get all the books or nothing at all, so I can't "check" the books for errors before displaying.

I was able to retrieve your books using the tag Cooking, so there's nothing wrong with your configuration or library.

I'll reach out to the calibre "Development" forum and see if there's any way to improve the situation.

In the meantime, if you're really set on using LT Match, you could check your LT catalog for weird characters in the title or author fields. Exporting your catalog to Excel might be the easiest way to do this.

[tlwright]

It looks like I need to do a little cleanup in my library, lol. Thank you! I'll do some housekeeping, and see if that fixes the issue. LT did some funky things to a previous GR import, so that may be the cause.

[Bradles]

Yeah, you're not the first user to face this issue...

I did some more research and found that LibraryThing returns no results if any book in the result set has corrupt data. The response code is 200 (OK) but 0 bytes are returned to LT Match and that's why I'm getting an error trying to interpret 0 bytes as if it was data. I can handle this scenario better in terms of showing a more informative error message, but that doesn't help you much.

I've reached out to the LibraryThing developers, to see if the situation can be improved from their end. I'm not expecting to hear back until after the holiday weekend.

Update: LT Support are not able to offer support as the LT APIs are "officially" disabled (but really only not supported) while they work on the LT redesign. (5 years and counting.)

[slk33]

Hi,
I did downloaded and ran a match a couple of days ago. I've since then added some books that were in Calibre to LT and went to do a match again and it's not loading any of the recently added books.
Originally, I had 2717 books in LT. Today I have 2732, but it's still only loading 2717.
Suggestions?
Thanks.

[JSWolf]

Originally Posted by slk33

Hi,
I did downloaded and ran a match a couple of days ago. I've since then added some books that were in Calibre to LT and went to do a match again and it's not loading any of the recently added books.
Originally, I had 2717 books in LT. Today I have 2732, but it's still only loading 2717.
Suggestions?
Thanks.

LibraryThing is using Cloudflare and that could be blocking you. Since @Bradles has not been on since July 21, I suggest you PM him with your problem.

But before you can PM, you have to go to the Feedback forum and find the thread to request PMs be enabled as you don't have enough posts for PMs to be enabled.

[DNSB]

Originally Posted by JSWolf

LibraryThing is using Cloudflare and that could be blocking you. Since @Bradles has not been on since July 21, I suggest you PM him with your problem.

But before you can PM, you have to go to the Feedback forum and find the thread to request PMs be enabled as you don't have enough posts for PMs to be enabled.

Jon, as near as I can tell, @slk33 already has PM access. Please note that PM access has little if anything to do with the number of posts since looking at the Kobo µSD card requests thread, close to 80% of the first time posters have PMs enabled.

In other words, please check your facts before posting!

[Bradles]

Originally Posted by slk33

Hi,
I did downloaded and ran a match a couple of days ago. I've since then added some books that were in Calibre to LT and went to do a match again and it's not loading any of the recently added books.
Originally, I had 2717 books in LT. Today I have 2732, but it's still only loading 2717.
Suggestions?
Thanks.

Hi slk33,

Please check that your settings in LibraryThing Match "match" the properties of the books you have added:

• LibraryThing collection (I set it to "All collections")
• LibraryThing taglist (optional, but make sure you're not excluding newly added books if it is filled in)
• Max results (make sure it is large enough to return all books)

Also, make sure you're newly added books aren't marked "Private" in LT. LT Match can only see public books in a public catalog.

If still no luck, we'll look into it further...

[slk33]

So I tried it again, without changing anything, and it loaded the newly added books.
Perhaps it has something to do with when the upload it or whatever to Cloudflare?
I'm going to add about 200 more books tonight, as soon as I can figure out how to make a column for the isbn so I can import them.
I'll try to load the new LT list tomorrow and let you know what happens.
Thanks for the prompt response!

[Wiggo]

Hi Bradles

Loading LT books I get this error

<HTTPError 524: ''>

Edit: I don't know why, but it worked on the 4th attempt - sorry

Edit2: Tested a few more times and still works. Must have caught an unfavourable moment earlier