'Get Books' not working for Archive.com

sgulick1 · 03-05-2017, 05:25 PM

I have used the 'Get Books' feature to collect books mainly from Archive.org for several years, but it stopped pulling up anything from Archive.org a few weeks ago. It still gets books from Proj Gutenberg, ManyBooks etc. -the only problem is with Archive.org (I checked, their website is up and running). I tried to 'Get Books' repeatedly over several weeks and updated my Calibre and Firefox versions, but no luck. I have Windows 10. Where might the problem lie?

theducks · 03-05-2017, 06:01 PM

Each site has a unique recipe to scrape the data.
Maybe they changed the site? Then the recipe will need to be revised.

kovidgoyal · 03-06-2017, 12:51 AM

Post a book title/author that does not return results even though you think it should, and I will take a look. Most likely the open search API on the site is broken.

kovidgoyal · 03-06-2017, 01:01 AM

Never mind, I see that a few weeks ago I changed that plugin to use https instead of http -- apparently that is the cause of the problem, I have reverted that change. It now works for me with a couple of test searches.

Try it again in a couple of hours and you should be fine.

sgulick1 · 03-06-2017, 07:08 PM

Unfortunately I am still not pulling anything from Archive.org, I rebooted and tried again just now. For analysis, it may be helpful to mention some related issues I noticed in Get Books page. I normally select these stores: P.Gutenberg, Archive.org, Amazon Kindle, Google Books, ManyBooks. I am pulling nothing from either Archive.org or Google Books, and of the other 3 stores, prices are showing only for ManyBooks. For test purposes, for title/author/keyword (one per search event) I am entering Oliver Twist/Dickens/England and/or Odyssey/Homer/Greece. Thanks for looking into this, Calibre is great!

kovidgoyal · 03-06-2017, 10:17 PM

amazon stores are broken because amazon is blocking calibre, that is unlikely to be fixed anytime soon. As for archive.org, in addition to the https problem their opensearch server also seems to be broken, for example go to:

http://bookserver.archive.org/catalo...earch?q=austen

and you get an internal server error. Report it to them and hopefully they will fix it.

kovidgoyal · 03-06-2017, 11:05 PM

This should fix the Google Books plugin: https://github.com/kovidgoyal/calibr...6a0d7b0f53448e

kovidgoyal · 03-06-2017, 11:32 PM

I was wrong about amazon, the problem is a change in the website markup, not blocking, this shoudl fix it: https://github.com/kovidgoyal/calibr...c82133370e5933

sgulick1 · 03-07-2017, 05:50 PM

Regarding Archive.org issue, I reported it at their website as you suggested, am awaiting response.

03-05-2017, 05:25 PM	#1
sgulick1 Junior Member Posts: 3 Karma: 10 Join Date: Mar 2017 Location: Colorado Device: pc/ kindle paperwhite	'Get Books' not working for Archive.com I have used the 'Get Books' feature to collect books mainly from Archive.org for several years, but it stopped pulling up anything from Archive.org a few weeks ago. It still gets books from Proj Gutenberg, ManyBooks etc. -the only problem is with Archive.org (I checked, their website is up and running). I tried to 'Get Books' repeatedly over several weeks and updated my Calibre and Firefox versions, but no luck. I have Windows 10. Where might the problem lie?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Has anyone tried reading on mobile, books from Archive.org or Google books?	automa	General Discussions	15	12-03-2012 07:53 PM
Add Amazon Archive books to Calibre?	Xanne	Library Management	2	08-08-2012 01:19 PM
Internet Archive preserves paper books	wallcraft	General Discussions	24	06-18-2011 02:17 PM
Is There A Way To Archive Books Downloaded	Barry8416	Sony Reader	10	08-19-2009 01:41 PM
Removing books from the Archive?	aormond	Amazon Kindle	12	03-07-2009 04:36 PM

03-05-2017, 06:01 PM	#2
theducks Well trained by Cats Posts: 29,969 Karma: 55705602 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	Each site has a unique recipe to scrape the data. Maybe they changed the site? Then the recipe will need to be revised.

03-06-2017, 12:51 AM	#3
kovidgoyal creator of calibre Posts: 44,015 Karma: 22669822 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Post a book title/author that does not return results even though you think it should, and I will take a look. Most likely the open search API on the site is broken.

03-06-2017, 01:01 AM	#4
kovidgoyal creator of calibre Posts: 44,015 Karma: 22669822 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Never mind, I see that a few weeks ago I changed that plugin to use https instead of http -- apparently that is the cause of the problem, I have reverted that change. It now works for me with a couple of test searches. Try it again in a couple of hours and you should be fine.

03-06-2017, 07:08 PM	#5
sgulick1 Junior Member Posts: 3 Karma: 10 Join Date: Mar 2017 Location: Colorado Device: pc/ kindle paperwhite	Unfortunately I am still not pulling anything from Archive.org, I rebooted and tried again just now. For analysis, it may be helpful to mention some related issues I noticed in Get Books page. I normally select these stores: P.Gutenberg, Archive.org, Amazon Kindle, Google Books, ManyBooks. I am pulling nothing from either Archive.org or Google Books, and of the other 3 stores, prices are showing only for ManyBooks. For test purposes, for title/author/keyword (one per search event) I am entering Oliver Twist/Dickens/England and/or Odyssey/Homer/Greece. Thanks for looking into this, Calibre is great!

03-06-2017, 10:17 PM	#6
kovidgoyal creator of calibre Posts: 44,015 Karma: 22669822 Join Date: Oct 2006 Location: Mumbai, India Device: Various	amazon stores are broken because amazon is blocking calibre, that is unlikely to be fixed anytime soon. As for archive.org, in addition to the https problem their opensearch server also seems to be broken, for example go to: http://bookserver.archive.org/catalo...earch?q=austen and you get an internal server error. Report it to them and hopefully they will fix it.

03-06-2017, 11:05 PM	#7
kovidgoyal creator of calibre Posts: 44,015 Karma: 22669822 Join Date: Oct 2006 Location: Mumbai, India Device: Various	This should fix the Google Books plugin: https://github.com/kovidgoyal/calibr...6a0d7b0f53448e

03-06-2017, 11:32 PM	#8
kovidgoyal creator of calibre Posts: 44,015 Karma: 22669822 Join Date: Oct 2006 Location: Mumbai, India Device: Various	I was wrong about amazon, the problem is a change in the website markup, not blocking, this shoudl fix it: https://github.com/kovidgoyal/calibr...c82133370e5933

03-07-2017, 05:50 PM	#9
sgulick1 Junior Member Posts: 3 Karma: 10 Join Date: Mar 2017 Location: Colorado Device: pc/ kindle paperwhite	Regarding Archive.org issue, I reported it at their website as you suggested, am awaiting response.

Advert

Advert