500 error when adding HTML page from archive.org

[wwwalker]

I keep getting 500 internal server error on archive.org for importing HTML document. i opened the URL in the error message and site said busy, try again later but it never is any good no matte how many times I try. It looks like I have to 'borrow' HTML versions but can't see why.

Here is error:

calibre, version 4.9.1 (win32, embedded-python: True)
Failed to download e-book: Failed: Downloading Complete world of Greek mythology.html

Starting job: Downloading Complete world of Greek mythology.html
Job: "Downloading Complete world of Greek mythology.html" failed with error:
Traceback (most recent call last):
File "site-packages\calibre\gui2\threaded_jobs.py", line 83, in start_work
File "site-packages\calibre\gui2\ebook_download.py", line 86, in __call__
File "site-packages\calibre\gui2\ebook_download.py", line 102, in _download
File "site-packages\calibre\gui2\ebook_download.py", line 69, in download_file
File "site-packages\mechanize\_mechanize.py", line 253, in open
File "site-packages\mechanize\_mechanize.py", line 309, in _mech_open
httperror_seek_wrapper: HTTP Error 500: Internal Server Error

Called with args: (<calibre.gui2.ui.Main object at 0x07588300>, None, 'https://bookserver.archive.org/borrow/webview/completeworldofg00rich', u'Complete world of Greek mythology.html', u'', True, [], <bound method ArchiveOrgStore.create_browser of <calibre.gui2.store.stores.archive_org_plugin.Arch iveOrgStore object at 0x07C737D0>>) {u'abort': <threading._Event object at 0x1243CDD0>, u'notifications': <Queue.Queue instance at 0x136E55D0>, u'log': <calibre.utils.logging.GUILog object at 0x1243CA10>}

Any hack of python in Calibre or info re registering with archive.org to be allowed to download the HTML version of the books would be good as I am a programmer and can write Python otherwise I read the book on the URL as an HTML directly on their site but not as an EBook in Calibre.

I have not upgraded as Calibre in later versions has problems with flickering ebooks due to Qt library changing and only Windows 10 being supported not Windows 7.

[kovidgoyal]

No idea, dont use archive.org myself. You can check the code in archive_org_plugin.py and modify it however you like. https://manual.calibre-ebook.com/develop.html

[JSWolf]

You do know that you cannot stay on Windows 7 forever and that someday you will have to upgrade to Windows 10. So now is a better time then later to upgrade both Windows and Calibre. And when you do upgrade to Windows 10, if you can, do so to a 64-bit version.

That being said, it looks like the problem is on Archive.org's end.

[DNSB]

Hmmm... given that 5 web browsers gave a 500 error trying to connect to https://bookserver.archive.org/borro...worldofg00rich though https://archive.org/details/completeworldofg00rich does work with a banner saying you can borrow this book for 14 days and a "Login and Borrow" button? Add in that the URL you are trying to use has borrow in the path and a question comes to mind:

Do you have a configuration that will log you in to archive.org to allow borrowing the book?

@JSWolf: Please note I get the same 500 error using all the browsers I tested on Windows 10 1909 and 2004, Mac OSX Catalina, SUSE Tumbleweed, Ubuntu 20.04 and Raspbian. I find myself doubting that his issue was caused by using Windows 7.

[JSWolf]

Originally Posted by DNSB

Hmmm... given that 5 web browsers gave a 500 error trying to connect to https://bookserver.archive.org/borro...worldofg00rich though https://archive.org/details/completeworldofg00rich does work with a banner saying you can borrow this book for 14 days and a "Login and Borrow" button? Add in that the URL you are trying to use has borrow in the path and a question comes to mind:

Do you have a configuration that will log you in to archive.org to allow borrowing the book?

@JSWolf: Please note I get the same 500 error using all the browsers I tested on Windows 10 1909 and 2004, Mac OSX Catalina, SUSE Tumbleweed, Ubuntu 20.04 and Raspbian. I find myself doubting that his issue was caused by using Windows 7.

I wasn't saying it was an issue with Windows 7. The OP said Calibre cannot be updated any further due to Windows 7. So I was posting to update Windows7 to Windows 10 so Calibre can also be updated.

Then I said it was a problem on archive.org's side of things.