MobileRead Forums
Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes
Reload this Page Economist recipe failing with 403 error

Notices

Reply
 
Thread Tools Search this Thread
Old 12-08-2023, 02:25 AM   #1
adfadfsasdfafafd
Enthusiast
adfadfsasdfafafd has learned how to buy an e-book online
 
Posts: 27
Karma: 76
Join Date: May 2014
Device: Kindle 3
Economist recipe failing with 403 error
I'm consistently getting this error today (and I've tried from a couple of different IPs):

Quote:
Downloading recipe urn: builtin:economist
Trying to get latest version of recipe: economist
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Kindle Output profile being used, reducing image quality to keep file size below amazon email threshold
Traceback (most recent call last):
File "runpy.py", line 194, in _run_module_as_main
File "runpy.py", line 87, in _run_code
File "site.py", line 39, in <module>
File "site.py", line 35, in main
File "calibre/utils/ipc/worker.py", line 215, in main
File "calibre/gui2/convert/gui_conversion.py", line 31, in gui_convert_recipe
File "calibre/gui2/convert/gui_conversion.py", line 25, in gui_convert
File "calibre/ebooks/conversion/plumber.py", line 1108, in run
File "calibre/customize/conversion.py", line 242, in __call__
File "calibre/ebooks/conversion/plugins/recipe_input.py", line 137, in convert
File "calibre/web/feeds/news.py", line 1056, in download
File "calibre/web/feeds/news.py", line 1225, in build_index
File "<string>", line 280, in parse_index
File "calibre/web/feeds/news.py", line 706, in index_to_soup
File "mechanize/_mechanize.py", line 241, in open_novisit
File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.httperror_seek_wrapper: HTTP Error 403: Forbidden
adfadfsasdfafafd is offline   Reply With Quote
Old 12-08-2023, 02:31 AM   #2
unkn0wn
Fanatic
unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.
 
Posts: 543
Karma: 82944
Join Date: May 2021
Device: kindle
its checking if connection is secure.
Attached Thumbnails
Click image for larger version Name: Screenshot 2023-12-08 115802.png Views: 91 Size: 30.5 KB ID: 205078  
unkn0wn is offline   Reply With Quote
Advert
Old 12-08-2023, 02:51 AM   #3
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 44,566
Karma: 24495948
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Quote:
Originally Posted by unkn0wn View Post
its checking if connection is secure.
What it's really doing is checking if you are connecting using a browser blessed by cloudflare's "bot protection". Which means you cannot connect anymore without using a browser running javascript that happens to pass a bunch of heuristics implemented in cloudflare's JS script.

"Secure" indeed, roll eyes.
Last edited by kovidgoyal; 12-08-2023 at 02:55 AM.
kovidgoyal is offline   Reply With Quote
Old 12-08-2023, 02:53 AM   #4
adfadfsasdfafafd
Enthusiast
adfadfsasdfafafd has learned how to buy an e-book online
 
Posts: 27
Karma: 76
Join Date: May 2014
Device: Kindle 3
Is there a way around this?
adfadfsasdfafafd is offline   Reply With Quote
Old 12-08-2023, 03:21 AM   #5
unkn0wn
Fanatic
unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.
 
Posts: 543
Karma: 82944
Join Date: May 2021
Device: kindle
can we get __NEXT_DATA__ json through waybackmachine? like nyt!

archive.is/latest/ doesn't have it

Code:
    def print_version(self, url):
        return 'https://webcache.googleusercontent.com/search?q=cache:' + url.split('?')[0]
this one works but has rate limit.
Last edited by unkn0wn; 12-08-2023 at 03:29 AM.
unkn0wn is offline   Reply With Quote
Advert
Old 12-08-2023, 03:32 AM   #6
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 44,566
Karma: 24495948
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
If the google webcache works you can use it via google_get_cached_url() function that implements rate limiting globally across all calibre process/threads. But I suspect google's web cache has both rate and total requests limits.
kovidgoyal is offline   Reply With Quote
Old 12-08-2023, 04:11 AM   #7
unkn0wn
Fanatic
unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.
 
Posts: 543
Karma: 82944
Join Date: May 2021
Device: kindle
fixed. it'll work now.
unkn0wn is offline   Reply With Quote
Old 12-08-2023, 12:57 PM   #8
adfadfsasdfafafd
Enthusiast
adfadfsasdfafafd has learned how to buy an e-book online
 
Posts: 27
Karma: 76
Join Date: May 2014
Device: Kindle 3
Amazing, thank you!
adfadfsasdfafafd is offline   Reply With Quote
Reply

« Previous Thread | Next Thread »

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
HTTP Error 403: Forbidden enuddleyarbl Calibre 13 07-08-2024 05:48 PM
The Economist Recipe NSILMike Recipes 6 05-20-2016 08:40 AM
"The New York Times" recipe failing with error mikebw Recipes 8 10-02-2015 06:48 PM
Economist Recipe Failing... awitko Recipes 2 11-07-2011 12:47 AM
Economist recipe jdomingos76 Recipes 1 03-08-2011 09:33 AM


All times are GMT -4. The time now is 05:30 PM.

Contact Us - FAQ - Guidelines - Privacy - Top

MobileRead.com is a privately owned, operated and funded community.