![]() |
#1 |
Member
![]() Posts: 14
Karma: 10
Join Date: Dec 2013
Device: Kindle Paperwhite
|
Only first page of articles in The Economist
For maybe 2 weeks, articles in certain sections (China and the Americas) only shows the first page. The rest of the article is missing.
|
![]() |
![]() |
![]() |
#2 |
creator of calibre
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 44,265
Karma: 23661992
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
The economist is no longer serving the full text for those articles. Presumably they now want you to have an account and subscribe to read them. I dont have the time right now to investigate and given its just those two sections, not much motivation either. Maybe if they re-institute a full subscription requirement I will look into adding login back to the recipe.
|
![]() |
![]() |
Advert | |
|
![]() |
#3 |
Enthusiast
![]() Posts: 45
Karma: 16
Join Date: Feb 2015
Device: Kindle Paperwhite
|
I just noticed the same thing for China and Americas. Can see the full article when logging into The Economist. Is it easy to create a separate Economist recipe with login so users can have that option as well or is it going to require a lot of work? I don't see any catcha requirement so that is one obstacle out of the way.
|
![]() |
![]() |
![]() |
#4 |
Member
![]() Posts: 14
Karma: 10
Join Date: Dec 2013
Device: Kindle Paperwhite
|
Thank you very much. I hope the number of unreadable articles does not grow too much.
|
![]() |
![]() |
![]() |
#5 |
Enthusiast
![]() Posts: 45
Karma: 16
Join Date: Feb 2015
Device: Kindle Paperwhite
|
Don't thank me please as I haven't done anything. I know nothing about Python programming but decided to give it a shot. Hope the community can offer some help to me.
I am stuck on the login piece. I don't know what the login website is or the login form is for the economist or whether it exist. This is what I have so far. Everything I tried did not work so far. If I can get this correct, maybe it can work. def get_browser(self): br = BasicNewsRecipe.get_browser(self) if self.username and self.password: br.open('https://myaccount.economist.com/s/login/') br.select_form(id='c-lwc-login-form') br['username'] = self.username br['password'] = self.password br.submit() return br |
![]() |
![]() |
Advert | |
|
![]() |
#6 |
creator of calibre
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 44,265
Karma: 23661992
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
This is already fixed by getting the articles in those sections from googles webcache.
|
![]() |
![]() |
![]() |
#7 |
Enthusiast
![]() Posts: 45
Karma: 16
Join Date: Feb 2015
Device: Kindle Paperwhite
|
Not sure I understand barring the recipe will be updated on a future Calibre release. Does the Economist recipe download from Google Webcache or straight from the Economist website? I am still stuck on the login page where when I inspect the html, I don't see a login form so I don't know what to put in br.select_form or I have to put something else to point the recipe to look for the username and password. That is where I am stuck.
|
![]() |
![]() |
![]() |
#8 |
creator of calibre
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 44,265
Karma: 23661992
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
You dont need to do anything, just use the builtin recipe as always.
|
![]() |
![]() |
![]() |
#9 |
Enthusiast
![]() Posts: 45
Karma: 16
Join Date: Feb 2015
Device: Kindle Paperwhite
|
Downloaded the past issues again and it looks like the China section and Americas sections have the full article. Thanks!
|
![]() |
![]() |
![]() |
#10 |
Member
![]() Posts: 14
Karma: 10
Join Date: Dec 2013
Device: Kindle Paperwhite
|
Thank you. This week's Economist seems indeed to be complete !
|
![]() |
![]() |
![]() |
#11 |
Junior Member
![]() Posts: 1
Karma: 10
Join Date: May 2023
Device: Kindle
|
I still get only first pages of articles. And not just one section or two, but a lot of them. This week: Middle East, China, Asia, Americas, Europe, Britain, USA... What can I do to fix it?
|
![]() |
![]() |
![]() |
#12 |
Enthusiast
![]() Posts: 31
Karma: 10
Join Date: Dec 2010
Location: Melbourne, Australia
Device: Kobo Clara HD
|
In this week's edition I'm getting the same problem on By Invitation, Briefing, Asia, Middle East & Africa, Europe, Britain, Science & Technology, Culture, and The Economist Explains.
Leaders, Letters, China, US, The Americas, International, Special Report, Business, Finance & Economics, and the Obituary all seem to be OK. Last week the cutting out occurred on only two (different) sections - China and The Americas. I'm very happy to have a login method as I'm a subscriber - I just much prefer to read on my Kobo rather than on a phone, tablet, or PC. |
![]() |
![]() |
![]() |
#13 |
Connoisseur
![]() Posts: 97
Karma: 10
Join Date: Sep 2013
Device: Kindle Paperwhite (2012)
|
Happens to me to, most or all artiles only partially downloaded. I*tried upgrading Calibre to the latest version (ruining the font display) but that does not help either.
|
![]() |
![]() |
![]() |
#14 |
creator of calibre
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 44,265
Karma: 23661992
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
Well, I looked at creating a login briefly but the login is now a javascript based monstrosity that goes through salesforce servers. So reverse engineering it will be a fairly painful effort. I dont know why news sites in the US/UK are so fond of these JS based login processes, makes it hard for their own paying customers to access their content.
|
![]() |
![]() |
![]() |
#15 |
Enthusiast
![]() Posts: 31
Karma: 10
Join Date: Dec 2010
Location: Melbourne, Australia
Device: Kobo Clara HD
|
|
![]() |
![]() |
![]() |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
The Economist recipe fails - no articles | mkgtu | Recipes | 2 | 05-11-2023 07:49 PM |
Economist only downloading two articles | davidsmartin | Recipes | 6 | 06-20-2022 09:17 AM |
Convert "The Economist" EPUB to MOBI = Lose Navigation to Articles and Sections | dukelov3 | Conversion | 3 | 03-08-2013 10:11 PM |
Fetching multi-page articles | Steven630 | Recipes | 27 | 08-21-2012 10:04 PM |
The Economist-Missing articles | redall | Recipes | 0 | 06-16-2011 12:41 PM |