09-25-2012, 12:58 PM | #1 |
Junior Member
Posts: 1
Karma: 10
Join Date: Sep 2012
Device: Kindle
|
Foreign Policy
Hi there guys.
I was wondering if anyone was experiencing problems with FP? It was working until a few months ago, now all that gets downloaded is a set of html links to the articles or a table of contents. This is both in the viewer on the computer and on my Kindle. I'm using Calibre on linux. Thanks for any help. |
09-25-2012, 04:41 PM | #2 |
Guru
Posts: 800
Karma: 194644
Join Date: Dec 2007
Location: Argentina
Device: Kindle Voyage
|
I'll take a look
|
Advert | |
|
09-25-2012, 05:17 PM | #3 |
Guru
Posts: 800
Karma: 194644
Join Date: Dec 2007
Location: Argentina
Device: Kindle Voyage
|
The seem to have some nasty javascript protection against scraping. Too much work for me.
|
09-28-2012, 09:37 PM | #4 |
Groupie
Posts: 171
Karma: 10
Join Date: May 2012
Device: Kindle Paperwhite2
|
All section names are images, not texts. This seems to be the biggest problem. Besides, the structure is such that every single article looks like a section to me. But isn't it possible to fetch all articles without putting them into various sections (like what you do when you fetch articles from a rss)?
|
09-29-2012, 06:45 AM | #5 |
Guru
Posts: 800
Karma: 194644
Join Date: Dec 2007
Location: Argentina
Device: Kindle Voyage
|
The problem is not in fetching urls it is in fetching the content of articles. The content is being loaded by javascript after the main page loads.
|
Advert | |
|
10-01-2012, 04:54 AM | #6 |
Groupie
Posts: 171
Karma: 10
Join Date: May 2012
Device: Kindle Paperwhite2
|
|
10-01-2012, 06:51 AM | #7 |
Junior Member
Posts: 1
Karma: 10
Join Date: Oct 2012
Device: kindle
|
I'm afraid to be out of place here, but it seems work:
class AdvancedUserRecipe1349086293(BasicNewsRecipe): title = u'Foreign Policy' oldest_article = 7 max_articles_per_feed = 100 auto_cleanup = True feeds = [(u'Foreign_Policy', u'http://www.foreignpolicy.com/node/feed')] def print_version(self, url): return url + '?print=yes&hidecomments=yes&page=full' |
10-07-2012, 09:43 AM | #8 |
Groupie
Posts: 171
Karma: 10
Join Date: May 2012
Device: Kindle Paperwhite2
|
It has nothing to do with the recipe. The website has been changed, it seems.
|
10-07-2012, 09:45 AM | #9 |
Groupie
Posts: 171
Karma: 10
Join Date: May 2012
Device: Kindle Paperwhite2
|
Now that the recipe works again, can anyone make a recipe of the print edition?
http://www.foreignpolicy.com/issues/current |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Free (nook/Kindle/Sony/iTunes) Foreign Policy [Globetrotting Insurance Agent Mystery] | ATDrake | Deals and Resources (No Self-Promotion or Affiliate Links) | 2 | 09-01-2012 10:26 AM |
Foreign Policy all feeds? Help? | DogonCrook | Recipes | 1 | 11-10-2010 06:44 PM |
Classic Return Policy | nremondelli | Barnes & Noble NOOK | 1 | 06-10-2010 09:31 AM |
Return Policy | JicMic | Sony Reader | 1 | 04-25-2009 10:37 AM |