![]() |
#1 |
o hai.
![]() Posts: 13
Karma: 10
Join Date: Jun 2010
Device: Kindle Keyboard 3G
|
Calibre + Instapaper Limits
Sometimes when I use calibre to fetch my instapaper articles, I find that not all of my articles are fetched. Lately, it has been fetching my 10 or so most recent articles only.
Anyone else experiencing this or have a possible fix? note: when i download the articles straight from instapaper, ALL articles are downloaded. |
![]() |
![]() |
![]() |
#2 |
Junior Member
![]() Posts: 3
Karma: 10
Join Date: Nov 2010
Device: Kindle 3
|
![]()
Hi!
Firstly can I say what a fabulous bit of software Calibre is! Well done to Kovid for what has made life so much easier.. ![]() I'm in the same boat as the OP when trying to download articles from Instapaper. It varies how many articles are actually downloaded. For instance, the first time I downloaded a bunch of articles the filesize was 4.3MB - a few minutes later when I tried again the size was 0.8MB and only a handful! I tried this a few days later and the same 0.8mb file was downloaded. Do you think this is a Calibre issue or an Instapaper one? The recipe is as follows: Code:
__license__ = 'GPL v3' __copyright__ = '2009-2010, Darko Miletic <darko.miletic at gmail.com>' ''' www.instapaper.com ''' import urllib from calibre import strftime from calibre.web.feeds.news import BasicNewsRecipe class Instapaper(BasicNewsRecipe): title = 'The KindleMagic Daily' __author__ = 'Unknown' description = '''Personalized news feeds. Go to instapaper.com to setup up your news. Fill in your instapaper username, and leave the password field below blank.''' publisher = 'Instapaper.com' category = 'news, custom' oldest_article = 50 max_articles_per_feed = 100 no_stylesheets = True use_embedded_content = False needs_subscription = True INDEX = u'http://www.instapaper.com' LOGIN = INDEX + u'/user/login' conversion_options = { 'comment' : description , 'tags' : category , 'publisher' : publisher } feeds = [ (u'Uncategorised articles' , INDEX + u'/u') ,(u'Starred articles', INDEX + u'/starred') ,(u'News', INDEX + u'/u/folder/number_removed/news') ,(u'Sport', INDEX + u'/u/folder/number_removed/sport') ,(u'Technology', INDEX + u'/u/folder/number_removed/technology') ,(u'Gaming', INDEX + u'/u/folder/number_removed/gaming') ,(u'Comment', INDEX + u'/u/folder/number_removed/comment') ,(u'Gossip/Rubbish', INDEX + u'/u/folder/number_removed/gossip-rubbish') ] def get_browser(self): br = BasicNewsRecipe.get_browser() if self.username is not None: br.open(self.LOGIN) br.select_form(nr=0) br['username'] = self.username if self.password is not None: br['password'] = self.password br.submit() return br def parse_index(self): totalfeeds = [] lfeeds = self.get_feeds() for feedobj in lfeeds: feedtitle, feedurl = feedobj self.report_progress(0, _('Fetching feed')+' %s...'%(feedtitle if feedtitle else feedurl)) articles = [] soup = self.index_to_soup(feedurl) for item in soup.findAll('div', attrs={'class':'titleRow'}): description = self.tag_to_string(item.div) atag = item.a if atag and atag.has_key('href'): url = atag['href'] title = self.tag_to_string(atag) date = strftime(self.timefmt) articles.append({ 'title' :title ,'date' :date ,'url' :url ,'description':description }) totalfeeds.append((feedtitle, articles)) return totalfeeds def print_version(self, url): return self.INDEX + '/text?u=' + urllib.quote(url) Really hoping someone can help here folks! Thanks in advance for your time ![]() Cheers Maxi (UK) PS, not sure if this is relevant, but on my work's box I am running Ubuntu 10.04 - every time I download I get all the articles (i.e. 4.3mb) so it's working fine there. An Ubuntu 10.10 thing?? ----------- |
![]() |
![]() |
Advert | |
|
![]() |
#3 |
Addict
![]() ![]() ![]() ![]() ![]() Posts: 219
Karma: 404
Join Date: Nov 2010
Device: Kindle 3G, Samsung SIII
|
I would try to download from command line using the -vv option, if I remember correctly the usage would be:
Code:
ebook-convert path_to_instapaper_recipe download_filename --username your_username --password your_password -vv |
![]() |
![]() |
![]() |
#4 | |
US Navy, Retired
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 9,865
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
|
Quote:
|
|
![]() |
![]() |
![]() |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
Instapaper + Calibre + Kobo = great | dantaipan | Kobo Reader | 10 | 10-15-2010 10:03 PM |
Instapaper folders and Calibre | flyash | Calibre | 4 | 08-13-2010 02:01 AM |
AZW Limits | 6charlong | Amazon Kindle | 14 | 08-01-2010 11:23 AM |
Calibre, Instapaper, multipage articles and ordering | flyash | Calibre | 1 | 06-10-2010 07:03 PM |
Calibre not working with Instapaper fetch | angelsdan | Calibre | 3 | 05-22-2010 01:34 PM |