WSJ recipe not working - Page 2

Mister Z · 02-15-2021, 03:29 PM

The WSJ recipe (updated) fails for me too, with this log (running on headless linux):

Code:

Conversion options changed from defaults:
  mobi_file_type: 'new'
  test: None
1% Converting input to HTML...
InputFormatPlugin: Recipe Input running
Using custom recipe
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36
Starting login process...
Sending login request...
Performing login callback...
1% Fetching feeds...
1% Got feeds from index page
Traceback (most recent call last):
  File "runpy.py", line 194, in _run_module_as_main
  File "runpy.py", line 87, in _run_code
  File "site.py", line 45, in <module>
  File "site.py", line 41, in main
  File "calibre/ebooks/conversion/cli.py", line 401, in main
  File "calibre/ebooks/conversion/plumber.py", line 1108, in run
  File "calibre/customize/conversion.py", line 245, in __call__
  File "calibre/ebooks/conversion/plugins/recipe_input.py", line 139, in convert
  File "calibre/web/feeds/news.py", line 1051, in download
  File "calibre/web/feeds/news.py", line 1231, in build_index
ValueError: No articles found, aborting
Traceback (most recent call last):
  File "runpy.py", line 194, in _run_module_as_main
  File "runpy.py", line 87, in _run_code
  File "site.py", line 45, in <module>
  File "site.py", line 41, in main
  File "calibre/ebooks/metadata/cli.py", line 182, in main

mjfriedman · 02-19-2021, 10:35 AM

I'd guess this is a problem with the Journal rather than the recipe. Typically if I kill the fetch and try it again I get it to work within 2-3 tries. But of course that only works if I'm home to do that....

mkgtu · 06-27-2021, 03:37 PM

I have had the same problem, not only with WSJ but occasionally with the New York Times getting stuck.

But if you can live without the pictures, try excluding images from the download. Just create a custom recipe from the built-in, and then exclude images by adding "dict(name='img')" to the Remove Tags section near the end of the recipe.

Without images the result is a much, much smaller file (1mb or less) and a very quick download which, at least for me, rarely fails or gets stuck. (I do the same for the New York Times)

Unfortunately there is still the occasional problem of not getting all sections of the WSJ, but it seems to happen less frequently with the "no images" version.

Sent from my SM-G975U using Tapatalk

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
WSJ recipe fails	mjfriedman	Recipes	13	10-17-2019 03:09 PM
WSJ recipe fails	ebonytowers	Recipes	25	09-13-2019 07:28 AM
WSJ recipe returning error	BobbyVan	Recipes	4	09-29-2016 09:41 PM
WSJ recipe -- subscription is not fully recognized	pmiles	Recipes	5	10-26-2013 11:23 PM
Where's the wsj recipe?	mdovell	Calibre	7	09-10-2010 09:29 AM

02-19-2021, 10:35 AM	#17
mjfriedman Connoisseur Posts: 72 Karma: 10 Join Date: Dec 2010 Device: Kindle Oasis	I'd guess this is a problem with the Journal rather than the recipe. Typically if I kill the fetch and try it again I get it to work within 2-3 tries. But of course that only works if I'm home to do that....

06-27-2021, 03:37 PM	#18
mkgtu Zealot Posts: 129 Karma: 33000 Join Date: Feb 2010 Device: Currently:Voyage, Oasis 3, Kindle mobile apps, andKindle Fire	I have had the same problem, not only with WSJ but occasionally with the New York Times getting stuck. But if you can live without the pictures, try excluding images from the download. Just create a custom recipe from the built-in, and then exclude images by adding "dict(name='img')" to the Remove Tags section near the end of the recipe. Without images the result is a much, much smaller file (1mb or less) and a very quick download which, at least for me, rarely fails or gets stuck. (I do the same for the New York Times) Unfortunately there is still the occasional problem of not getting all sections of the WSJ, but it seems to happen less frequently with the "no images" version. Sent from my SM-G975U using Tapatalk

Advert