MobileRead Forums
Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes
Reload this Page requesting schedule of new york times

Notices

Reply
 
Thread Tools Search this Thread
Old 08-01-2024, 09:24 AM   #1
jamesran
Junior Member
jamesran began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2024
Device: kindle paperwhite 3
requesting schedule of new york times
the schedule of new york times in github which was posted by the author of calibre was 6 months old and it can not work now , can someone post a working schedule here?
jamesran is offline   Reply With Quote
Old 08-01-2024, 01:22 PM   #2
unkn0wn
Fanatic
unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.
 
Posts: 573
Karma: 82944
Join Date: May 2021
Device: kindle
what do you mean schedule? provide the github link here.
unkn0wn is offline   Reply With Quote
Old 08-01-2024, 10:13 PM   #3
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
Posts: 13,009
Karma: 76440556
Join Date: Nov 2007
Location: Toronto
Device: Libra H2O, Libra Colour
For what it's worth, I just tried all the NY Times recipes present in calibre 7.16; three found in the English category of Fetch News and one in the English (United States) category.

All worked properly, albeit returning only a small number of articlers due to the NY Times paywall.

No need to use anything from Github; calibre auto updates recipes as they are used.
PeterT is offline   Reply With Quote
Old 08-03-2024, 04:36 AM   #4
jamesran
Junior Member
jamesran began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2024
Device: kindle paperwhite 3
Quote:
Originally Posted by unkn0wn View Post
what do you mean schedule? provide the github link here.
https://github.com/kovidgoyal/calibr...nytimes.recipe

the schedule of new york times can not work
jamesran is offline   Reply With Quote
Old 08-03-2024, 05:09 AM   #5
jamesran
Junior Member
jamesran began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2024
Device: kindle paperwhite 3
my laptops is a little old , only the 32bit window operating system can be installed on it, the newest calibre requires 64bit system, but the schedules of old calibre can not work properly.
jamesran is offline   Reply With Quote
Old 08-03-2024, 05:34 AM   #6
unkn0wn
Fanatic
unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.
 
Posts: 573
Karma: 82944
Join Date: May 2021
Device: kindle
copy the log after run, paste it in a txt file and attach it here.
Only then we can know what the problem is!
unkn0wn is offline   Reply With Quote
Old 08-03-2024, 05:32 PM   #7
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
Posts: 13,009
Karma: 76440556
Join Date: Nov 2007
Location: Toronto
Device: Libra H2O, Libra Colour
Unfortunately it looks like there was a major restructuring of the NY Times recipes a few months ago which broke out code responsible for parsing the JSON into a separate file, web.site_parsers.nytimes which appears not to function correctly in calibre 5.44 (which as far as I can tell was the last 32 bit version).

Sent from my Pixel 7a using Tapatalk
PeterT is offline   Reply With Quote
Old 08-04-2024, 01:18 AM   #8
jamesran
Junior Member
jamesran began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2024
Device: kindle paperwhite 3
Quote:
Originally Posted by PeterT View Post
Unfortunately it looks like there was a major restructuring of the NY Times recipes a few months ago which broke out code responsible for parsing the JSON into a separate file, web.site_parsers.nytimes which appears not to function correctly in calibre 5.44 (which as far as I can tell was the last 32 bit version).

Sent from my Pixel 7a using Tapatalk
you are right that i just can use calibre5.44 , and the calibre7.16 is ok with new york times after i tested in a new laptop. why did calire stop supporting window 32bit operating system?
jamesran is offline   Reply With Quote
Old 08-04-2024, 01:55 AM   #9
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 42,433
Karma: 162918680
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos
Quote:
Originally Posted by jamesran View Post
you are right that i just can use calibre 5.44 , and the calibre7.16 is ok with new york times after i tested in a new laptop. why did calire stop supporting window 32bit operating system?
calibre uses QT for graphics interface support for multiple operating systems. When QT dropped support for 32 bit operating systems, the choice was either to do a custom compile of QT, become a commercial customer ($$$) or drop 32 bit support.
DNSB is offline   Reply With Quote
Old 08-04-2024, 02:12 AM   #10
unkn0wn
Fanatic
unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.
 
Posts: 573
Karma: 82944
Join Date: May 2021
Device: kindle
Quote:
Originally Posted by jamesran View Post
https://github.com/kovidgoyal/calibr...nytimes.recipe

the schedule of new york times can not work
did you try this one?
https://github.com/kovidgoyal/calibr...mes_sub.recipe

you still haven't posted the log file!
unkn0wn is offline   Reply With Quote
Old 08-04-2024, 07:31 AM   #11
jamesran
Junior Member
jamesran began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2024
Device: kindle paperwhite 3
Quote:
Originally Posted by unkn0wn View Post
copy the log after run, paste it in a txt file and attach it here.
Only then we can know what the problem is!
Spoiler:

calibre, version 5.44.0 (win32, embedded-python: True)
转换错误: 失败: 抓取新闻，来源于 The New York Times (Web)

抓取新闻，来源于 The New York Times (Web)
Conversion options changed from defaults:
output_profile: 'generic_eink'
verbose: 2
Resolved conversion options
calibre version: 5.44.0
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': 'original',
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_download_recipe': False,
'dont_split_on_page_breaks': True,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': False,
'epub_inline_toc': False,
'epub_toc_at_end': False,
'epub_version': '2',
'expand_css': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'flow_size': 260,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x069E4358>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': False,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.GenericEink object at 0x069E4808>,
'page_breaks_before': None,
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': '',
'search_replace': None,
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': '',
'sr1_search': '',
'sr2_replace': '',
'sr2_search': '',
'sr3_replace': '',
'sr3_search': '',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': None,
'transform_html_rules': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Downloading recipe urn: custom:1002
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Failed to download section: https://www.nytimes.com/section/world
Failed to download section: https://www.nytimes.com/section/us
Failed to download section: https://www.nytimes.com/section/politics
Failed to download section: https://www.nytimes.com/section/nyregion
Failed to download section: https://www.nytimes.com/section/business
Failed to download section: https://www.nytimes.com/section/technology
Failed to download section: https://www.nytimes.com/section/sports
Failed to download section: https://www.nytimes.com/section/science
Failed to download section: https://www.nytimes.com/section/health
Failed to download section: https://www.nytimes.com/section/opinion
Failed to download section: https://www.nytimes.com/section/arts
Failed to download section: https://www.nytimes.com/section/books
Failed to download section: https://www.nytimes.com/section/movies
Failed to download section: https://www.nytimes.com/section/arts/music
Failed to download section: https://www.nytimes.com/section/arts/television
Failed to download section: https://www.nytimes.com/section/style
Failed to download section: https://www.nytimes.com/section/dining
Failed to download section: https://www.nytimes.com/section/fashion
Failed to download section: https://www.nytimes.com/section/garden
Failed to download section: https://www.nytimes.com/section/travel
Failed to download section: https://www.nytimes.com/section/education
Failed to download section: https://www.nytimes.com/section/multimedia
Failed to download section: https://www.nytimes.com/section/obituaries
Failed to download section: https://www.nytimes.com/section/magazine
Traceback (most recent call last):
File "runpy.py", line 194, in _run_module_as_main
File "runpy.py", line 87, in _run_code
File "site.py", line 82, in <module>
File "site.py", line 77, in main
File "site.py", line 49, in run_entry_point
File "calibre\utils\ipc\worker.py", line 215, in main
File "calibre\gui2\convert\gui_conversion.py", line 31, in gui_convert_recipe
File "calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert
File "calibre\ebooks\conversion\plumber.py", line 1108, in run
File "calibre\customize\conversion.py", line 242, in __call__
File "calibre\ebooks\conversion\plugins\recipe_input.py ", line 137, in convert
File "calibre\web\feeds\news.py", line 1056, in download
File "calibre\web\feeds\news.py", line 1236, in build_index
ValueError: No articles found, aborting
Last edited by theducks; 08-04-2024 at 10:38 AM. Reason: SPOILER LOG files
jamesran is offline   Reply With Quote
Old 08-04-2024, 07:50 AM   #12
jamesran
Junior Member
jamesran began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2024
Device: kindle paperwhite 3
Quote:
Originally Posted by unkn0wn View Post
did you try this one?
https://github.com/kovidgoyal/calibr...mes_sub.recipe

you still haven't posted the log file!
i tried the recipe you gave to me, it seems that i just got the titles of articles and could not get content of article
Last edited by jamesran; 08-04-2024 at 07:53 AM.
jamesran is offline   Reply With Quote
Old 08-04-2024, 07:54 AM   #13
jamesran
Junior Member
jamesran began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Aug 2024
Device: kindle paperwhite 3
Quote:
Originally Posted by unkn0wn View Post
did you try this one?
https://github.com/kovidgoyal/calibr...mes_sub.recipe

you still haven't posted the log file!
Spoiler:

calibre, version 5.44.0 (win32, embedded-python: True)
转换错误: 失败: 抓取新闻，来源于 The New York Times (Web)

抓取新闻，来源于 The New York Times (Web)
Conversion options changed from defaults:
output_profile: 'generic_eink'
verbose: 2
Resolved conversion options
calibre version: 5.44.0
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': 'original',
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_download_recipe': False,
'dont_split_on_page_breaks': True,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': False,
'epub_inline_toc': False,
'epub_toc_at_end': False,
'epub_version': '2',
'expand_css': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'flow_size': 260,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x069E4358>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': False,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.GenericEink object at 0x069E4808>,
'page_breaks_before': None,
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': '',
'search_replace': None,
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': '',
'sr1_search': '',
'sr2_replace': '',
'sr2_search': '',
'sr3_replace': '',
'sr3_search': '',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': None,
'transform_html_rules': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Downloading recipe urn: custom:1002
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Failed to download section: https://www.nytimes.com/section/world
Failed to download section: https://www.nytimes.com/section/us
Failed to download section: https://www.nytimes.com/section/politics
Failed to download section: https://www.nytimes.com/section/nyregion
Failed to download section: https://www.nytimes.com/section/business
Failed to download section: https://www.nytimes.com/section/technology
Failed to download section: https://www.nytimes.com/section/sports
Failed to download section: https://www.nytimes.com/section/science
Failed to download section: https://www.nytimes.com/section/health
Failed to download section: https://www.nytimes.com/section/opinion
Failed to download section: https://www.nytimes.com/section/arts
Failed to download section: https://www.nytimes.com/section/books
Failed to download section: https://www.nytimes.com/section/movies
Failed to download section: https://www.nytimes.com/section/arts/music
Failed to download section: https://www.nytimes.com/section/arts/television
Failed to download section: https://www.nytimes.com/section/style
Failed to download section: https://www.nytimes.com/section/dining
Failed to download section: https://www.nytimes.com/section/fashion
Failed to download section: https://www.nytimes.com/section/garden
Failed to download section: https://www.nytimes.com/section/travel
Failed to download section: https://www.nytimes.com/section/education
Failed to download section: https://www.nytimes.com/section/multimedia
Failed to download section: https://www.nytimes.com/section/obituaries
Failed to download section: https://www.nytimes.com/section/magazine
Traceback (most recent call last):
File "runpy.py", line 194, in _run_module_as_main
File "runpy.py", line 87, in _run_code
File "site.py", line 82, in <module>
File "site.py", line 77, in main
File "site.py", line 49, in run_entry_point
File "calibre\utils\ipc\worker.py", line 215, in main
File "calibre\gui2\convert\gui_conversion.py", line 31, in gui_convert_recipe
File "calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert
File "calibre\ebooks\conversion\plumber.py", line 1108, in run
File "calibre\customize\conversion.py", line 242, in __call__
File "calibre\ebooks\conversion\plugins\recipe_input.py ", line 137, in convert
File "calibre\web\feeds\news.py", line 1056, in download
File "calibre\web\feeds\news.py", line 1236, in build_index
ValueError: No articles found, aborting
Last edited by theducks; 08-04-2024 at 10:39 AM. Reason: SPOILER LOG files
jamesran is offline   Reply With Quote
Old 08-04-2024, 09:01 AM   #14
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
Posts: 13,009
Karma: 76440556
Join Date: Nov 2007
Location: Toronto
Device: Libra H2O, Libra Colour
Quote:
Originally Posted by unkn0wn View Post
did you try this one?
https://github.com/kovidgoyal/calibr...mes_sub.recipe

you still haven't posted the log file!
The problem in all the recipes is
Quote:
Code:
 @property
    def nyt_parser(self):
        ans = getattr(self, '_nyt_parser', None)
        if ans is None:
            from calibre.live import load_module
            self._nyt_parser = ans = load_module('calibre.web.site_parsers.nytimes')
        return ans
It's related to a change that "Move NYT JSON parsing code into its own module so it can be shared"
PeterT is offline   Reply With Quote
Old 08-04-2024, 10:37 AM   #15
unkn0wn
Fanatic
unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.unkn0wn can do the Funky Gibbon.
 
Posts: 573
Karma: 82944
Join Date: May 2021
Device: kindle
Quote:
Originally Posted by jamesran View Post
my laptops is a little old , only the 32bit window operating system can be installed on it, the newest calibre requires 64bit system, but the schedules of old calibre can not work properly.
looks like there's no fix as @PeterT said.

How old is your processor? check if its 64bit compatible, you can run linux with persistence data/memory

I think even a 15 year old laptop would have a core2duo processor.
unkn0wn is offline   Reply With Quote
Reply

« Previous Thread | Next Thread »

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
NYT Spanish New York Times Español El Times Recipe compa Recipes 0 03-24-2022 03:40 PM
The New York Times Vikas Chahal Recipes 0 05-09-2021 04:55 AM
fetch news schedule several times a day geertdeprez Recipes 1 06-06-2011 06:31 AM
New York Times Paywall? Starson17 Recipes 7 04-03-2011 09:33 PM
New York Times on 505 Hamza Sony Reader 21 03-03-2008 01:55 PM


All times are GMT -4. The time now is 04:46 AM.

Contact Us - FAQ - Guidelines - Privacy - Top

MobileRead.com is a privately owned, operated and funded community.