Fetch news Financial Times Print Edition failing

[dagon]

I was not aware recipe problems are no longer reported as bugs, and posted the following as a bug. Kovid Goyal has kindly pointed me to this forum as the appropriate place to post such a notification. Here is his response, followed by all of the information I sent. Thank you.

==============================================I do not provide support for recipes (a recipe is script to download
news from a source). The best place to request recipes for news download
sources or request help with a recipe is the calibre recipes forum at
https://www.mobileread.com/forums/forumdisplay.php?f=228


** Changed in: calibre
Status: New => Invalid

--
You received this bug notification because you are subscribed to the bug
report.
https://bugs.launchpad.net/bugs/2035105

Title:
Fetch news from Financial Times Print Ed failing

Status in calibre:
Invalid

Bug description:
Attempts to fetch the Financial Times - Print Edition are now failing due to conversion error.
Environment:
Windows 10 Pro 22H2 19045.3324
Intel i9-9940x at normal speed (not overclocked) with 64GB RAM

Calibre error report:
calibre, version 6.26.0 (win32, embedded-python: True)
Conversion error: Failed: Fetch news from Financial Times - Print Edition

Fetch news from Financial Times - Print Edition
Failed to initialize plugin: 'C:\\Users\\Owner\\AppData\\Roaming\\calibre\\plug ins\\DeDRM.zip'
Conversion options changed from defaults:
verbose: 2
Resolved conversion options
calibre version: 6.26.0
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': 'original',
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_download_recipe': False,
'dont_split_on_page_breaks': True,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': False,
'epub_inline_toc': False,
'epub_max_image_size': 'none',
'epub_toc_at_end': False,
'epub_version': '2',
'expand_css': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'flow_size': 260,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x000002CDCECB9A20>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': False,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.OutputProfile object at 0x000002CDCECB8130>,
'page_breaks_before': None,
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': '',
'search_replace': None,
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': '',
'sr1_search': '',
'sr2_replace': '',
'sr2_search': '',
'sr3_replace': '',
'sr3_search': '',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': None,
'transform_html_rules': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:financial_times_print_edition
Trying to get latest version of recipe: financial_times_print_edition
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.87 Safari/537.36
Traceback (most recent call last):
File "runpy.py", line 196, in _run_module_as_main
File "runpy.py", line 86, in _run_code
File "site.py", line 83, in <module>
File "site.py", line 78, in main
File "site.py", line 50, in run_entry_point
File "calibre\utils\ipc\worker.py", line 215, in main
File "calibre\gui2\convert\gui_conversion.py", line 31, in gui_convert_recipe
File "calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert
File "calibre\ebooks\conversion\plumber.py", line 1108, in run
File "calibre\customize\conversion.py", line 242, in __call__
File "calibre\ebooks\conversion\plugins\recipe_input.py ", line 138, in convert
File "calibre\web\feeds\news.py", line 1068, in download
File "calibre\web\feeds\news.py", line 1237, in build_index
File "<string>", line 71, in parse_index
ValueError: The Financial Times Newspaper is not published today.

To manage notifications about this bug go to:
https://bugs.launchpad.net/calibre/+...+subscriptions

[unkn0wn]

https://www.ft.com/todaysnewspaper/edition/uk this is the link we use in the recipe.
https://www.ft.com/todaysnewspaper

both of these links wont show sections and articles like it did before without login. Maybe it'll start working again after some days, until then, use the feeds based recipe.

how long was this not working for? Maybe there was no ft newspaper published today.

[dagon]

Unlike my experience with Deutsche Welle (please see thread), as of this morning the FT fetch still fails. For me, both DW and FT began failing a fetch call on 09/09/2023, both reporting a conversion error.

I regularly fetch 50+ publications. Usually a failed fetch will only persist for a few days, and seems to be caused by a particular article having an unusual structure. I just wait them out. The recent DW and FW failures were different in that both were conversion errors and persisted for some days. I thought it possible both websites had changed their structure at the same time (very rare in my experience).

As you note, perhaps it will begin working again. At least the non "Print Edition" recipe continues to fetch.

Thanks for your quick response.