Recipe for Ars Technica only loading top level headings

[MDofPerth]

I've been enjoying a great recipe for Ars Technica for many years. Really appreciate Darko Miletic, Sujata Raman, Alexis Rohou, Tom Sparks providing and maintaining this over the years.

I am experiencing a problem similar to the one posted 09-02-2016, by renszarv and I think fixed back then by Kovid Goyal.

Since late August 2024, the Ars Technica recipe is returning only the top level headings; content is absent.

[I am using Calibre 7.17, but I noticed this problem on the previous release as well]

[unkn0wn]

it still is working.

[MDofPerth]

Originally Posted by unkn0wn

it still is working.

Which version of Calibre are you using unkn0wn?

[unkn0wn]

copy the log into a .txt file and attach it here.

you can get the log from Jobs (footer-right) and copy log of this recipe after run.

[MDofPerth]

Originally Posted by unkn0wn

copy the log into a .txt file and attach it here.
you can get the log from Jobs (footer-right) and copy log of this recipe after run.

Thanks ukn0wn. I have attached the log. I appreciate your help with this.

BTW: As of this morning I am on Calibre v7.18, and I notice that in the release notes there is an improvement to Ars Technica mentioned. Unfortunately, I still have the same problem on this version, so I'm guessing there is something about my local configuration that is incorrect.

[PeterT]

It looks lioke you have out of date security certificates.

See an excerpt from your log

Spoiler:

Could not fetch link https://arstechnica.com/?p=2048683
Traceback (most recent call last):
File "mechanize\_urllib2_fork.py", line 1236, in do_open
File "http\client.py", line 1286, in request
File "http\client.py", line 1332, in _send_request
File "http\client.py", line 1281, in endheaders
File "http\client.py", line 1041, in _send_output
File "http\client.py", line 979, in send
File "http\client.py", line 1458, in connect
File "ssl.py", line 517, in wrap_socket
File "ssl.py", line 1108, in _create
File "ssl.py", line 1379, in do_handshake
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1006)

Try visiting the site in your browser and see if that helps.

[unkn0wn]

yea like peter said, if you are on windows, visit the ars technica website from windows edge browser or also maybe your default browser.
it might install the missing ssl certificates.

[MDofPerth]

Thank you PeterT and unk0wn.
Visiting the site and exporting the PEM certificate chain, and then importing that (using Edge in this case, but I expect other browsers would also work) did the job.