08-09-2023, 12:12 PM | #1 |
Member
Posts: 20
Karma: 10
Join Date: May 2021
Device: kindle
|
Bloomberg Businessweek fail
calibre, version 6.24.0 (win32, embedded-python: True)
Conversion error: Failed: Fetch news from Bloomberg Businessweek Spoiler:
Last edited by theducks; 08-10-2023 at 02:48 AM. Reason: Please Spoiler Log files |
08-10-2023, 01:34 AM | #2 |
Evangelist
Posts: 498
Karma: 82764
Join Date: May 2021
Device: kindle
|
https://github.com/kovidgoyal/calibr...966c20472087c3
Maybe they are on to us! simultaneous downloads don't work anymore, so, it will take longer to fetch content. If you still face s2s_high_score error, use vpn or new ip, or else we can increase the delay further. |
Advert | |
|
08-15-2023, 05:54 PM | #3 |
Zealot
Posts: 129
Karma: 33000
Join Date: Feb 2010
Device: Currently:Voyage, Oasis 3, Kindle mobile apps, andKindle Fire
|
Still not working. Have tried recipe with VPN, three different locations, IP's.
Get same error: mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 307: s2s_high_score Could maybe increase delay? I don't see any "delay" in current recipe Last edited by mkgtu; 08-15-2023 at 05:57 PM. |
08-15-2023, 06:19 PM | #4 |
Zealot
Posts: 129
Karma: 33000
Join Date: Feb 2010
Device: Currently:Voyage, Oasis 3, Kindle mobile apps, andKindle Fire
|
In the latest recipe on github the original 7 second delay had been removed (#). The simultaneous downloads "3" had also been removed (#) and changed to "1".
You mention possibly "increasing the delay", but since there was no longer any delay in the recipe to increase, in calibre I "customized" the recipe by adding back "Delay 7" seconds right above the "Simultaneous downloads=1" So lines 74 and 75 read: delay = 7 # seconds simultaneous_downloads = 1 With that change the recipe then downloaded successfully, though, with the 7 second delay, quite slowly (14mins, 38secs) I should also note that I left the VPN "on". I'll try it again at some future time with no VPN and maybe shortening the delay a bit. |
08-15-2023, 07:19 PM | #5 |
Zealot
Posts: 129
Karma: 33000
Join Date: Feb 2010
Device: Currently:Voyage, Oasis 3, Kindle mobile apps, andKindle Fire
|
Have tried the 7 sec, single simultaneous download changes I reference above several more times. Have changed IP with VPN each time and/or used my own IP. Have changed delay to 2, 3, and back to 7.
It only worked once, and failed every other time with the same error, regardless of the delay or IP. Maybe I'll try again tomorrow. But it looks like Bloomberg guard dogs are pretty vigilant. |
Advert | |
|
08-16-2023, 01:30 AM | #6 |
Evangelist
Posts: 498
Karma: 82764
Join Date: May 2021
Device: kindle
|
download from my ip doesnt work anymore even after 2 weeks, website opens through browser but in calibre there's s2s error, I test with vpn.
to increase delay you have to increase values in time.sleep in pre_process, so remove the lower values in Code:
pause = random.choice((0.25, 0.5, 0.75, 1)) but the sleep time already ads up to 10 or more seconds for each article, sometimes it even takes a minute with the present values. And it takes like half an hour to fetch the whole thing, increasing delay further might be unnecessary. if you still want to, you can just remove the lower value 0.25 and add 1.25 to the random.choice. The idea was that with random delay instead of fixed delay, we could evade detection. (and this method worked for sometime with simultaneous downloads too). I tested the present recipe with vpn and its still working without issues. |
08-16-2023, 01:44 AM | #7 |
Evangelist
Posts: 498
Karma: 82764
Join Date: May 2021
Device: kindle
|
Okay I tried bloomberg recipe which has a lot of articles and takes like 30 minutes and it fetched okay.
For Businessweek we can maybe increase the delay in time.sleep(3) part to 5 or something. don't touch the random.choice. which might be unnecessary. Last edited by unkn0wn; 08-16-2023 at 02:14 AM. |
08-16-2023, 02:12 AM | #8 |
Evangelist
Posts: 498
Karma: 82764
Join Date: May 2021
Device: kindle
|
|
09-16-2023, 09:26 AM | #9 |
Member
Posts: 11
Karma: 10
Join Date: Sep 2023
Location: Mumbai
Device: Kindle Oasis
|
Bloomberg Businessweek fail
calibre, version 6.26.0 (win32, embedded-python: True)
ValueError: No articles found, aborting Fetch news from Bloomberg Businessweek Spoiler:
|
09-16-2023, 02:02 PM | #10 |
Evangelist
Posts: 498
Karma: 82764
Join Date: May 2021
Device: kindle
|
|
09-23-2023, 11:33 AM | #11 |
Member
Posts: 11
Karma: 10
Join Date: Sep 2023
Location: Mumbai
Device: Kindle Oasis
|
This recipe worked ! Thanks a ton !
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Vacuous Businessweek Articles | rozen | Recipes | 0 | 08-06-2011 12:08 AM |
iPad Bloomberg Businessweek: iPad Subscription | kjk | Apple Devices | 0 | 04-11-2011 12:15 AM |
iPad Bloomberg Businessweek: CEO Guide to the iPad | kjk | Apple Devices | 0 | 07-07-2010 11:18 AM |
Bloomberg BusinessWeek Article on Kindle | sirmaru | Amazon Kindle | 1 | 06-18-2010 02:17 PM |
BusinessWeek article: PDA for managing well-being | Colin Dunstan | Lounge | 1 | 08-17-2004 12:20 PM |