[GUI Plugin] FanFicFare

[JimmXinu]

Sorry, I don't know what's going on with that log.

There is duplication of some output (or possibly two instances running??) and everything is out of order from what I see when I run debug.

There's a debug output from FFF initialization:

FFF: DEBUG: 2024-08-07 15:55:28,248: calibre_plugins.fanficfare_plugin.fff_plugin(217): Plugin FanFicFare macmenuhack file_path:C:\Users\ljcod\AppData\Roaming\calibre\plugins\fanficfare_macmenuhack.txt

But it should be appearing after most of the other lines.

[johansolo]

Originally Posted by JimmXinu

There is an issue with Ubuntu and Debian packaged Calibre not working recently. My response is to use the official Calibre download.

(Near as I can tell, the problem is python3-urllib3_2.0.7 not requiring python3-requests-toolbelt? Users report success installing python3-requests-toolbelt or downgrading python3-urllib3 to 1.26.18.)

If you are using the official Calibre download, I want to know about.

I was able to fix that problem using:

pip install --upgrade twine requests-toolbelt

I wrote about in this very thread.
https://www.mobileread.com/forums/sh...postcount=9791

[applegaa]

Originally Posted by JimmXinu

New Test Version Posted

2024-07-16
- Allow scribblehub.com story URLs w/o title and search calibre w/o title



I feel like this has come up before. But it may have been a different site.

Let's try this: I've changed the adapter to accept URLs w/o title, but to still use it, and code to that Plugin that searches for existing books without the title.

I don't read this site, so I'm depending on you guys to tell me if it does something unintended.

The test version was working great and I didn't run into any issues with it.
I finally got around to installing the new monthly version today and it doesn't appear to have this functionality. Was there a reason it got pulled?

- Andrew

[JimmXinu]

Originally Posted by applegaa

The test version was working great and I didn't run into any issues with it.
I finally got around to installing the new monthly version today and it doesn't appear to have this functionality. Was there a reason it got pulled?

- Andrew

That change is included in the released version. I double checked the posted zip.

[applegaa]

Originally Posted by JimmXinu

That change is included in the released version. I double checked the posted zip.

Calibre shows version 4.37.0 as Installed and Available.

I just restarted in debug mode and then used the following as my test cases. I did verify that they all ended up at the first URL when entered in my browser.

https://www.scribblehub.com/series/1...rawler-litrpg/
https://www.scribblehub.com/series/1...ake-name-here/
https://www.scribblehub.com/series/1...fake-name-here
https://www.scribblehub.com/series/1144593/
https://www.scribblehub.com/series/1144593

The "fake-name-here" URLs actually matched the existing story and asked if I wanted to update the URL. I'm not sure why it worked today but not last night. I'll keep watching and see if it happens again.

However, the ability to enter a URL without a title still doesn't work. The last two URLs above were just ignored by FanFicFare. It wouldn't pick them up from the clipboard and did nothing if I manually pasted them in. That's not a critical feature for me, but I wanted to mention it.

I'm not including the debug log because the title change worked and the no title URLs were not even logged.


For the record, from last night's failure, this was the old URL:
https://www.scribblehub.com/series/8...-thief-litrpg/
And this was the URL that resulted in a new epub:
https://www.scribblehub.com/series/8...-arcane-thief/
The author's name and URL did not change. Also, yes, this is the same story that prompted my original request. Snollygoster really likes to change the name around.

Okay, new wrinkle... Before posting this I got the bright idea, since it was working now, to delete the new epub and update the old one. I didn't think to restart in debug mode this time, sorry, but I gave it the new URL and it's now downloading all 193 chapters again instead of updating the existing 192 chapter epub.

After using the "new" URL from last night, I discovered that the name and URL has changed again. The newest new one is:
https://www.scribblehub.com/series/8...-thief-litrpg/

Curious what would happen, I dumped that URL into FanFicFare. Rather than complaining that it couldn't determine which book to update or simply downloading a third copy of it, it actually matched up to the new epub and asked if I wanted to update the URL. However, it didn't actually update it. All that it updated was the Title itself. I'll try again when there is actually a new chapter to add, as maybe the URL change got dropped without that update?

I am so confused right now...

- Andrew

[JimmXinu]

I've commented before that I don't read that site. So when I make a change to address a reported issue, that's generally the only thing I'm looking at--I'm depending on users to report any related issues or knock-on effects.

I will look at adapting the logic we use for ffnet to scribblehub.

Fair warning, I expect that some form of title will be necessary. These probably won't work:
https://www.scribblehub.com/series/1144593/
https://www.scribblehub.com/series/1144593

[riothamus]

Originally Posted by applegaa

Curious what would happen, I dumped that URL into FanFicFare. Rather than complaining that it couldn't determine which book to update or simply downloading a third copy of it, it actually matched up to the new epub and asked if I wanted to update the URL. However, it didn't actually update it. All that it updated was the Title itself. I'll try again when there is actually a new chapter to add, as maybe the URL change got dropped without that update?

I am so confused right now...

- Andrew

Just curious, I've been trying to download from scribblehub the last few days with flaresolverr (even updated flaresolverr) and I'm getting timeouts for detected challenges. Are you having any issues?

[JimmXinu]

New Test Version Posted

2024-08-14
- adapter_scribblehubcom: Allow for changing title in story URL.
- Update adapter_syosetucom.py (#1095) Fix update retrieval for series not completed, thanks dado330
- Make CLI username prompt more visible

I've adapted similar logic to ffnet for scribblehub for INI sections, plugin URL search, and chapter URL normalization.

[applegaa]

Originally Posted by riothamus

Just curious, I've been trying to download from scribblehub the last few days with flaresolverr (even updated flaresolverr) and I'm getting timeouts for detected challenges. Are you having any issues?

I do occasionally, but not that often and I just retry the failed one. Except when the site goes into its quasi-lockdown state, I've only had one ever failed twice in a row.

That said, I don't use flaresolverr, as I never got it to work reliably. Instead, I just added "use_cloudscraper:true" to the "[www.scribblehub.com]" section of my personal.ini. It's not perfect, but it greatly reduced the 403 rate I was seeing before using it.

- Andrew

[riothamus]

Originally Posted by applegaa

I do occasionally, but not that often and I just retry the failed one. Except when the site goes into its quasi-lockdown state, I've only had one ever failed twice in a row.

That said, I don't use flaresolverr, as I never got it to work reliably. Instead, I just added "use_cloudscraper:true" to the "[www.scribblehub.com]" section of my personal.ini. It's not perfect, but it greatly reduced the 403 rate I was seeing before using it.

- Andrew

Thanks for the tip. That worked. Took two tries but it worked. I already had that line commented out in my .ini so I must have tried it in the past. Hopefully they'll fix flaresolverr soonish. Appreciate it.

[applegaa]

Originally Posted by JimmXinu

I've commented before that I don't read that site. So when I make a change to address a reported issue, that's generally the only thing I'm looking at--I'm depending on users to report any related issues or knock-on effects.

I will look at adapting the logic we use for ffnet to scribblehub.

Fair warning, I expect that some form of title will be necessary. These probably won't work:
https://www.scribblehub.com/series/1144593/
https://www.scribblehub.com/series/1144593

I understand you don't use the site and really appreciate that you continue to support it anyways.

I may have misunderstood the wording when you released the original test version. I thought it said that it would accept URLs without titles. It's not a feature I see myself using. I just tested it because I thought it was supported.


It looks like the issue was actually with the metadata for the older epub. It looked fine when I viewed it, but FanFicFare behaved weirdly when trying to update the story directly instead of from the URL. So, I just deleted it and will stick with the new one.

Sorry for not doing more thorough testing before reporting the issue.

- Andrew