[GUI Plugin] FanFicFare

[FrostWard]

Originally Posted by FrostWard

It was actually ao3. I did read a bit back and noticed ao3 was having some issues, but i assumed it would at least show some progress. In my case it would just force me to close caliber entirely.

Ok, i fixed it. I just had to downgrade the version of caliber back to 7.22, and it started working again

[JimmXinu]

I don't of any reason the Calibre version would make a difference.

Calibre 7.24 just came out, could you try that one?

[vorm]

Hello, I need some help. I'm using the Calibri plugin and would like to know if there's a way to set up my personal.ini file to save GIFs as GIF files instead of converting them to JPG.

Specifically, is there an option where I can whitelist/blacklist what types of files are processed?

[JimmXinu]

Originally Posted by vorm

Hello, I need some help. I'm using the Calibri plugin and would like to know if there's a way to set up my personal.ini file to save GIFs as GIF files instead of converting them to JPG.

Specifically, is there an option where I can whitelist/blacklist what types of files are processed?

No, there isn't a setting for processing specific file types.

FFF downsizes large images and converts to jpg because the expected target platform is e-ink book readers.

You can prevent any image processing with:

[epub]
no_image_processing:true

[Linwe]

Ok, I think I posted about this once before a long while ago without any real resolution (primarily, I think, because it wasn't a repeatable issue) but here's something I'm getting quite frustrated with now. I'm open to any ideas and help.

I'm primarily using Opera for my browser to keep track of and update stories from ffnet. I'm having random stories, that have previously been updated through FFF without issue, now seem to be throwing out 403 Errors when I try to update.

Status | Error
Title | Mind Over Magic
Author | DZ2
Comment | HTTP Error in FFF '403 Client Error: Forbidden for url: https://www.fanfiction.net/s/1440984...Magic'(403)
URL | https://www.fanfiction.net/s/14409840/1/Mind-Over-Magic

I use the browser cache feature; make sure the Captcha has been dealt with (usually using another story that I'm either not updating, currently reading/finishing, or is just totally unrelated to get the Captcha issue out of the way); the chapter update is usually a few hours old so I don't think it's timing-related; I've even cleared my cache files and reload all the relevant webpages to try again, and to no success. I've had to resort to using FireFox to update, which is a headache now because it drags on my laptop resources and slows things down and yet haven't had issues (so far) using that as a backup. But why?? It's not always consistent on which story to throw an error on either, but when it picks one FFF just refuses to have anything to do with it. I can download other stories and updates without problem though. Sometimes, if I download something else first THEN it will work, but this does not always work either.

Please, WHAT is going on??? Is this something wrong with using Opera, is it potentially on FFnet's end? Sometimes the error message I'll get just reads that there's some problem with reading the URL and not just that it's "forbidden for url: (...)". I'm just so confused, because again this isn't a consistent problem - the story I have issues with seems to change almost weekly sometimes (this week it's id 14409840, last time it was id 14122375, before that it was something else...) I have changed literally nothing in my settings for months beyond updating FFF plugin and calibre.

[ownedbycats]

Just a silly question. but have you been refreshing after loading a page with captcha? It looks like it from your post but not sure. Thats a usual catch for me.

[JimmXinu]

Originally Posted by Linwe

Ok, I think I posted about this once before a long while ago without any real resolution (primarily, I think, because it wasn't a repeatable issue) but here's something I'm getting quite frustrated with now. I'm open to any ideas and help.
...

For a problem I can't see for myself, I'm largely limited to speculation.

• FFF makes certain assumptions about story/chapter URLs and if they don't match exactly what's in the cache, it's a problem. A few years ago, a user had issues with a browser security feature changing the URLs. But that was on Firefox.
  
• The default browser_cache_age_limit is 4.0 hours. FFF ignores cache entries older than that. And, depending on the browser, it can sometimes be difficult to get the browser to re-cache the page.
  
• Some sites just mark their pages as no-cache. It seems unlikely ffnet would do that for only some pages, but I don't put anything past cloudflare--and they seem to be the dominate web server on the net these days.
  
• On one occasion, there was a corner case where our cache reading code didn't compute the hash correctly. We were eventually able to pin down a specific URL that could replicate the problem where I could see it and fix it.

The only way I know of to get any further is scanning every cache entry and looking for the matching URL.

I have code to do that, but only as a debugging tool. If you are prepared to try purpose-built debugging versions, open an issue on github and we'll take it up there.


Personally, I use use_browser_cache_only:true for ffnet--I assume direct access is never going to work and only use cache. Then I use open_pages_in_browser:true in case I forgot to pre-cache the pages. But I use Firefox as my normal browser.

[El_Pirato]

Are we going to get inkitt.com on the list at any time?

[iakrus]

hi there!
i need to mass update my library (i've completely redone a lot of my metadata and now redirect a fair bit in a way i didnt use to) WITHOUT mass updating my library (i have read the faq).

i have 17,000 fics so i'm fully expecting this to take months. i have a few questions-
whats the largest safe number and at what intervals? what size batches and how far apart is least likely to cause issues?
also is there a limit cap that i could hit too, if i do 10 every 10 min for 9 hours straight for example, would that be similar to doing 100 an hour every 9 hours (i know thats not the same number but its the principle)
does it change if i'm just updating the metadata from the websites and not updating the fics- that feels more like a skim than actually doing anything but i get that probably isnt how it works.
what would you suggest?

[JimmXinu]

Multi-reply

Originally Posted by El_Pirato

Are we going to get inkitt.com on the list at any time?

See https://github.com/JimmXinu/FanFicFa...ent-2539046005

This has been discussed before and rejected as part of main stream FFF. I don't want to add any new sites that are paid author content. See #361 #1087 #1109 (Discussion)

Second reply

Originally Posted by iakrus

hi there!
i need to mass update my library (i've completely redone a lot of my metadata and now redirect a fair bit in a way i didnt use to) WITHOUT mass updating my library (i have read the faq).

i have 17,000 fics so i'm fully expecting this to take months. i have a few questions-
...

Those are all good questions that I don't have answers for. We just don't have any hard numbers for the various limits and they all depend on which site.

When I'm doing anything more than ~25 stories at a time, I both batch and set a longer slow_down_sleep_time. Default values range from 0 to 12s depending on site. The default sleep for a site gets bumped up when I hear from multiple users having troubles with a site.

Reading metadata request is more light weight for most sites, but is still pretty heavy for sites that paginate the chapter list, like SB/SV/XenforoForum sites. An SB/SV story with a couple hundred thread marks can generate dozens of requests just for the chapter list.

If you don't have a Saved Metadata Column, definitely set that up first. If you already had one set up, use Update from Saved Metadata Column if you can.

I've been reading and collecting fanfic for 30 years and my library is not quite 6600. How do you have time to have read 17k stories?