[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by RoundRobbinReadz

I think this is a simple ish question, but I can't find the answer. So, hence, my first post. I'll ask in two parts. This is using the Calibre plugin version of FanFicFare.

I created a custom column, in Calibre. Custom column name. Needs to be labeled in personal.ini. What's the code to do this? The label / name and any other lines of code needed?

I'm not sure what you mean, but I think you assume a greater degree of FFF-Calibre integration than exists.

I refer to the data FFF collects and handles as "metadata entries", which are separate from Calibre data, AKA columns. Simplifying a bit, FFF metadata entries are divided into 'standard' entries collected for most/all sites and 'site specific' entries that are only used by that site. For example, every site has title and author; snapeflavours is potionsandsnitches.org only.

If you want FFF to populate a Calibre custom column on download/update, you can set it in the FFF Custom Columns config tab (for standard metadata entries) in personal.ini with custom_columns_settings.

If you want a Calibre custom column to appear in your ebooks' title page on update (it's assumed the Calibre book is created during initial download), there's a checkbox in the FFF personal.ini config tab 'Pass Calibre Columns into FanFicFare on Update/Overwrite', and a button to show you want what FFF metadata entry names each column will be placed in. They will automatically be labeled the same as the Calibre Columns.

You can then used those metadata entry names in titlepage_entries or logpage_entries.

Originally Posted by RoundRobbinReadz

Second part of the question:
Where would I look to find this information? Is there a wiki or FAQ I've missed? Any central location with links to the many resources designed to learn the basics of formatting custom columns in Calibre/FFF? Feels like I'm just missing a link tree or something similar.

The FFF github project has a wiki which also has an FAQ.

A lot of INI settings are documented primarily in defaults.ini. You can see the defaults.ini for FFF Calibre plugin from the button on the FFF personal.ini config tab , or on github.

[JimmXinu]

New Test Version Posted

2025-02-23
- For adapter_mcstoriescom: Remove /../ from Get Story URLs from web page
- adapter_mcstoriescom: Suppress site URLs that look like stories but aren't. #1160

[ernand]

A problem that suddenly started happening to me is that FFF is asking for my AO3 login information to update my fics. I already have that information on the .ini, and I have not changed it.

I keep getting the Error: Failed to Login for URL: https://archiveofourown.org/works/57...iew_adult=true) with username: (Ernand)

[theladyoffangorn]

Originally Posted by ernand

A problem that suddenly started happening to me is that FFF is asking for my AO3 login information to update my fics. I already have that information on the .ini, and I have not changed it.

I keep getting the Error: Failed to Login for URL: https://archiveofourown.org/works/57...iew_adult=true) with username: (Ernand)

I am having the same issue, started this evening. I have checked and I am using latest version of both Calibre and FFF, and have checked my personal.ini and it is correct (and worked for the last month).

[theladyoffangorn]

This is the entire error message I'm getting. Tried logging out from AO3 on any other devices
calibre, version 7.26.0
ERROR: Unhandled exception: <b>FailedToLogin</b>:Failed to Login for URL: (https://archiveofourown.org/users/Th...marks?page=156) with username: (TheLadyOfFangorn)

calibre 7.26 embedded-python: True
Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19045')
Python 3.11.5
Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre.exe
Successfully initialized third party plugins: FanFicFare (4, 42, 0)
Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 711, in get_urls_from_page_menu
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 734, in get_urls_from_page
File "C:\Users\rick\AppData\Roaming\calibre\plugins\Fan FicFare.zip\fanficfare\geturls.py", line 44, in get_urls_from_page
File "C:\Users\rick\AppData\Roaming\calibre\plugins\Fan FicFare.zip\fanficfare\adapters\base_adapter.py", line 474, in get_urls_from_page
File "C:\Users\rick\AppData\Roaming\calibre\plugins\Fan FicFare.zip\fanficfare\adapters\base_otw_adapter.p y", line 605, in before_get_urls_from_page
File "C:\Users\rick\AppData\Roaming\calibre\plugins\Fan FicFare.zip\fanficfare\adapters\base_otw_adapter.p y", line 127, in performLogin
fanficfare.exceptions.FailedToLogin: Failed to Login for URL: (https://archiveofourown.org/users/Th...marks?page=156) with username: (TheLadyOfFangorn)

[readerboy7]

I am unable to download the following fanfic from AO3: https://archiveofourown.org/works/49500382 (locked to registered users only)

Calibre 7.26, FanFicFare v4.42.0
Personal.ini does contain my username and password

Error message when run through calibre is
'NoneType' object has no attribute 'get_text'

Error message when run via
calibre-debug.exe --run-plugin FanFicFare -- https://archiveofourown.org/works/49500382
is

Traceback (most recent call last):
  File "runpy.py", line 198, in _run_module_as_main
  File "runpy.py", line 88, in _run_code
  File "site.py", line 83, in <module>
  File "site.py", line 78, in main
  File "site.py", line 50, in run_entry_point
  File "calibre\debug.py", line 289, in main
  File "calibre_plugins.fanficfare_plugin.__init__", line 146, in cli_main
  File "C:\Users\{Name}\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\cli.py", line 346, in main
  File "C:\Users\{Name}\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\cli.py", line 322, in dispatch
  File "C:\Users\{Name}\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\cli.py", line 437, in do_download
  File "C:\Users\{Name}\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\adapters\base_adapter.py", line 342, in getStoryMetadataOnly
  File "C:\Users\{Name}\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\adapters\base_adapter.py", line 446, in doExtractChapterUrlsAndMetadata
  File "C:\Users\{Name}\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\adapters\base_otw_adapter.py", line 199, in extractChapterUrlsAndMetadata
  File "C:\Users\{Name}\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\htmlcleanup.py", line 77, in stripHTML
AttributeError: 'NoneType' object has no attribute 'get_text'

I have been able to download other fanfics from AO3 recently, but I don't think any of them were registered users only.

(Edit: windows 10 computer, if that matters)

[grimorie]

Originally Posted by ernand

A problem that suddenly started happening to me is that FFF is asking for my AO3 login information to update my fics. I already have that information on the .ini, and I have not changed it.

I keep getting the Error: Failed to Login for URL: https://archiveofourown.org/works/57...iew_adult=true) with username: (Ernand)

I have the same problem with downloading from Ao3 asking for login, I'm using a mac, if that helps.

[madame_newbie]

I ran into the same problem as well as off today. It keeps asking me to log in even for works that aren't behind a lock. I do think it could on AO3's side because downloading has been slow for me (my downtime's set to 6) but it was slow even for one medium length fic.

[Pixiestyxs]

I've also been having the `'NoneType' object has no attribute 'get_text'` error, it seems like every 1 out of 5 urls from AO3 give me this error. It just started yesterday it seems like. I'm on Mac.

I have more examples but all of these are freshly giving me the error this morning:
https://archiveofourown.org/works/8130674
https://archiveofourown.org/works/5519189
https://archiveofourown.org/works/6455950
https://archiveofourown.org/works/7194323
https://archiveofourown.org/works/8941855

[JimmXinu]

Instead of the usual "This work is only available to registered users of the Archive." or "Sorry, we couldn&#x27;t find the work you were looking for.", the site is returning a page that says:

Reminder:
This site is in beta. Things may break or crash without notice.

There's a notice linked on the front page about "Intermittent site slowness and errors" including:

We estimate the new Elasticsearch servers will be in place by early April. Until then, you might run into the following issues, especially during busy periods:

• all pages loading more slowly
• Elasticsearch-powered pages like search results and work and bookmark listings taking longer to update
• error pages
• automated checks from Cloudflare's Under Attack mode
• stricter rate limiting
• issues with services like the Wayback Machine or Tumblr RSS accounts that rely on bots, scrapers, or other automated tools, which we have deprioritized in favor of traffic from users

FFF likely is affected by one or more of these. And note that part about early April. This may be going on for a some time.

"Fix" (but not really)

• I can add code to detect the "in beta" page and report it instead of parsing failing.
• I can increase slow_down_sleep_time in defaults.ini for AO3.

I honestly don't know of anything else I can do.

Workaround

If you are already logged in, in your browser, the Browser Cache feature appears to work:

[archiveofourown.org]
always_login:false
## comment out username at least, otherwise Get Stories From Page will try to login
# username:XXX
# password:XXX
use_browser_cache:true
use_browser_cache_only:true
open_pages_in_browser:true

[Pixiestyxs]

Thanks! I'll try the workaround and just count down the days until April. I appreciate all the work you do on this.