[GUI Plugin] FanFicFare

[JimmXinu]

Originally Posted by WolFen

So at the end of it entire Ao3 section would look like this?


I could see include_logpage is usually set to false, so I hope grabbing that section and only changing it to true does the job?
As for what to include in the logpage, I assume using # extra_logpage_entries: is what’s needed

I haven’t put it in my personal.ini yet, as I want to make sure I didn’t screw it up more beforehand lol

You could make a second calibre library for testing changes. "Try it to see if it works" is a primary testing technique, IMO.

I will point out obvious errors, but if you haven't tried it, I'm not going to either.

• Look for the paragraph in add_to_ about "Gotcha". You need a leading comma(,) to keep them as lists.
• Keywords with a list, in general, shouldn't be on the next line like you have extra_titlepage_entries.
• OTOH, multiple line settings like custom_columns_settings will only work if all lines to be included have leading whitespace. That indicates to the INI parser they are a continuation.

I've fixed the format issues, but I don't promise it does everything you want:

Spoiler:

[archiveofourown.org]
#username:XXXXXXXX
#password:XXXXXXXX
#is_adult:true
#always_login:true

add_to_extra_valid_entries:series04, series05, series06, series07, series08, series09,  series10, series11, series12, series13, series14, series15, series16, series17, series18, series19, series20, series04Url, series05Url, series06Url, series07Url, series08Url, series09Url, series10Url, series11Url, series12Url, series012rl, series13Url, series14Url, series15Url, series16Url, series17Url, series18Url, series19Url, series20Url, series04HTML, series05HTML, series06HTML, series07HTML, series08HTML, series09HTML, series10HTML, series11HTML, series12HTML, series13HTML, series14HTML, series15HTML, series16HTML, series17HTML, series18HTML, series19HTML, series20HTML 
series04HTML_label:Additional Series 
series05HTML_label:Additional Series 
series06HTML_label:Additional Series 
series07HTML_label:Additional Series 
series08HTML_label:Additional Series 
series09HTML_label:Additional Series 
series10HTML_label:Additional Series 
series11HTML_label:Additional Series 
series12HTML_label:Additional Series 
series13HTML_label:Additional Series 
series14HTML_label:Additional Series 
series15HTML_label:Additional Series 
series16HTML_label:Additional Series 
series17HTML_label:Additional Series 
series18HTML_label:Additional Series 
series19HTML_label:Additional Series 
series20HTML_label:Additional Series  



add_to_make_linkhtml_entries:,series04,series05,series06,series07,series08,series09,series10,series11,series12,series13,series14,series15,series16,series17,series18,series19,series20  



extra_titlepage_entries:series04HTML,series05HTML,series06HTML,series07HTML,series08HTML,series09HTML,series10HTML,series11HTML,series12HTML,series13HTML,series14HTML,series15HTML,series16HTML,series17HTML,series18HTML,series19HTML,series20HTML



custom_columns_settings:
 series=>#multiseries,a
 series00=>#multiseries,a
 series01=>#multiseries,a
 series02=>#multiseries,a
 series03=>#multiseries,a
 series04=>#multiseries,a
 series05=>#multiseries,a
 series06=>#multiseries,a
 series07=>#multiseries,a
 series08=>#multiseries,a
 series09=>#multiseries,a
 series10=>#multiseries,a
 series11=>#multiseries,a
 series12=>#multiseries,a
 series13=>#multiseries,a
 series14=>#multiseries,a
 series15=>#multiseries,a
 series16=>#multiseries,a
 series17=>#multiseries,a
 series18=>#multiseries,a
 series19=>#multiseries,a
 series20=>#multiseries,a


## include a Update Log page before the story text. If 'true', the
## log will be updated each time the epub is and all the metadata
## fields that have changed since the last update (typically
## dateUpdated,numChapters,numWords at a minimum) will be shown.
## Great for tracking when chapters came out and when the description,
## etc changed.
## Plugin will now preserve the log page when the epub is overwritten,
## too.
include_logpage: true
## If set to 'smart', logpage will only be included if the story is
## status:In-Progress or already had a logpage. That way you don't
## end up with Completed stories that have just one logpage entry.
#include_logpage: smart
## By default, logpage is placed before the story chapters. This
## setting, if true, will place the logpage after the chapters
## instead.

# extra_logpage_entries:fandoms,freeformtags,freefromtags,ao3categories,comments,chapterstotal,kudos,hits,bookmarks,collections,byline,bookmarked,bookmarktags.bookmarksummary.bookmarkprivate,bookmarkrec,restricted,series00,series01,series02,series03


##This is what metadata is put into the main tags category in Calibre on download or update,
##if FFF is configured to update tags every time. Will add missing tags if updating an existing
##story but will not overwrite/remove other tags on update.
add_to_include_subject_tags:,extratags, ao3categories, fandoms, ships, status, warnings

[Linwe]

Hello all, I am having trouble updating a specific story: https://www.fanfiction.net/s/1435823...ing-Not-Earned . I can update other FFN stories, but for some reason this one will not update the latest chapter. More specifically, it will not update while I use the Opera browser but seems to have no issue if I switch to using Firefox; I do not seem to have this issue with other stories or sites (the Opera vs Firefox browser). The error message I get is the standard 403 Error despite doing the usual things (open first chapter then latest chapter, cloud captcha, etc). Can anyone else see if this duplicates for them, or have an idea what's going on with this particular story? This problem has been a repeated issue for me the last 8-ish chapters and it's kinda annoying having to open my backup web browser for this one story update.

TIA

Status | Error
Title | No Thing Not Earned
Author | john.mainer
Comment | HTTP Error in FFF '403 Client Error: Forbidden for url: https://www.fanfiction.net/s/1435823...arned'(403)
URL | https://www.fanfiction.net/s/1435823...ing-Not-Earned

[JimmXinu]

Yeah, ffnet has been blocked from direct download for the majority of users for years now. If you're only having troubles with one story, you're doing better than everybody else.

There are a couple work arounds that have been added to FanFicFare, but they require more effort:
https://github.com/JimmXinu/FanFicFa...erCacheFeature
https://github.com/JimmXinu/FanFicFa.../ProxyFeatures

I did check and I was able to download that story using Browser Cache feature after caching all the chapters.

[Linwe]

Originally Posted by JimmXinu

Yeah, ffnet has been blocked from direct download for the majority of users for years now. If you're only having troubles with one story, you're doing better than everybody else.

There are a couple work arounds that have been added to FanFicFare, but they require more effort:
https://github.com/JimmXinu/FanFicFa...erCacheFeature
https://github.com/JimmXinu/FanFicFa.../ProxyFeatures

I did check and I was able to download that story using Browser Cache feature after caching all the chapters.

I didn't know about the Proxy option before, but I have been using the Cache trick since FFN started being a *bleep* about downloading. For whatever reason it just doesn't work for this one story thru Opera (and yet works for Firefox). I was just wondering if it was something on my end or something about that particular story. Seems it must be something on my end. I'll keep jumping hoops then.

Thanks for the feedback!

[JimmXinu]

Originally Posted by Linwe

I didn't know about the Proxy option before, but I have been using the Cache trick since FFN started being a *bleep* about downloading. For whatever reason it just doesn't work for this one story thru Opera (and yet works for Firefox). I was just wondering if it was something on my end or something about that particular story. Seems it must be something on my end. I'll keep jumping hoops then.

Okay. Your initial post didn't say and I assumed.

We have had some weird Browser Cache corner cases where certain pages(chapters) didn't cache, or couldn't be found in the cache for certain people.

Basically, the only way to troubleshoot it is, a) if the user can duplicate and b) give me a copy of the cache files. Then I might be able to figure something out.

If you have a work around with Firefox, I'm inclined to not worry about it for a one off.

[WolFen]

Originally Posted by JimmXinu

You could make a second calibre library for testing changes. "Try it to see if it works" is a primary testing technique, IMO.

Ah I dunno how to exactly do that, so I guess I’ll just do the testing in the main one while copying the previous data beforehand so if something goes (more) wrong I can just place it back

Originally Posted by JimmXinu

Look for the paragraph in add_to_ about "Gotcha". You need a leading comma(,) to keep them as lists.

Yeah I saw that, just don’t exactly understand it if I’m being honest, but I think I tried it now?

Originally Posted by JimmXinu

add_to_make_linkhtml_entries:,series04,series05,se ries06,series07,series08,series09,series10,series1 1,series12,series13,series14,series15,series16,ser ies17,series18,series19,series20

Also I could see there’s a comma at the start (right after ':'), I’m uncertain if this is the leading comma you were talking about or if it was a mistake? I’m assuming it was a mistake but would like to double check.

Originally Posted by JimmXinu

[*]Keywords with a list, in general, shouldn't be on the next line like you have extra_titlepage_entries.

Yeah I noticed that and fixed it in my own notes, but I couldn’t fix it in the post as it had to wait for approval

Originally Posted by JimmXinu

OTOH, multiple line settings like custom_columns_settings will only work if all lines to be included have leading whitespace. That indicates to the INI parser they are a continuation.

Yeah they do have a ‘leading whitespace’ (From what I saw it’s just literally the space beforehand?) but for some reason when I copied and pasted it over, it removed the spaces. In personal.ini the space is there though





Following your changes it did fix some of the stuff, as copying over what was already in defaults.ini definitely messed some things up, and while there are still some problems, I don’t mind them too much, rather I’d like to try and focus again on the bookmarks problem which originally made me come here
I figured with #always_login:true it’ll now be able to also scrape my bookmarks data (The summary notes and tags) but it appears to have not worked? It being only in defaults.ini should mean it’ll do it now, right?
Currently in personal.ini the only place bookmarks are mentioned is for the logpage entries, so that shouldn’t interfere I don’t think

If we can’t figure it out easily it’s fine, I’ll just try and do it manually. I’ll probably have to skip the tags as it’ll take a lof of work to do by hand, but I know I only made notes for 2k… okay I might have to pick and choose with them.










Also not related to my own issue (And apologies if linking this isn't allowed) but from my experience https://fichub.net/ can still download fanfics from FFN. It might be possible to work something out with their site? Not sure how that would go though.

[mrEd]

Originally Posted by JimmXinu

Is that with using the posted test version? Because I've fixed once already.

That got it, Cheers!

[JimmXinu]

New Test Version Posted

2024-07-29
- Fix for paginated AO3 series, closes #1091

[cantper]

Originally Posted by JimmXinu

Yeah, ffnet has been blocked from direct download for the majority of users for years now. If you're only having troubles with one story, you're doing better than everybody else.

There are a couple work arounds that have been added to FanFicFare, but they require more effort:
https://github.com/JimmXinu/FanFicFa...erCacheFeature
https://github.com/JimmXinu/FanFicFa.../ProxyFeatures

I did check and I was able to download that story using Browser Cache feature after caching all the chapters.

The Web to EPUB extension seems to work for downloading ffnet stories, albeit it pauses every 23 or so chapters due to the ffnet spam detector. Is there some way to do that on FanFicFare as well?


Also, lately I found Royalroad is randomly inserting many different variants of "This story is stolen; please report if found on Amazon" into the middle of chapters. Is there any way to get rid of that message?

[thoughts]

Hey everyone,

I set up an outlook email account to capture fic URLs a year ago and it was working fine until last week.
Just trying to do some troubleshooting for why "get story URLs from email" is failing now.

The error is clearly a login issue

calibre, version 7.15.0
ERROR: Unhandled exception: <b>error</b>:b'LOGIN failed.'

Traceback (most recent call last):
File "calibre_plugins.fanficfare_plugin.fff_plugin" , line 592, in get_urls_from_imap_menu
File "BLAH", line 189, in get_urls_from_imap
File "imaplib.py", line 612, in login
imaplib.IMAP4.error: b'LOGIN failed.'

IMAP still works for other apps I've hooked that account to and I haven't changed the email login details (can still log in to the account just fine).

I've had to change authorisation protocol for outlook accounts connected to apps to OAuth2 previously to get them to continue to work.

How would I check which authorisation protocol the FanFicFare plug-in is using? Is OAuth2 able to be enabled for FanFicFare?

Any help, with troubleshooting the issue would be much appreciated. Thanks.

[johansolo]

Hi, I want to share an issue that just resolved right now.

Until last week FanFicFare worked fine but today I opened calibre and I noticed the icon in the main toolbar didn't show.

I searched in the toolbar configuration, uninstalled, reinstalled, and nothing worked. I can't even use activate/deactivate o customize buttons in preference-->Plugins.

I restarted in debug mode and get the log.

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/requests_toolbelt/_compat.py", line 48, in <module>
    from requests.packages.urllib3.contrib import appengine as gaecontrib
ImportError: cannot import name 'appengine' from 'requests.packages.urllib3.contrib' (/home/USER/.local/lib/python3.10/site-packages/urllib3/contrib/__init__.py)
.
.
.
CONTINUES UNTIL LINE 74

I searched the first lines and ended in:

https://stackoverflow.com/questions/...packages-urlli

And the answer https://stackoverflow.com/a/76438881 works for my problem.

pip install --upgrade twine requests-toolbelt

I uninstall and reinstall again and now works again. Even my personal.ini is fine (Now I know is stored in the library database)

I post this here because after the fix I searched this issue in this thread and I didn't get any result.

However I located a similar issue in the github page (https://github.com/JimmXinu/FanFicFare/issues/1079) but I don't have account there so I wrote here.

I hope that was useful.

[JimmXinu]

Originally Posted by cantper

The Web to EPUB extension seems to work for downloading ffnet stories, albeit it pauses every 23 or so chapters due to the ffnet spam detector. Is there some way to do that on FanFicFare as well?

Short answer is no.

Originally Posted by cantper

Also, lately I found Royalroad is randomly inserting many different variants of "This story is stolen; please report if found on Amazon" into the middle of chapters. Is there any way to get rid of that message?

This came up earlier this year, was discussed on github and a 'fix' contributed. I warned at the time that it was potentially a never ending cycle of changes and counter fixes...

[Ghostcat]

Originally Posted by cantper

The Web to EPUB extension seems to work for downloading ffnet stories, albeit it pauses every 23 or so chapters due to the ffnet spam detector. Is there some way to do that on FanFicFare as well?

Web to EPUB downloads into the browser cache, so you can use it to download a story (don't bother saving the epub file) then use the FFF Cache work-round to load the story into Calibre.

You can avoid the 23 chapter pause by setting a Manual Delay in W2E's Advanced options.

[JimmXinu]

New Version Released

Version 4.37.0 - 2024-08-01
- Fix for paginated AO3 series, closes #1091
- Allow scribblehub.com story URLs w/o title and search calibre w/o title
- Use titlepage_entry for titlepage_wide_entry unless explicitly set.
- adapter_storiesonlinenet: Fix for chapter select getting cover image link.
- adapter_storiesonlinenet: Remove ''s Page' to '.s Page'
- Full OTW settings for [http://www.adastrafanfic.com](http:/...trafanfic.com/) in defaults.ini
- Update translations

[WolFen]

I was mid-way updating my Ao3 downloads after following some of your Personal.ini fixes, and towards the end it stopped being able to connect to my Ao3 account.
I'm assuming it's probably due to me implementing #always_login:true but I can't be certain. The odd part is that it happened in the middle of the job, as in it managed to do just fine the start and middle but towards the end this error occurred.
I decided to test if it only happens with these works which I already downloaded and was just attempting to update the metadata for, and well I was able to download a completely new work no problem (With the metadata being the fixed version)
I could try deleting them all and redownloading them I guess, but I think it'll still be a problem as for some reason it can't connect to my Ao3 account anymore, and these works require you to login


I attached the debug log, I ran a few more attempts and received the exact same error.
My Username and Password are in Personal.ini btw, I didn't touch that and it worked fine beforehand.
I also attempted removing #always_login:true but that didn't fix the problem, same error and didn't offer the prompt from before, asking me to log in.

Spoiler:

ApplicationPaletteChange event ignored
Using calibre Qt style: True
FFF: DEBUG: 2024-08-01 19:14:09,710: calibre_plugins.fanficfare_plugin.fff_plugin(217): Plugin FanFicFare macmenuhack file_path:C:\Users\NF\AppData\Roaming\calibre\plug ins\fanficfare_macmenuhack.txt
calibre Debug log
calibre 7.16 embedded-python: True
Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19045')
Python 3.11.5
Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: Count Pages (1, 13, 6) && FanFicFare (4, 37, 0) && Last Modified (0, 8, 5)
calibre 7.16 embedded-python: True
Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19045')
Python 3.11.5
Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')
Interface language: None
EXE path: C:\Program Files\Calibre2\calibre-debug.exe
Successfully initialized third party plugins: Count Pages (1, 13, 6) && FanFicFare (4, 37, 0) && Last Modified (0, 8, 5)
QPA platform: windows
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 102.23899371069182 x 102.35820895522387
[0.00] Starting up...
[0.00] Showing splash screen...
[0.19] splash screen shown
[0.19] Initializing db...
[1.55] db initialized
[1.55] Constructing main UI...
[4.58] GUI main window shown
[4.67] main UI initialized...
[4.67] Hiding splash screen
FFF: DEBUG: 2024-08-01 19:17:54,226: calibre_plugins.fanficfare_plugin.fff_plugin(1157) : FanFicFare v4.37.0
FFF: INFO: 2024-08-01 19:17:54,335: calibre_plugins.fanficfare_plugin.prefs(216): Using default settings
FFF: DEBUG: 2024-08-01 19:17:54,377: configurable.py(1080): use_browser_cache:
FFF: DEBUG: 2024-08-01 19:17:54,378: configurable.py(1100): use_basic_cache:true
FFF: DEBUG: 2024-08-01 19:17:54,379: calibre_plugins.fanficfare_plugin.fff_plugin(1467) : update existing id:302
FFF: DEBUG: 2024-08-01 19:17:54,381: calibre_plugins.fanficfare_plugin.fff_plugin(1612) : existing epub tmp:C:\Users\NF\AppData\Local\Temp\calibre_z2_va01 o\fanficfare_q1uh_out\old-302-57ol_2qm.epub
FFF: DEBUG: 2024-08-01 19:17:54,381: calibre_plugins.fanficfare_plugin.fff_plugin(1679) : title:As One, So the Other
FFF: DEBUG: 2024-08-01 19:17:54,381: calibre_plugins.fanficfare_plugin.fff_plugin(1680) : outfile:C:\Users\NF\AppData\Local\Temp\calibre_z2_ va01o\fanficfare_q1uh_out\bgmeta-v8qtsjfl.epub
FFF: DEBUG: 2024-08-01 19:17:54,526: configurable.py(1080): use_browser_cache:
FFF: DEBUG: 2024-08-01 19:17:54,527: configurable.py(1100): use_basic_cache:true
FFF: DEBUG: 2024-08-01 19:17:54,527: calibre_plugins.fanficfare_plugin.fff_plugin(1467) : update existing id:294
FFF: DEBUG: 2024-08-01 19:17:54,530: calibre_plugins.fanficfare_plugin.fff_plugin(1612) : existing epub tmp:C:\Users\NF\AppData\Local\Temp\calibre_z2_va01 o\fanficfare_q1uh_out\old-294-lg7isa3n.epub
FFF: DEBUG: 2024-08-01 19:17:54,530: calibre_plugins.fanficfare_plugin.fff_plugin(1679) : title:Famil(iarit)y
FFF: DEBUG: 2024-08-01 19:17:54,530: calibre_plugins.fanficfare_plugin.fff_plugin(1680) : outfile:C:\Users\NF\AppData\Local\Temp\calibre_z2_ va01o\fanficfare_q1uh_out\bgmeta-nwuizqrs.epub
[200.97] splash screen hidden
[200.97] Started up in 200.97 seconds with 9216 books
Worker Launch took: 0.02 seconds
Job: 0 Download 2 FanFiction Book(s) finished
Download 2 FanFiction Book(s)

FFF: INFO: 2024-08-01 19:17:54,965: calibre_plugins.fanficfare_plugin.jobs(49): CPUs:3

FFF: INFO: 2024-08-01 19:17:54,966: calibre_plugins.fanficfare_plugin.jobs(52): FanFicFare v4.37.0

calibre 7.16 embedded-python: True

Windows-10-10.0.19045-SP0 Windows ('64bit', 'WindowsPE')

('Windows', '10', '10.0.19045')

Python 3.11.5

Windows: ('10', '10.0.19045', 'SP0', 'Multiprocessor Free')

Interface language: None

EXE path: C:\Program Files\Calibre2\calibre-parallel.exe

Successfully initialized third party plugins: Count Pages (1, 13, 6) && FanFicFare (4, 37, 0) && Last Modified (0, 8, 5)

FFF: INFO: 2024-08-01 19:17:55,012: calibre_plugins.fanficfare_plugin.jobs(73): Launch background process for site archiveofourown.org:

https://archiveofourown.org/works/398600

https://archiveofourown.org/works/1785532

FFF: INFO: 2024-08-01 19:18:14,627: calibre_plugins.fanficfare_plugin.jobs(135):



================================================== ============================== sitearchiveofourown.org)

FFF: INFO: 2024-08-01 19:17:56,735: calibre_plugins.fanficfare_plugin.jobs(216):



-------------------------------------------------------------------------------- https://archiveofourown.org/works/398600

FFF: DEBUG: 2024-08-01 19:17:56,778: configurable.py(1080): use_browser_cache:

FFF: DEBUG: 2024-08-01 19:17:56,778: configurable.py(1100): use_basic_cache:true

FFF: INFO: 2024-08-01 19:17:56,779: base_otw_adapter.py(142): url: https://archiveofourown.org/works/398600/navigate

FFF: INFO: 2024-08-01 19:17:56,779: base_otw_adapter.py(143): metaurl: https://archiveofourown.org/works/398600

FFF: DEBUG: 2024-08-01 19:17:56,781: cache_basic.py(116):

========== MISS (GET) BasicCache

https://archiveofourown.org/works/398600/navigate

FFF: DEBUG: 2024-08-01 19:17:56,781: fetcher_requests.py(114):

---------- REQ (GET) RequestsFetcher

https://archiveofourown.org/works/398600/navigate

FFF: DEBUG: 2024-08-01 19:17:58,052: fetcher_requests.py(127): response code:200

FFF: DEBUG: 2024-08-01 19:17:58,052: decorators.py(112): fromcache:False

FFF: DEBUG: 2024-08-01 19:17:58,053: decorators.py(123): random sleep(1.00-3.00):2.97

FFF: DEBUG: 2024-08-01 19:18:01,027: requestable.py(55): Encoding:utf8

FFF: DEBUG: 2024-08-01 19:18:01,029: cache_basic.py(116):

========== MISS (GET) BasicCache

https://archiveofourown.org/works/398600

FFF: DEBUG: 2024-08-01 19:18:01,030: fetcher_requests.py(114):

---------- REQ (GET) RequestsFetcher

https://archiveofourown.org/works/398600

FFF: DEBUG: 2024-08-01 19:18:01,433: fetcher_requests.py(127): response code:200

FFF: DEBUG: 2024-08-01 19:18:01,433: decorators.py(112): fromcache:False

FFF: DEBUG: 2024-08-01 19:18:01,434: decorators.py(123): random sleep(1.00-3.00):2.00

FFF: DEBUG: 2024-08-01 19:18:03,430: requestable.py(55): Encoding:utf8

FFF: DEBUG: 2024-08-01 19:18:03,432: cache_basic.py(116):

========== MISS (GET) BasicCache

https://archiveofourown.org/token_dispenser.json

FFF: DEBUG: 2024-08-01 19:18:03,432: fetcher_requests.py(114):

---------- REQ (GET) RequestsFetcher

https://archiveofourown.org/token_dispenser.json

FFF: DEBUG: 2024-08-01 19:18:03,617: fetcher_requests.py(127): response code:200

FFF: DEBUG: 2024-08-01 19:18:03,618: decorators.py(112): fromcache:False

FFF: DEBUG: 2024-08-01 19:18:03,619: decorators.py(123): random sleep(1.00-3.00):2.71

FFF: DEBUG: 2024-08-01 19:18:06,326: requestable.py(55): Encoding:utf8

FFF: INFO: 2024-08-01 19:18:06,326: base_otw_adapter.py(119): Will now login to URL (https://archiveofourown.org/users/login) as ()

FFF: DEBUG: 2024-08-01 19:18:06,327: cache_basic.py(116):

========== MISS (POST) BasicCache

https://archiveofourown.org/users/login

FFF: DEBUG: 2024-08-01 19:18:06,327: fetcher_requests.py(114):

---------- REQ (POST) RequestsFetcher

https://archiveofourown.org/users/login

FFF: DEBUG: 2024-08-01 19:18:06,551: fetcher_requests.py(127): response code:200

FFF: DEBUG: 2024-08-01 19:18:06,551: decorators.py(112): fromcache:False

FFF: DEBUG: 2024-08-01 19:18:06,552: decorators.py(123): random sleep(1.00-3.00):2.13

FFF: DEBUG: 2024-08-01 19:18:08,688: requestable.py(55): Encoding:utf8

FFF: INFO: 2024-08-01 19:18:08,688: base_otw_adapter.py(125): Failed to login to URL https://archiveofourown.org/users/login as

FFF: INFO: 2024-08-01 19:18:08,688: calibre_plugins.fanficfare_plugin.jobs(450): Exception: {'title': 'As One, So the Other', 'author_sort': 'jedipati', 'author': ['jedipati'], 'comments': '', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': 302, 'begin': None, 'end': None, 'comment': 'Failed to Login for URL: (https://archiveofourown.org/works/398600/navigate) with username: ()', 'url': 'https://archiveofourown.org/works/398600', 'site': 'archiveofourown.org', 'series': '', 'added': False, 'pubdate': None, 'publisher': 'archiveofourown.org', 'listorder': 1, 'collision': 'Overwrite Always', 'uniqueurl': 'https://archiveofourown.org/works/398600[None-None]', 'is_adult': False, 'username': 'NoneGiven', 'password': '', 'icon': 'dialog_error.png', 'epub_for_update': 'C:\\Users\\NF\\AppData\\Local\\Temp\\calibre_z2_v a01o\\fanficfare_q1uh_out\\old-302-57ol_2qm.epub', 'calibre_columns': {}, 'outfile': 'C:\\Users\\NF\\AppData\\Local\\Temp\\calibre_z2_v a01o\\fanficfare_q1uh_out\\bgmeta-v8qtsjfl.epub'}:Failed to Login for URL: (https://archiveofourown.org/works/398600/navigate) with username: ()

Traceback (most recent call last):

File "calibre_plugins.fanficfare_plugin.jobs", line 255, in do_download_for_worker

File "C:\Users\NF\AppData\Roaming\calibre\plugins\FanFi cFare.zip\fanficfare\adapters\base_adapter.py", line 325, in getStoryMetadataOnly

File "C:\Users\NF\AppData\Roaming\calibre\plugins\FanFi cFare.zip\fanficfare\adapters\base_adapter.py", line 429, in doExtractChapterUrlsAndMetadata

File "C:\Users\NF\AppData\Roaming\calibre\plugins\FanFi cFare.zip\fanficfare\adapters\base_otw_adapter.py" , line 176, in extractChapterUrlsAndMetadata

File "C:\Users\NF\AppData\Roaming\calibre\plugins\FanFi cFare.zip\fanficfare\adapters\base_otw_adapter.py" , line 127, in performLogin

fanficfare.exceptions.FailedToLogin: Failed to Login for URL: (https://archiveofourown.org/works/398600/navigate) with username: ()

FFF: INFO: 2024-08-01 19:18:08,693: calibre_plugins.fanficfare_plugin.jobs(216):



-------------------------------------------------------------------------------- https://archiveofourown.org/works/1785532

FFF: DEBUG: 2024-08-01 19:18:08,733: configurable.py(1080): use_browser_cache:

FFF: DEBUG: 2024-08-01 19:18:08,734: configurable.py(1100): use_basic_cache:true

FFF: INFO: 2024-08-01 19:18:08,735: base_otw_adapter.py(142): url: https://archiveofourown.org/works/1785532/navigate

FFF: INFO: 2024-08-01 19:18:08,735: base_otw_adapter.py(143): metaurl: https://archiveofourown.org/works/1785532

FFF: DEBUG: 2024-08-01 19:18:08,735: cache_basic.py(116):

========== MISS (GET) BasicCache

https://archiveofourown.org/works/1785532/navigate

FFF: DEBUG: 2024-08-01 19:18:08,735: fetcher_requests.py(114):

---------- REQ (GET) RequestsFetcher

https://archiveofourown.org/works/1785532/navigate

FFF: DEBUG: 2024-08-01 19:18:10,024: fetcher_requests.py(127): response code:200

FFF: DEBUG: 2024-08-01 19:18:10,024: decorators.py(112): fromcache:False

FFF: DEBUG: 2024-08-01 19:18:10,025: decorators.py(123): random sleep(1.00-3.00):1.08

FFF: DEBUG: 2024-08-01 19:18:11,106: requestable.py(55): Encoding:utf8

FFF: DEBUG: 2024-08-01 19:18:11,107: cache_basic.py(116):

========== MISS (GET) BasicCache

https://archiveofourown.org/works/1785532

FFF: DEBUG: 2024-08-01 19:18:11,108: fetcher_requests.py(114):

---------- REQ (GET) RequestsFetcher

https://archiveofourown.org/works/1785532

FFF: DEBUG: 2024-08-01 19:18:11,788: fetcher_requests.py(127): response code:200

FFF: DEBUG: 2024-08-01 19:18:11,789: decorators.py(112): fromcache:False

FFF: DEBUG: 2024-08-01 19:18:11,790: decorators.py(123): random sleep(1.00-3.00):2.49

FFF: DEBUG: 2024-08-01 19:18:14,278: requestable.py(55): Encoding:utf8

FFF: DEBUG: 2024-08-01 19:18:14,281: cache_basic.py(116):

========== HIT (GET) BasicCache

https://archiveofourown.org/token_dispenser.json

FFF: DEBUG: 2024-08-01 19:18:14,282: requestable.py(55): Encoding:utf8

FFF: INFO: 2024-08-01 19:18:14,283: base_otw_adapter.py(119): Will now login to URL (https://archiveofourown.org/users/login) as ()

FFF: DEBUG: 2024-08-01 19:18:14,284: cache_basic.py(116):

========== HIT (POST) BasicCache

https://archiveofourown.org/users/login

FFF: DEBUG: 2024-08-01 19:18:14,284: requestable.py(55): Encoding:utf8

FFF: INFO: 2024-08-01 19:18:14,285: base_otw_adapter.py(125): Failed to login to URL https://archiveofourown.org/users/login as

FFF: INFO: 2024-08-01 19:18:14,286: calibre_plugins.fanficfare_plugin.jobs(450): Exception: {'title': 'Famil(iarit)y', 'author_sort': 'Niitza', 'author': ['Niitza'], 'comments': '', 'good': False, 'status': 'Error', 'showerror': True, 'calibre_id': 294, 'begin': None, 'end': None, 'comment': 'Failed to Login for URL: (https://archiveofourown.org/works/1785532/navigate) with username: ()', 'url': 'https://archiveofourown.org/works/1785532', 'site': 'archiveofourown.org', 'series': '', 'added': False, 'pubdate': None, 'publisher': 'archiveofourown.org', 'listorder': 0, 'collision': 'Overwrite Always', 'uniqueurl': 'https://archiveofourown.org/works/1785532[None-None]', 'is_adult': False, 'username': 'NoneGiven', 'password': '', 'icon': 'dialog_error.png', 'epub_for_update': 'C:\\Users\\NF\\AppData\\Local\\Temp\\calibre_z2_v a01o\\fanficfare_q1uh_out\\old-294-lg7isa3n.epub', 'calibre_columns': {}, 'outfile': 'C:\\Users\\NF\\AppData\\Local\\Temp\\calibre_z2_v a01o\\fanficfare_q1uh_out\\bgmeta-nwuizqrs.epub'}:Failed to Login for URL: (https://archiveofourown.org/works/1785532/navigate) with username: ()

Traceback (most recent call last):

File "calibre_plugins.fanficfare_plugin.jobs", line 255, in do_download_for_worker

File "C:\Users\NF\AppData\Roaming\calibre\plugins\FanFi cFare.zip\fanficfare\adapters\base_adapter.py", line 325, in getStoryMetadataOnly

File "C:\Users\NF\AppData\Roaming\calibre\plugins\FanFi cFare.zip\fanficfare\adapters\base_adapter.py", line 429, in doExtractChapterUrlsAndMetadata

File "C:\Users\NF\AppData\Roaming\calibre\plugins\FanFi cFare.zip\fanficfare\adapters\base_otw_adapter.py" , line 176, in extractChapterUrlsAndMetadata

File "C:\Users\NF\AppData\Roaming\calibre\plugins\FanFi cFare.zip\fanficfare\adapters\base_otw_adapter.py" , line 127, in performLogin

fanficfare.exceptions.FailedToLogin: Failed to Login for URL: (https://archiveofourown.org/works/1785532/navigate) with username: ()



FFF: INFO: 2024-08-01 19:18:14,627: calibre_plugins.fanficfare_plugin.jobs(147):

Download Results:

Error https://archiveofourown.org/works/1785532 Failed to Login for URL: (https://archiveofourown.org/works/1785532/navigate) with username: ()

Error https://archiveofourown.org/works/398600 Failed to Login for URL: (https://archiveofourown.org/works/398600/navigate) with username: ()



FFF: INFO: 2024-08-01 19:18:14,627: calibre_plugins.fanficfare_plugin.jobs(171):

Error

https://archiveofourown.org/works/1785532

https://archiveofourown.org/works/398600



FFF: DEBUG: 2024-08-01 19:19:51,805: calibre_plugins.fanficfare_plugin.dialogs(493): self.extraoptions['anthology_url']:NOT FOUND
FFF: DEBUG: 2024-08-01 19:19:51,816: calibre_plugins.fanficfare_plugin.fff_plugin(1157) : FanFicFare v4.37.0
FFF: DEBUG: 2024-08-01 19:19:51,975: configurable.py(1080): use_browser_cache:
FFF: DEBUG: 2024-08-01 19:19:51,975: configurable.py(1100): use_basic_cache:true
FFF: INFO: 2024-08-01 19:19:51,977: base_otw_adapter.py(142): url: https://archiveofourown.org/works/43770457/navigate
FFF: INFO: 2024-08-01 19:19:51,977: base_otw_adapter.py(143): metaurl: https://archiveofourown.org/works/43770457
FFF: DEBUG: 2024-08-01 19:19:51,977: cache_basic.py(116):
========== MISS (GET) BasicCache
https://archiveofourown.org/works/43770457/navigate
FFF: DEBUG: 2024-08-01 19:19:51,977: fetcher_requests.py(114):
---------- REQ (GET) RequestsFetcher
https://archiveofourown.org/works/43770457/navigate
FFF: DEBUG: 2024-08-01 19:19:53,032: fetcher_requests.py(127): response code:200
FFF: DEBUG: 2024-08-01 19:19:53,032: decorators.py(112): fromcache:False
FFF: DEBUG: 2024-08-01 19:19:53,033: decorators.py(123): random sleep(1.00-3.00):1.34
FFF: DEBUG: 2024-08-01 19:19:54,376: requestable.py(55): Encoding:utf8
FFF: DEBUG: 2024-08-01 19:19:54,378: cache_basic.py(116):
========== MISS (GET) BasicCache
https://archiveofourown.org/works/43770457
FFF: DEBUG: 2024-08-01 19:19:54,380: fetcher_requests.py(114):
---------- REQ (GET) RequestsFetcher
https://archiveofourown.org/works/43770457
FFF: DEBUG: 2024-08-01 19:19:54,967: fetcher_requests.py(127): response code:200
FFF: DEBUG: 2024-08-01 19:19:54,967: decorators.py(112): fromcache:False
FFF: DEBUG: 2024-08-01 19:19:54,968: decorators.py(123): random sleep(1.00-3.00):2.60
FFF: DEBUG: 2024-08-01 19:19:57,570: requestable.py(55): Encoding:utf8
FFF: DEBUG: 2024-08-01 19:19:57,791: base_otw_adapter.py(269): numChapters: (15)
FFF: WARNING: 2024-08-01 19:19:58,174: story.py(1384): Skipping invalid metadata entry (statusextratags) in include_subject_tags
FFF: DEBUG: 2024-08-01 19:19:58,182: calibre_plugins.fanficfare_plugin.fff_plugin(1474) : from URL(https://archiveofourown.org/works/43770457)
FFF: DEBUG: 2024-08-01 19:19:58,700: calibre_plugins.fanficfare_plugin.fff_plugin(1679) : title:We Create Our Own Demons
FFF: DEBUG: 2024-08-01 19:19:58,700: calibre_plugins.fanficfare_plugin.fff_plugin(1680) : outfile:C:\Users\NF\AppData\Local\Temp\calibre_z2_ va01o\fanficfare_2h3llsmj\We Create Our Own Demons-Lokiislife-5fl3e7en.epub
FFF: DEBUG: 2024-08-01 19:21:01,328: calibre_plugins.fanficfare_plugin.fff_plugin(1816) : add/update We Create Our Own Demons https://archiveofourown.org/works/43770457 id(None)
FFF: DEBUG: 2024-08-01 19:21:01,728: calibre_plugins.fanficfare_plugin.fff_plugin(2194) : update_error_column_loop prev_val:None
FFF: DEBUG: 2024-08-01 19:21:01,728: calibre_plugins.fanficfare_plugin.fff_plugin(1831) : Attempting metadata update
FFF: DEBUG: 2024-08-01 19:21:01,916: calibre_plugins.fanficfare_plugin.fff_plugin(2410) : No value for series04, skipping custom column(#multiseries) update.
FFF: DEBUG: 2024-08-01 19:21:02,013: calibre_plugins.fanficfare_plugin.fff_plugin(2501) : has link_map:True
FFF: INFO: 2024-08-01 19:21:02,014: calibre_plugins.fanficfare_plugin.fff_plugin(2515) : cover_image:
FFF: DEBUG: 2024-08-01 19:21:04,585: calibre_plugins.fanficfare_plugin.fff_plugin(1906) : set_marked_ids:{9217: 'fff_success_0000'}
FFF: DEBUG: 2024-08-01 19:21:04,676: calibre_plugins.fanficfare_plugin.fff_plugin(1915) : Finished Adding/Updating 1 books.
FFF: DEBUG: 2024-08-01 19:21:04,678: calibre_plugins.fanficfare_plugin.fff_plugin(1918) : removed tdir

I haven't checked trying to add a new story that requires you logging in, but I could if you want me to. I have a feeling it'll give the same error tho.



Also regarding the previous ask, if it is indeed possible to include bookmark data I would like for it to show up, as it appears to be possible