[GUI Plugin] FanFicFare

[JimmXinu]

So basically, you're trying to download from a URL, using 'Add New Book' mode, and it's still trying to update instead?

I can't replicate this, nor can I think of any setting that could cause it. I would suggest user error (thinking you changed the mode for that download, but didn't) except that the default mode is 'Update Metadata from Web'.

I would try (re)downloading & installing the current posted test version of the plugin.

A debug log (restart in debug under Calibre Preferences dropdown) of it happening may help.

Do you see this happen if you start in a new (empty) library with default FFF settings?

[iakrus]

hi! yeah it's definitely something i messed up, because in a blank library it worked fine.

im not surprised, ive been fiddling with my metadata settings and code for weeks because despite the fact ive been using calibre for 5 years and i have 17k fics i'd been handling pretty much everything manually until a couple of months ago.

so ive been trying to work out how i want my metadata (it was all just in one almost 10k tags column... eek) and trying to learn the code and fiddling with columns and adding a couple of plugins that link in and so forth, so i've definitely botched a few things up along the way!

my personal.ini is a bit of a mess right now specifically because somethink broke last week and i went through like 8 back ups comparing code to figure out what broke it (i didnt, it just started working again). i butchered it pretty far down but im sure theres still like 20 mistakes in there! i've attatched the debug file and also my personal.ini, and if you want pictures of all the different tabs in the settings window, just let me know and i'll send those over too!!

thanks so much for the help, it must get pretty exhausting helping people fumbling around at something you're brilliant at!

## This is an example of what your personal configuration might look
## like.  Uncomment options by removing the '#' in front of them.

[defaults]
## titlepage_entries: category,genre, status
## [www.whofic.com]
## # overrides defaults.
## titlepage_entries: category,genre, status,dateUpdated,rating
## [epub]
## # overrides defaults & site section
## titlepage_entries: category,genre, status,datePublished,dateUpdated,dateCreated
## [www.whofic.com:epub]
## # overrides defaults, site section & format section
## titlepage_entries: category,genre, status,datePublished
## [overrides]
## # overrides all other sections
## titlepage_entries: category

## Some sites also require the user to confirm they are adult for
## adult content.  Uncomment by removing '#' in front of is_adult.
is_adult:true


## Literal strings can be set into custom columns using double quotes.
## Each metadata=>column mapping must be on a separate line and each
## needs to have one space at the start of each line.  There is also a
## special case for Integer and Float type custom columns: The static
## value "None" will clear the column.

## 'r_anthaver' and 'n_anthaver' can be used to indicate the same as
## 'r' and 'n' for normal downloads, but to average the metadata for
## the differents story in an anthology before setting in integer and
## float type custom columns.  This can be useful for a averrating
## column, for example.
## 'r_anthmax' and 'n_anthmax' indicate 'r' and 'n' for normal
## downloads, but to use the highest value for the metadata from the
## differents story in an anthology in integer and float type custom
## columns.
## Default is to sum the values of all stories, and numChapters and
## numWords are always summed.

#custom_columns_settings:
# cliches=>#acolumn
# themes=>#bcolumn,a
# timeline=>#ccolumn,n
# "FanFiction"=>#collection
# averrating=>#averrating,r_anthaver




browser_cache_path:C:\Users\isaac\AppData\Local\Mozilla\Firefox\Profiles\dbq9ckcm.default-release\cache2
browser_cache_age_limit:-1


## Don't like the numbers at the start of chapter titles on some
## sites?  You can use strip_chapter_numbers to strip them off.  Just
## want to make them all look the same?  Strip them off, then add them
## back on with add_chapter_numbers.  Don't like the way it strips
## numbers or adds them back?  See chapter_title_strip_pattern and
## chapter_title_add_pattern.
#strip_chapter_numbers:true
#add_chapter_numbers:true

## Add this to genre if there's more than one category.
add_genre_when_multi_category:crossover




[epub]
## include images from img tags in the body and summary of stories.
## Images will be converted to jpg for size if possible.  Images work
## in epub format only.  To get mobi or other format with images,
## download as epub and use Calibre to convert.
#include_images:true

## If not set, the summary will have all html stripped for safety.
## Both this and include_images must be true to get images in the
## summary.
#keep_summary_html:true

## If set, the first image found will be made the cover image.  If
## keep_summary_html is true, any images in summary will be before any
## in chapters.
#make_firstimage_cover:true

## Resize images down to width, height, preserving aspect ratio.
## Nook size, with margin.
#image_max_size: 580, 725

## Change image to grayscale, if graphics library allows, to save
## space.
#grayscale_images: false


## Most common, I expect will be using this to save username/passwords
## for different sites.  Here are a few examples.  See defaults.ini
## for the full list.

[www.twilighted.net]
#username:XXXXXXXX
#password:XXXXXXXX
## default is false
#collect_series: true

[archiveofourown.org]
username:XXXXXXXX
password:XXXXXXXX
titlepage_entries: seriesHTML,category,genre,language,characters,ships,status,datePublished,dateUpdated,dateCreated,rating,warnings,chapterslashtotal,numWords,publisher,description
chapterslashtotal_label: Chapters
add_to_replace_metadata:
 chapterslashtotal=>^(\d+)/\1$=>\1
 chapterslashtotal=>/\?$=>
add_to_custom_columns_settings:
 bookmarks=>#bookmarks
 kudos=>#kudos
 freeformtags=>#freeformtags
keep_in_order_freeformtags:true


generate_cover_settings:
 ${#ao3collections} => House of the Dragon \(tv\)=> asoiaf targ
 ${category} => Dragon Age: Inquisition => da inquis
 ${category} => HotD => asoiaf targ
 ${category} => (A Song of Ice and Fire & Related Fandoms|Game of Thrones (TV)|A Song of Ice and Fire - George R. R. Martin) => asoiaf stark
 ${category} =>Star Wars: Darth Vader \(Comics\)=>star wars 2 
 ${category} => Star Wars => star wars basic
 ${characters} => Zuko \(Avatar\) => atla zuko
 ${characters} => Aang \(Avatar\) => atla aang

[ficwad.com]
#username:XXXXXXXX
#password:XXXXXXXX

[www.adastrafanfic.com]
## Some sites do not require a login, but do require the user to
## confirm they are adult for adult content.
#is_adult:true

[www.twcslibrary.net]
#username:XXXXXXXX
#password:XXXXXXXX
#is_adult:true
## default is false
#collect_series: true

[www.fimfiction.net]
#is_adult:true
#fail_on_password:XXXXXXXX

[www.tthfanfic.org]
#is_adult:true
## tth is a little unusual--it doesn't require user/pass, but the site
## keeps track of which chapters you've read and won't send another
## update until it thinks you're up to date.  This way, on download,
## it thinks you're up to date.
#username:XXXXXXXX
#password:XXXXXXXX

[www.fanfiction.net]

## browser cache will only be used if use_browser_cache:true and ONLY
## for fanfiction.net right now.  Requires a browser_cache_path set in
## [defaults].
always_reload_first_chapter:true
use_browser_cache:true
use_browser_cache_only:true
open_pages_in_browser:false
add_to_custom_columns_settings:
 favs=>#kudos

[www.alternatehistory.com]
username:XXXXXXXX
password:XXXXXXXX


## This section will override anything in the system defaults or other
## sections here.
[overrides]
## default varies by site.  Set true here to force all sites to
## collect series.
#collect_series: true#
#extra_valid_entries: collections 



add_to_extra_valid_entries:,category_modified
include_in_category_modified:category

replace_metadata:
 category_modified=>Assassin's Creed - All Media Types|Assassin's Creed Odyssey|Assassin's Creed RPF|Assassin's Creed: Unity - Fandom|Assassin's Creed Syndicate - Fandom|Assassin's Creed Valhalla|ac valhalla - Fandom|Assassin's Creed=>Assassin's Creed
 category_modified=>A Song of Ice and Fire & Related Fandoms|A Song of Ice and Fire - George R. R. Martin|Game of Thrones \(TV\)|Game of Thrones RPF|Game of Thrones Book|ASOIAF=>ASOIAF | GoT

 category_modified=>Shingeki no Kyojin \| Attack on Titan=>Attack on Titan

 category_modified=>Avatar: The Last Airbender \(Cartoon 2005\)|Avatar: The Last Airbender|Avatar \(TV\)=>ATLA

 category_modified=>Avatar: Legend of Korra=>LOK

 category_modified=>Criminal Minds \(US TV\)=>Criminal Minds

 category_modified=>Dragon Age: Inquisition|Dragon Age \(Video Games\)|Dragon Age - All Media Types|Dragon Age: Origins - Awakening|Dragon Age: Origins|Dragon Age II|Dragon Age - Awakening|Dragon Age - Various Authors|Dragon Age: The Veilguard|Dragon Age Origins|Dragon Age: Dreadwolf \(Video Game\)|Dragon Age: The Masked Empire|Dragon Age \(Comics\)|Dragon Age \(Tabletop RPG\)|Dragon Age: Jaws of Hakon|Dragon Age: The Descent - Fandom|Dragon Age: The Silent Grove|Dragon Age: Trespasser|Dragon Age: Last Flight|Dragon Age: Blood Mage no Seisen \| Dragon Age: Dawn of the Seeker|Dragon Age Crossover|Dragon Age: Those Who Speak|Dragon Age: Until We Sleep|Dragon Age=>Dragon Age

 category_modified=>House of the Dragon \(TV\) RPF|House of the Dragon \(TV\)|fire and blood - Fandom|Daemon Targaryen\/Rhaenyra Targaryen - Fandom|Fire and Blood - George R.R. Martin|Fire and Blood : Vollume 1=>HotD,ASOIAF | GoT

 category_modified=>Outer Wilds \(Video Game\)=>Outer Wilds

 category_modified=>Harry Potter - J. K. Rowling=>Harry Potter

 category_modified=>Avengers \(Marvel\) - All Media Types|Captain America \(2011\)|Captain America \(Movies\)|Incredible Hulk \(2008\)|Iron Man - All Media Types|Iron Man \(Movies\)|Marvel Avengers Movies Universe|Marvel Cinematic Universe|Marvel \(Movies\)|The Avengers \(2012\)|The Avengers \(Marvel Movies\)|The Avengers \(Marvel\) - All Media Types|The Incredible Hulk - All Media Types|Thor \(2011\)=>Marvel

 category_modified=>Mass Effect - All Media Types|Mass Effect Trilogy|Mass Effect: Andromeda=>Mass Effect

 category_modified=>Star Wars - All Media Types|Star Wars Original Trilogy|Star Wars Prequel Trilogy|Star Wars: The Clone Wars \(2008\) - All Media Types|Star Wars Episode VII: The Force Awakens \(2015\)|Star Wars Legends - All Media Types|Star Wars Episode I: The Phantom Menace|Star Wars: Rebels|Star Wars Sequel Trilogy|Star Wars Episode III: Revenge of the Sith|Star Wars: Clone Wars \(2003\) - All Media Types|Star Wars Legends: Jedi Apprentice Series - Jude Watson & Dave Wolverton|Rogue One: A Star Wars Story \(2016\)|The Mandalorian \(TV\)|Solo: A Star Wars Story \(2018\)|Star Wars Episode II: Attack of the Clones|Star Wars: Rebellion Era - All Media Types|Star Wars: The Bad Batch \(Cartoon\)|Star Wars \(Marvel Comics\)|Star Wars Episode IV: A New Hope|Star Wars Legends: Jango Fett Open Seasons \(Comics\)|Rise of Empire Era - All Media Types|Star Wars: The Book of Boba Fett \(TV\)|Star Wars - Rebels|Star Wars Legends: New Jedi Order Series - Various Authors|Star Wars: Darth Vader \(Comics\)|Star Wars: Dooku: Jedi Lost - Cavan Scott|Star Wars: Expanded Universe \(Comics\)|Star Wars: Jedi: Fallen Order \(Video Game\)|Star Wars: Jedi: Fallen Order Series \(Video Games\)|Star Wars: Queen's Shadow Series - E. K. Johnston|Star Wars: The High Republic|Star Wars: Star Wars Legends: The Old Republic \(Video Game\)|Star Wars: Obi-Wan Kenobi \(TV\)|Star Wars=>Star Wars

 category_modified=>The Umbrella Academy \(Comics\)|The Umbrella Academy \(TV\)=>The Umbrella Academy

 category_modified=>Twilight \(Movies\)|Twilight Series - All Media Types|Twilight Series - Stephenie Meyer=>Twilight


add_to_custom_columns_settings:
 category_modified=>#mycollections
 collections=>#ao3collections

[JimmXinu]

I didn't expect personal.ini to affect it, but I did test it and it didn't. Anything affecting download mode is going to be in the plugin GUI settings.

(Unrelated - Are you deliberately ignoring the "always_reload_first_chapter doesn't work in [www.fanfiction.net]" warning?)

Settings

Seeing all your options would help. But there's a more precise way than screenshots.

If you don't mind removing your user/pass settings from personal.ini first, there's a way to give me exactly what you have set for everything:

In FFF config, under that rightmost 'Other' tab, there's a button for 'View library preferences'. If you click that, and then choose 'settings' in the left column, you'll see a JSON of all the plugin settings. Put that in a text file and post it or send it to me.

Invocation

It would also help to know exactly how you are invoking FFF when this happens.

Prior screenshot shows you have 'Update metadata from Web' as default mode. How are you changing the mode 'Add New'?

• Manually from dropdown while on the Download from URLs dialog?
• Using the menu option (FFF > Actions by Update Modes > Download from URLs > Add New Book)?
• A keyboard shortcut? Favourites plugin? To what?

[HowWouldIKnow]

Originally Posted by JimmXinu

That can be done using custom_columns_settings in personal.ini for ao3categories, hits, kudos & bookmarks.

Hmm I tried it like that but there is no change:

custom_columns_settings:
#characters=>#characters
fandoms=>fandoms
ao3categories=>categories
kudos=>kudos
hits=>hits
bookmarks=>bookmarks
comments=>comments

[JimmXinu]

Originally Posted by HowWouldIKnow

Hmm I tried it like that but there is no change:

Custom column names all have to have '#' at the start. And the INI format requires a leading space for each line to be considered part of the same setting.

Like so:

custom_columns_settings:
 fandoms=>#fandoms
 ao3categories=>#categories
 kudos=>#kudos
 hits=>#hits
 bookmarks=>#bookmarks
 comments=>#comments

Edit: Also, it works better to use [CODE] instead of [QUOTE] around ini snippets.

[iakrus]

Originally Posted by JimmXinu

It would also help to know exactly how you are invoking FFF when this happens.

Hey!

Turns out this was the issue, I think! I've been using shortcuts for a while, and the issue is that my shortcut to "Download Fanfiction Books from URLs - Update EPUB if new chapter" will only do that!

At first I was confused because testing with other things seemed like it was working again! I only figured it out when I cycled back around to trying the different ways with a different fic and it didn't work - with my shortcut!

Then after even MORE testing I noticed that even though my settings say it should default to 'update calibre metadata from website', which I had changed to while doing all my metadata changes - eventually i'll have to update the metadata of my whole 17k library (in short bursts, ive read the FAQ!) and I use it now to test each change I make.

So I used my shortcut with a fic that had a duplicate, and every single option I clicked in the drop down returned with "More than one identical book etc etc" or if there was only one in there, "Already contains X chapters."

What made this difficult for me to notice is that when adding new books, it works just fine! And that's of course what I use it for 90% of the time. This only became a problem when I tried to download duplicates of fics to test metadata changes.

So yeah, the shortcuts are specific and only allow you to do the one option you chose for the shortcut, even if you try and change it in the pop up window. Good to know!

(Unrelated - Are you deliberately ignoring the "always_reload_first_chapter doesn't work in [www.fanfiction.net]" warning?)

The honest answer to this was yes I was! Because when I added that line along with a couple of others I was able to download and update ffn fics for the first time in like a year, and i could have tested which bit of code had fixed it, but I was so relieved it was working, and didn't want to accidentally break it again (I'm good at that) that I resigned myself to clicking the "save anyway" button on the popup each time!
You'll be releaved to know that line is no longer in my personal.ini I'm sure!

(Also I'm a very visual person so I took screenshots of my steps along the way and I'm gonna add them below even though it's not 100% necessary!)

[JimmXinu]

New Test Version Posted

2024-10-29
- Fix for D/L from URL Mode Menu actions not honoring changed update mode in dialog.

Originally Posted by iakrus

Turns out this was the issue, I think! I've been using shortcuts for a while, and the issue is that my shortcut to "Download Fanfiction Books from URLs - Update EPUB if new chapter" will only do that!

Confirmed. If you use one of the mode-specific menu actions for Download by URL, that mode will be used even if you change it in the dialog.

Conversely, the Update options honor your (2nd) choice if you change the mode in the dialog.

So this was a bug.

[JimmXinu]

New Test Version Posted

2024-10-30
- Update Translations

[ownedbycats]

In storyUrl section, is there a way to set series00 as series01 and vice-versa?

[JimmXinu]

Originally Posted by ownedbycats

In storyUrl section, is there a way to set series00 as series01 and vice-versa?

I thought that would be easy, but I can't think of any way that works.

Best I can think of is to swap them in 'temp' entries, something like:

[https://archiveofourown.org/works/XXXXX]
add_to_extra_valid_entries:,seriesT0,seriesT1,seriesT0Url,seriesT1Url,seriesT0HTML,seriesT1HTML

include_in_seriesT1:series00
include_in_seriesT0:series01
include_in_seriesT1Url:series00Url
include_in_seriesT0Url:series01Url

add_to_make_linkhtml_entries:,seriesT0,seriesT1

add_to_custom_columns_settings:
 seriesT0=>#seriesFirst
 seriesT1=>#seriesSecond

But if that's what you are trying to do, you might as well just:

[https://archiveofourown.org/works/XXXXX]
add_to_custom_columns_settings:
 series01=>#seriesFirst
 series00=>#seriesSecond

Depending on what you do, it might necessary to put seriesT0/1 in the site section and then add the swap part each story you want swapped.

[JimmXinu]

New Version Released

Version 4.40.0 - 2024-11-01
- Update Translations
- Fix for D/L from URL Mode Menu actions not honoring changed update mode in dialog.
- Add error_dialog for email fetch failure about 2FA/outlook etc.
- adapter_ficbooknet: Another site update, thanks dbhmw #1125
- adapter_ficbooknet: Fixes for site changes, thanks dbhmw
- adapter_inkbunnynet: Add login for Get URLs from Page (#1119), thanks dbhmw
- adapter_syosetucom: Fix for site changes, thanks praschke
- Change decode_emails default to true.
- adapter_deviantartcom: Site changes, new chapter text tag. See #1118