|
Latest Uploads |
Browse Latest Uploads |
Latest Uploads (Feed) |
Kindle Download Guide |
Formats |
Kindle (MOBI) |
Sony BBeB (LRF) |
ePub (EPUB) |
eBookwise (IMP) |
Miscellaneous |
Search Forums |
Advanced Search |
Attachment Search |
Find New Posts |
All New Posts |
- w/o E-Book Uploads |
Last 24 Hours |
Last 2 Days |
Last 5 Days |
Your Posts |
Go to Page... |
![]() |
|
Thread Tools | Search this Thread |
![]() |
#1 |
Plugin Developer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 6,482
Karma: 4277235
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
|
[GUI Plugin] FanFicFare
Many people use their ebook readers to read FanFiction stories posted on the web on various sites. Many people also use Calibre to manage their ebook collections and readers.
This plugin brings the functionality of FanFicFare to Calibre. The source is available on the GitHub project home page. There's additional documentation and FAQs on the project wiki, including a page specifically about the plugin version. (FanFicFare was previously known as FanFictionDownLoader) Main Features of FanFicFare Plugin:
Supported Sites: Spoiler:
Special Notes:
Languages: This plugin has (at least partial) translations for: Spoiler:
Command Line Interface(CLI) Calibre offers a command-line interface (CLI) for calling plugins. This plugin supports that option and allows the user to call the plugin's basic functionality from outside calibre without having to install Python or get the plugin's files separately. (Note that at this time, FanFicFare via calibre CLI will use your personal.ini settings from your library, but does not add to or update your library.) Code:
calibre-debug.exe --run-plugin FanFicFare -- [options] <storyurl> ## to see CLI options: calibre-debug.exe --run-plugin FanFicFare -- --help Under Calibre's Preferences, there's an option for 'Get plugins to enhance Calibre'. Find FanFicFare on the list (check the 'Update' and 'All' lists if you don't see it), click Install in the lower right corner. --OR-- Download the attached zip file and install the plugin/add to context menu or toolbar/restart Calibre as described in the Introduction to plugins thread. Version History: Spoiler:
Version 4.37.0 - 2024-08-01 - Fix for paginated AO3 series, closes #1091 - Allow scribblehub.com story URLs w/o title and search calibre w/o title - Use titlepage_entry for titlepage_wide_entry unless explicitly set. - adapter_storiesonlinenet: Fix for chapter select getting cover image link. - adapter_storiesonlinenet: Remove ''s Page' to '.s Page' - Full OTW settings for [www.adastrafanfic.com](http://www.adastrafanfic.com/) in defaults.ini - Update translations Version 4.36.0 - 2024-07-01 - Built-in Event For Action Chains plugin - Catch bad href searches during internal link anchor search. - adapter_spiritfanfictioncom: use_basic_cache:true - adapter_spiritfanfictioncom: Cheesy fix for py2 not knowing %z in dates. - New Site: SpiritFanfiction.com Portuguese language site (#1078) thanks kilandra - XF2: SB/SV changed the header for thread_status - adapter_ficbooknet: adapter_ficbooknet: Better fixes for py2 from dbhmw - adapter_ficbooknet: Fix breakage for proxies & add covers #1077 - #1076, thanks dbhmw Version 4.35.0 - 2024-06-01 - Add download_finished_signal for Action Chains #1073 - New Site: touchfluffytail.org thanks dbhmw (#1071) - adapter_wattpadcom: Improve error reporting when story not found / connection refused. - base_xenforo2 better detect whether logged in. - adapter_deviantartcom: Streamline login vs watchers vs mature See #1070 - adapter_inkbunny: Fix author & category thanks dbhmw (#1069) - base_xenforo2forum: Prefix tag collecting too much. - datetime.utcnow() deprecated in more recent py3 versions - Skip invalid images, detect img types thanks dbhmw (#1068) - Fix for WebToEpub firefox cache key changing - QQ: Doesn't need reader_posts_per_page:30 anymore - adapter_forumquestionablequestingcom:Switch to BaseXenForo2ForumAdapter - adapter_ficbooknet: Remove py3 string handling that breaks on py2 - Update bundled certifi cacert.pem and version, not core.py Version 4.34.1 - 2024-05-01 - adapter_ficbooknet: Remove py3 string handling that breaks on py2 - Update bundled certifi cacert.pem and version Version 4.34.0 - 2024-05-01 - adapter_literotica: "Beta" site changes #1058 - Ficbook.net More metadata collection #1064 Thanks, dbhmw - Ficbook.net Add chapter dates for TOC #1065 Thanks, dbhmw - Ficbook.net Fix categories and add chapter notes #1063 Thanks, dbhmw - adapter_storiesonlinenet: Fix for /library/ -> /s/ - New Site: fanfictions.fr (#1061) French language site, thanks yvesmotteux - basexf: Add XF categorized tags into: category, genre, characters, contenttags and formattags - basexf: Fix for prefix tags, put in prefixtags included in genre - OTW(AO3) Support Paginated Series Version 4.33.0 - 2024-04-01 - Update translations. - adapter_inkbunnynet: Honor keep_summary_html, allow alternate cover image. Thanks hmonsta #912. - adapter_deviantartcom: Add a 6th different message to indicate 'mature content'. #1052 - adapter_deviantartcom: Bad username fails separately than bad pass. #1052 - Paste into ini edit as plain text only. - syosetu: make numeric metadata robust against wording changes - thanks praschke - New site Japanese language site kakuyomu.jp, thanks praschke - adapter_deviantartcom: Add another way to remove comments section. - Don't try to set imap tags before checking for 'good' update. - Move new exception catching for metadata errors Version 4.32.3 - 2024-03-04 - Fix setting book['tags'] for bgmeta for update AND overwrite. - Report errors during library update loop better. - SV site change, paginated threadmarks list Version 4.32.0 - 2024-03-01 - Update translations. - Add Edit personal.ini as a direct menu item--can keyboard shortcut - adapter_deviantartcom: Fix for site change and detect no username. Closes #1042 - Set book[tags] after writeStory for literotica. - New site: syosetu.com Japanese language site, thanks praschke - Don't do random lang anymore in test1--changes series sort in Calibre. - Don't need \n after </span> looking for log entries. - Add include_images:coveronly option for [#1037](https://github.com/JimmXinu/FanFicFare/issues/1037) - adapter_literotica: Allow for empty div.aa_ht tags, remove extra None from text - adapter_wwwutopiastoriescom: Remove author page get, add extracategories instead. Site static now. - adapter_wwwutopiastoriescom: Updates for site changes. Version 4.31.0 - 2024-02-01 - Update translations. - adapter_deviantartcom: Changed to 2 post login (#1035) and finding story id - fetcher_flaresolverr: Report errors from Flaresolverr better and fail faster--no retries. - Update adapter_royalroadcom to remove 'stolen' injections. Thanks, grenskul - Fix for site change, adapter_deviantartcom. #1030 - Allow image/comic (/i/) and poems (/p/) on literotica - Fix estimatedWords site metadata for SB/SV - thanks mx-sylveon! - Swap out SuperFastHash implementation #1026 - Another OTW(AO3) block/hidden story string Version 4.30.0 - 2023-12-01 - Update translations. - Better handling of &<> entities with stripHTML() and chapter titles. #1019 - SB(but not SV) removed RSS link from thread list title. Closes #1017 - adapter_storiesonlinenet: Allow /n/ as well as /s/ paths - adapter_storiesonlinenet: Update for chapter URL change for paid subs. See #1014, thanks bpothier! - adapter_storiesonlinenet: Update for chapter URL change. See #1013 - adapter_fanfictionnet: Only use data-original cover images. - BrowserCache should ignore usecache flag, that's for BasicCache. Version 4.29.0 - 2023-11-01 - Update translations. - Retry Calibre metadata update when it fails due to conflicting program(Windows File Explorer) - adapter_asianfanficscom: Fix for 'friend only' stories initially giving 404 - Change bs4.find(text=) to string= for deprecation change. - Add use_flaresolverr_proxy:directimages experimental for #1007 - Add base_adapter.img_url_trans() for adapter_fictionlive image URLs #1004 - Update six.py to 1.16 for Python 3.12 compatibility. #1006 - ConfigParser.read_file added in py3.2, readfp removed in py3.12, only used in plugin #1006 Version 4.28.0 - 2023-10-02 - Update translations. - adapter_fanficsme: More fixes for unusual cases, now using regexp #999 - adapter_fanficsme: Fixes for some unusual cases Closes #999 - Switch from setup.py to pyproject.toml for CLI packaging. - Remove site: www.lotrgfic.com - DNS removed +1year ago - Remove site: www.lushstories.com - Changed +2years ago incompatibly Closes #988 - Remove site: www.silmarillionwritersguild.org - Changed +2years ago incompatibly - Remove site: www.scarvesandcoffee.net - Changed +2years ago incompatibly - Remove site: merengo.hu - Doesn't serve text in full print +1year - Remove site: www.destinysgateway.com - Domain parked +1year - Remove site: archive.skyehawke.com - Domain parked, broken ~3years - Remove site: worldofx.de - Changed ~2years ago incompatibly, not efiction - Remove site: hlfiction.net - Site broken ~3 years (sql errors) - Remove site: noveltrove.com - Site broken +1 years, owner unresponsive 3years Closes #998 - Refactor to make base_otw_adapter - Refactor adastrafanfic.com to use base_otw_adapter - Explicitly call set_image_allocation_limit() for larger image buffer and error on 0x0 image from image_and_format_from_data() See #997. Thanks dastrdly6585 for helping figure this out. Version 4.27.0 - 2023-09-01 - AO3: Real fix for adult string change, revert earlier attempted fixes. Version 4.26.1 - 2023-08-18 - Fix for extratags not being picked up by include_in_subjects Version 4.26.0 - 2023-08-17 - adapter_royalroadcom: user found a story with no chapters - base_efiction: .string -> stripHTML for nested tags Closes #984 - Fix fanfiktionde status parsing #980 - thanks, burny2! - AO3: Make subscribed, markedforlater True/False to match bookmarked/bookmarkprivate/bookmarkrec - Add title replace_metadata(commented) for literotica Ch/Pt titles - AO3: Add subscribed, markedforlater - Filter cookies for flaresolverr - Add _LIST option to include_subject_tags(/extra_subject_tags), refactor - AO3 fix for protected email addr in chapter name breaking chapter datetime - Fix for #979, AO3 Get URLs from Page - adapter_storiesofardacom: Fix for detecting adult question on indiv chapters. - New Site: sunnydaleafterdark.com, thanks inklesspen! - Add anthology_merge_keepsingletocs option, requires new EpubMerge. - Apply mark_new_chapters to new story chapters in Anthologies. [#977](https://github.com/JimmXinu/FanFicFare/issues/977) - Allow mark_new_chapters when 1 chapter in case it changes. - Increase sleep times between cache checks using open_pages_in_browser. - adapter_literotica: 'Fix' clean_chapter_titles for titles ending with Pt or Ch - Fix for ficbook.net date change. Closes #973 Version 4.25.0 - 2023-07-03 - Fix for make_firstimage_cover causing embedded image to also use cover.jpg. - adapter_wuxiaworldxyz: Paginated TOC - Add use_workskin option for AO3 (& squidgeworld). PR#967, thanks niacdoial - Make Rejects List Note column orderable. - fix_relative_text_links fix for #anchors doesn't handle '.' in id. Fixes #966 refer #952 - AO3 Check for hidden work after login. - adapter_storiesonlinenet: Login now has a hidden token. - #962 Thanks, mvlcek - Allow for href='' in fix_relative_text_links processing. Version 4.24.0 - 2023-06-02 - Fix wuxiaworld.xyz specific setting section - Fix force_cover_image when already in story - AO3: Apparently minor change to chapter end note HTML. #956 - wuxiaworld.co -> wuxiaworld.xyz changes most data collection #953 - Fix Update Always metadata in BG logic - fix_relative_text_links: Keep #anchor links if target also in chapter. See #952 - Add order_chapters_by_date option for literotica.com, used to be hard coded. - Add force_update_epub_always option to update when EPUB has more chapters than source. See #950 #949 #942. Version 4.23.0 - 2023-05-02 - Change force_img_referer to force_img_self_referer_regexp See #940 #941 - adapter_deviantartcom: Another detect login string. #947 - Show INI highlighting under [storyUrl] sections - Update translations. - adapter_quotevcom: Some stories have no comments. - Don't try to set seriesUrl when no series (Anthologies) - Add force_img_referer optional feature. Closes #940 - Add static include_in_* when double quoted. - Set Calibre Series URL link (calibre versions > 6.14) Version 4.22.1 - 2023-04-01 - Fix for custom columns [storyUrl] sections. And still work for Anthologies. Version 4.22.0 - 2023-04-01 - AO3: Better fix for always_reload_first_chapter vs use_view_full_work, fixes #932 - adapter_fictionmaniatv: Site change for status, fixes #931 - Remove doubled doreplacements/removeallentities from author(etc)HTML processing. - Fix for custom columns [storyUrl] sections. - Remove inline ads, only seen with flaresolverr so far - Changes to wattpad API mapping chapter URLs to story URLs. - adapter_ficbooknet: Fix for site change. - adapter_wattpadcom: Fix accidentally hardcoding a story in. - adapter_thehookupzonenet: Fix changed date format - Remove site: sugarquill.net - Site retired - Remove site: fanfic.potterheadsanonymous.com - No DNS, broken ~3 years - Remove site: www.looselugs.com - No DNS, broken ~3 years - Remove site: themaplebookshelf.com - No DNS, broken ~18 months - Remove site: www.ik-eternal.net - No DNS, broken ~18 months - Remove site: www.wraithbait.com - SSL expired +1yr, broken ~3 years - Remove site: csi-forensics.com - SSL expired +1yr, broken ~3 years - Remove site: archive.shriftweb.org broken ~4 years - Remove site: trekiverse.org broken ~3 years - Remove site: buffygiles.velocitygrass.com broken ~3 years - Remove site: www.qaf-fic.com broken ~3 years - Remove site: sword.borderline-angel.com broken ~3 years - Remove site: www.andromeda-web.com broken ~3 years - Remove site: tasteofpoison.inkubation.net broken ~3 years - Remove site: merlinfic.dtwins.co.uk 'This site has been removed due to PHP compatibility issues.' Version 4.21.0 - 2023-03-01 - adapter_fictionlive: fix #922 -- call utf8fromSoup exactly once - Thanks, HazelSh! - adapter_royalroadcom: Fixes for site changes. #923 - AO3: Re-soup full_work on every chapter to avoid problems with soup changes. Found with always_reload_first_chapter:true - adapter_thesietchcom: Fix for site more closely following XenForo2 - FlareSolverr: novelfull.com sometimes w/o expires of any kind - adapter_fictionlive: Soup chapter text to fix up HTML - Add style attr by default to fiction.live Version 4.20.0 - 2023-02-02 - Fixes for adapter_fictionlive story URLs-normalize & skip unsub URL - adapter_deviantartcom date changes #910, thanks bugmaschine - Revamp retries for browser cache with open_pages_in_browser - Fix for & in chapter title. - Add r_anthmax/n_anthmax options for custom_columns_settings - Fixed the Deviantart adapter not detecting that a Deviation is Marked as needing a login, thanks bugmaschine - Skip day of week for localization in browsercache_firefox2 - Move makeDate to dateutils to call from browsercache_firefox2 - adapter_mediaminerorg: Updates for site changes - adapter_fastnovelsnet: Fixes for site changes -- tested with use_flaresolverr_proxy - Update language->langcode mapping for updated AO3 list - Browser Cache Refactor & open_pages_in_browser feature See PR #905 and this MR post. - Fixes for config base_xenforo options, closes #902 - Fix for adapter_quotevcom status - Equalize ok/cancel buttons on user/pass & email pass dialogs - adapter_ficbooknet: Site change for status + remove debug - Tweak for adapter_storiesonlinenet description parsing Version 4.19.0 - 2023-01-01 - Fixes for config base_xenforo options, closes #902 - Fix for adapter_quotevcom status - Equalize ok/cancel buttons on user/pass & email pass dialogs - adapter_ficbooknet: Site change for status + remove debug - Tweak for adapter_storiesonlinenet description parsing Version 4.18.0 - 2022-11-21 - Update metadata caching with dependency invalidating - Still allow images with use_flaresolverr_proxy if use_browser_cache - Support classic AND modern (and minimalist) theme for storiesonline, finestories and scifistories - thanks, mvlcek - adapter_tenhawkpresents: Change site to t.evancurrie.ca - tenhawk domain semi-broken - remove_class_chapter missing from config lists - Remove Calibre Update Cover option entirely(was deprecated) #878 - adapter_adultfanfictionorg: Fixes for site changes, thanks cryosaur. Version 4.17.0 - 2022-10-19 - Update Tranlsations - Fix site name fanfiction.tenhawkpresents.ink - Flaresolverr v3 beta using 'expiry' cookie key, was 'expires'. - Flaresolverr v3 beta doesn't have 'headers'?? - adapter_adultfanfictionorg: Fixes for site changes. - Disable Cancel during metadata update ProgBar. - adapter_chosentwofanficcom: Site has several links to each story in a series page. - Fixes for add_category/genre_when_multi_category settings. #884 Version 4.16.0 - 2022-09-19 - Update embedded certifi to 2022.06.15.1 - Add use_ssl_default_seclevelone option for aneroticstory - Update translations. - Add flaresolverr_proxy_timeout (default 60000ms) #703 - storiesonline / finestories / scifistories : Change story URL scheme to keep story-title & use to detect story ID reuse. #882 - Fix for remove from update & rejects lists when lower selected first. - adapter_wattpadcom: Add include_chapter_banner_images feature, defaults on - Clear metadata cache on numWords set from plugin for derived values. - Deprecate 'Update EPUB Cover?' Download Option. See #878 and Cover Settings Calibre Plugin - Add force_cover_image setting - Add use_old_cover setting - Add 'Set Calibre Cover Only for New Books' checkbox - Remove RSS link from threadmarks_title (XF2) - Also include threadmarks_title in tagsfromtitle (XF) - nsapa_proxy: detect proxy protocol violation - Fix #865 - thanks, nsapa 2022-08-19 - Make series name/comment area scrollable for when lengthy. Version 4.15.0 - 2022-08-11 - adapter_adultfanfictionorg: http->https Closes #870 - Fix for win10/qt6 progbar not displaying initially. - Add get_section_url() for adapter_royalroadcom for longer story URL [sections] - adapter_storiesonlinenet: Single chapter stories slightly different. Also scifistories and finestories. Closes #867 - Use cal6 icon theme system to allow plugin icon customization. Version 4.14.3 - 2022-07-15 - Update translations. - Remove site: webnovel.com See #843 - Fix for qt6 vs qt5 in Calibre6 and personal.ini search. Version 4.14.0 - 2022-07-11 - Update translations. - adapter_fictionhuntcom: Fix for changes to chapter list. - Restore & > < entities in chapter titles. Closes #863 - Update translations - Better handling for fail of an existing anthology book on update. Closes #860 - adapter_fictionhuntcom: Update for site changes. - Fix for problem with remove_tags refactor. - Refactor code to remove empty tags to also remove now-empty parents by making another pass. - Collect rating for adapter_libraryofmoriacom, refactor rating from TOC in base_efiction. Closes #859 - adapter_themasquenet: Switch to https, closes #854 - PI: Ctrl-Return/Enter on personal.ini editbox equivalent to clicking OK button. - base_xenforoforum_adapter(QQ): Allow for guest/deleted author w/o a link. Closes #852 - adapter_readonlymindcom: Add include_author_notes setting - See #850, thanks FayeGray! - adapter_mcstoriescom Allow multiple authors. Closes #847 Version 4.13.0 - 2022-06-01 - Update translations. - adapter_chosentwofanficcom: http->https - adapter_mediaminerorg: More story URL forms. #845 - Don't set marked in Calibre when book_id is None #833 - adapter_quotevcom: Update collection of searchtags - Add config check parsing for custom_columns_settings on personal.ini save. - Refactor img code in story.py to fix a problem when cover image also in story. - fastnovel.net -> fastnovels.net - Rename adapter_fastnovelsnet - Fixes for site changes - fix storiesonline login (again) - parameter name was changed back to "email" (#840) - Thanks mvlcek! - adapter_webnovelcom: Not all paragraphs starting with '<' are HTML. #841 - Lighten color highlighting for storyUrls sections in dark mode. - fix storiesonline login - thanks, mvlcek! - adapter_ficbooknet: Fix for site change. - adapter_wwwutopiastoriescom: Fixes for site changes. - adapter_fanficsme: Fix for changed 'words' metadata. - Remove site tomparisdorm.com - Moved to AO3 - Remove site: bloodties-fans.com - Moved to AO3. - Remove site wuxiaworld.com Closes #796 - Remove site wuxiaworld.site Closes #758 Version 4.12.4 - Bug Fix Release - 2022-05-02 - Fix for SpaceBattles using an attr on noscript tags now. - add chapter date metadata to RoyalRoadAdapter (#831 thanks buckley-w-david) - Address Storiesonline.net "Click to Load text..." (#829 #756 thanks mvlcek) - adapter_storiesonlinenet py2 fixes See #832 #829 #830 Version 4.12.0 - 2022-04-27 - Update translations. - Py2 vs py3 fix #828 - adapter_phoenixsongnet: Remove login code and changes for static author links. - adapter_webnovelcom: Fixes for site changes. #828 - adapter_fictionhuntcom: Fixes for site changes. - Xenforo2 status Ongoing==In-Progress - Apply connect_timeout setting to network requests. - adapter_webnovelcom: Unescape & too. See #825 - Detect and error on adjusted chapter list < 1. Closes #826 - adapter_webnovelcom: Read chapter text from json in <script> tag. - Add --mozilla-cookies CLI option. - use large cover images on royalroad (#823) Thanks sidney! - PI: Check for existing anthology ebook on new anthology from series URL. - ffnet: Add meta_from_last_chapter option. - adapter_literotica: add ...$ to story URL search for when /xyz-pt1 and /xyz are different stories. - fix wuxiaworldco: www => m (#818, thanks Rikkitp) - Adding fandom/category parsing to adapter_fictionhuntcom--more than just HP now. Version 4.11.0 - 2022-03-23 - Update translations. - adapter_quotevcom: Additional chapter image parsing. - royalroad: Recognize and normalize various chapter url formats (#813), thanks sidney - Change base_xenforoforum reveal_invisible_text feature to also add class=invisible_text. Closes #812 - adapter_fastnovelnet: Update to redirected Story URL. - adapter_fastnovelnet: 'Normalize' chapter URLs to current storyId URL--site is changing it frequently - base_efiction - narrow chapter search more--for merengo.hu. - Stop looking for FFDL settings--it's been 7 years. - Look for story URLs in pasted mime as well as dropped. See #809 - adapter_storiesonlinenet: fix for dateUpdated when 'Last Activity' #808 Version 4.10.0 - 2022-02-14 - adapter_fanfiktionde: Update where description comes from. - ReadOnlyMindAdapter: Add series_tags feature to populate series metadata (#803) - Thanks Nothorse - Add use_flaresolverr_proxy:withimages option for FlareSolverr v1 users. - Correct use_flaresolverr_proxy error checking. - adapter_royalroadcom: Add status 'Dropped' - New Site: readonlymind.com, thanks Nothorse Issue #767 PR #801 - Force include_images:false when use_flaresolverr_proxy:true -- FlareSolverr v2.2.0 crashes on image request. - Remove defunct site: hpfanficarchive.com - base_efiction: Add 'Igen' as equiv to 'Yes, Completed' in Hungarian - adapter_royalroadcom: Add status 'Stub' Closes #800 - New site: merengo.hu (Hungarian), thanks estherflails - Remove site: fanfic.hu (moved to merengo.hu, storyIds don't appear to be the same) - Fix for py2 for base_xenforoforum tagsfromtitle. Thanks hseg for the help. See [#791](https://github.com/JimmXinu/FanFicFare/issues/791) - Extend base_xenforoforum tagsfromtitle for ')(' '][' - Changes for upcoming Qt6 Calibre Version 4.9.0 - 2022-01-11 - Remove removed fictionalley site from plugin-example.ini - Update defaults.inis for Chrome's new Cache_Data dir. - Update translations. - Adding plugin feature to Mark anthologies when individual story skipped. See #786 - Refactoring of cli.py by hseg. - Tweaks to base_xenforoforum tagsfromtitle default replace_metadata by hseg. - adapter_archiveofourownorg: AO3 notification emails now sending http: instead of https: - Add remove_class_chapter feature, true by default. For Calibre convert with Base eFiction. - adapter_scribblehubcom: Corner case removing spoilers. Closes #778 - adapter_wwwnovelallcom: fixes for story w/o chapters & html desc. Version 4.8.0 - 2021-12-02 - Add fix_relative_text_links feature, defaults to true. - Make Scribble Hub spoilers & footnotes look nicer PR#733, thanks Epicpkmn11! - Add averrating metadata to adapter_novelfull. - Fix for cover_min_size causing failures with SVG images when no_image_processing:true. - Set default slow_down_sleep_time:2 for [www.asianfanfics.com] - Deviantart date fix (closes #768), also storyId and extratags changes, thanks jcotton42 - New Site: www.deviantart.com, thanks jcotton42 (see #765 and #374) - New Site: psychfic.com (re-added), thanks HappyFaceSpider Closes #764 - adapter_storiesonlinenet: Take rating from 'Age' field on scifistories/finestories - Thanks bpothier - adapter_ficbooknet: Fix for site change. Version 4.7.0 - 2021-11-04 - Code for FlareSolverr v2.0.X, can't handle images. - Update translations. - adapter_royalroadcom: fix for ancient bug reading unixtime attr that's come back after years. #753 - fictionalley-archive.org: Convert adapter_fictionalleyorg to adapter_fictionalleyarchiveorg. - adapter_storiesonlinenet: Fix for site updates, login and dates. - adapter_wwwutopiastoriescom: Add siterating_votes,siterating,siterank_of,siterank,v iews #750 - Fix for more arbitrary py3 incompatibility(MutableSet). Closes #748 - Update bundled certifi to 2021.10.08 - Switch config _filelist feature from using urllig.request.build_opener to fetcher.RequestsFetcher. - Switching royalroad.com specific 'get from imap' code to use fetcher instead of urllib. For #746 - adapter_wwwutopiastoriescom: Split 'eroticatags' metadata entry rather than single string. Closes #744 - Handle errors in royalroad email links better. - Fix for flaresolverr_proxy doing get urls from page - Add flaresolverr_proxy_protocol setting to allow for https, #739, submitted by TheCakeIsNaOH Version 4.6.0 - 2021-09-30 - Remove site www.squidge.org/peja now hosted on squidgeworld.org - Remove site faerie-archive.com - redirects to some sketchy looking ad sites. - Remove site fanfiction-junkies.de - redirects to ad site. - Remove site it-could-happen.net - redirects to some sketchy looking ad sites. - Remove site sebklaine.net - redirects to some sketchy looking ad sites. - Remove site nha.magical-worlds.us - redirects to something unrelated. - Fix for adapter_wuxiaworldsite site change - chapter list in page HTML now. - Better error message for AO3 login-required series. Closes #736 - Accept wuxiaworldsite.com as alias for wuxiaworld.site. - Don't retry connection to flaresolverr proxy and report specifically on fail. Closes #737 - Tweak XF tagsfromtitle in defaults.ini to not break & - Remove some debugs. - Fix for adapter_asianfanficscom - site changed author URLs. - Fix for FFF plugin not recognizing the same ffnet story URL when the title changes. - Add order_threadmarks_by_date_categories option, closes #733 - Add feature use_flaresolverr_proxy - Fix for asianfanfics.com site change, thanks oh45454545. inject_chapter_title setting may be unneeded now? - Add 'min' for minutes to parse_relative_date_string() #731 - Fix for dateutils change(#731) breaking royalroad - Fixes for site changes in adapter_webnovelcom. #731 - Add POST request for wuxiaworld.site site changers. Closes #729. Version 4.5.0 - 2021-08-25 - (Known issue: #729 - wuxiaworld.site has changed) - Update translations. - Fix for lazyload images in base_xenforoforum_adapter - Keep existing series/anthology URL during update for config purposes. - Allow chapter URLs for adapter_webnovelcom. - Shift adapter_fictionmaniatv to http, problems with https server? - Change blockfilecache to save uint32 addrs instead of original cache key. Hashing cache key proved unreliable in some cases. - Allow fictionpress.com with use_browser_cache--user still needs to configure in personal.ini Closes #716 Version 4.4.0 - 2021-07-13 - Add http_proxy and https_proxy settings. Should be unnecessary, also taking from Calibre. - Fix for XF2 stories using author img as cover when absolute URL. - XF: data-url or data-src for lazyload images. Closes #713 - adapter_royalroadcom: Collect numWords. #712 - XenForo2 sites (SB&SV) collect estimatedWords. #712 - Update packaged urllib3 and certifi modules. - Pre-v5 Calibre fix for nsapa_proxy. - Record error message for new downloads too since Failed Chapters are now a thing. - adapter_wwwnovelallcom - Updates for site changes. 'translator' no longer available? - New Site: worldofx.de (German language X-files eFiction) - Fixes to nsapa_proxy from nsapa https://github.com/JimmXinu/FanFicFare/pull/711 - Add link to wiki/BrowserCacheFeature in Cloudflare error. #708 - Treat img url contains '.svg?' same as endswith('.svg')--Calibre image processing chokes hard on SVG. #709 - Implement use_browser_cache for ficbook.net #704 - Forgot to import traceback in browser cache changes. - Skip Failures to read cache entries for Chrome Simple Cache and Firefox Cache2 instead of error. - Fix date reading for XenForo forums sites - Change defaults.ini to correctly show default values for remove_spoilers, legend_spoilers - Collect 'fandoms' for adapter_scribblehubcom. - PI: Only update author link (AKA authorUrl) in Calibre if changed. Only really affects older versions of Calibre. Calibre does the same starting around Sept 2020. Version 4.3.0 - 2021-05-30 - quotev.com: use_cloudscraper:true by default. - Update translations - adapter_bdsmlibrarycom: Set author Anonymous when author not found instead of sys.exit(). Closes #696 - Fix XF authorUrl and author_avatar_cover feature. Closes #695 - Catch exceptions in word count. - Add CLI --color option for warns and fails. Closes #692 - Report browser cache load fail as such. Version 4.2.0 - 30 Apr 2021 - Add New Site: novelfull.com (#688 & #689) - Thanks, AlexRiina! - Need to set logger.setLevel() again with import changes to see debugs in plugin. - import changes for arch linux system plugins - As submitted by eli-schwartz - Remove site: fictionpad.com, completely different site, looks like generic parked? - Remove site: www.thundercatsfans.org, no longer efiction, now static pages and PDFs - Remove site: www.thepetulantpoetess.com, no longer efiction, URLs like OTW but different - Remove site: www.potterfics.com, "Potterfics.com has closed its doors forever" - Remove site: fanfic.castletv.net, DNS there, no server, last successful 2018-10-21 - Remove site: deandamage.com, site there, efiction broken, last successful 2018-12-04 - Remove site: www.deepinmysoul.net, moved to deepinmysoul.nl and changed software--not eFiction anymore, <100 stories, all old - Include code for nsapa_proxy for dealing with Captchas (by nsapa -- coming soon!) - Some other import cleanup. - Updates from cloudscraper 1.2.58 - Use newer Calibre image processing, add JPG quality setting - thanks, Malloc Voidstar - Add use_cloudscraper:true under [www.ficbook.net] to defaults.ini - Fix for adapter_literotica story URL oddities. Again. - Fix for site change: adapter_fictionmaniatv - Get storyId for sugarquillnet and siyecouk from the parsed query string. From mcepl - Fix for adapter_literotica changing URLs on author page yet again. - Add [harrypotterfanfiction.com] slow_down_sleep_time:1 -- Site blocking fast downloads. Version 4.1.0 - 26 Mar 2021 - adapter_literotica - Update for recent site change and fix first chapter - Thanks, davidfor! - adapter_fictionlive - Fix off-by-one error in most_recent_chunk / add_chapter_url interaction, closes #672 Thanks, HazelSh! - Fixes for literotica sites changes. Issue #671 - Fix for include_dice_rolls when multiple fieldsets. - Check for img 'failedtoload' *before* trying to fetch on updates. - Issue with fiction.live setting in defaults[fiction.live] overriding personal[www.fiction.live]. Could use a more general solution if I can think of one. - minor changes to track fictionlive website updates - Thanks, HazelSh #668 - Fix show_timestamps option in adapter_fictionlive - Add include_dice_rolls option - Include error for continue_on_chapter_error in log - Put 'Change theme to Classic' back in adapter_storiesonlinenet - Remove some dup imports/code, thanks akshgpt7. Closes #663 - use_ssl_unverified_context:true ignored when use_clouadscraper:true - Fixes for ancient 'import *' getting broken by removing unused imports in base_writer -- Fixes "name 're' is not defined" with HTML output. Version 4.0.2 - 21 Feb 2021 - Fix for BG job race conditions. - Fix writer_txt import removeAllEntities - Update plugin about.html - Fix reduce_zalgo not imported. Version 4.0.0 - 18 Feb 2021 - Major refactoring/rewrite of network fetching and caching layer using `requests` library. - use_browser_cache feature added -- Read fanfiction.net stories from your Chrome or FireFox browser cache in addition / instead of the network. Many thanks to Sidney Markowitz for the stellar help with this. See BrowserCacheFeature Wiki Page. - Add additional_images setting for html & epub formats. Close #648 - Fix for 'Updating' (anonymous?) author in adapter_wuxiaworldsite. For #657 - Allow tweak_fg_sleep etc with any site, add defaults settings for basexenforo, fictionalley and fictionpress. - Drag/drop of 'emails'--look for story URL in Content-Base header for Thunderbird RSS 'emails'. - Apply 'email' proc flag when processing dragged .eml files--which are emails. - Update translations. - Fix adapter_webnovelcom for some site changes. Closes #644 - Allow tweak_fg_sleep etc with any site, add defaults settings for basexenforo, fictionalley and fictionpress. - fanficauthors.net doesn't use login anymore. Closes #651 - BG % done by stories AND chapters. - Restore multi-process background jobs as one process per site. - Don't count continue_on_chapter_error chapters when checking vs 'new chapters'. - More properly get msg payload fromemail drag and drop. Closes #645 - Give adapter_archiveofourownorg a get_section_url() for quicker rejects checks from email. - Convert adapter_spikeluvercom to base_efiction after site changes. - Remove 'extrasleep' feature--it was ugly--increase slow_down_sleep_time for the couple sites that used it. We can trust the users, right? - Remove httplib._MAXHEADERS workaround for royalroad.com - not happening anymore. - Fixes for py2/py3 & a stray INI space. - Fix for Reject List to equate story URLs with and without titles, for XenForo and ffnet. Otherwise you can end up with dups in Reject List and not recognize new URLs are already being rejected. Also fixes [storyUrl] sections without titles for ffnet. - Fix fictionpress.net and retain Reject List entries for removed sites. - Get cloudscraper 1.2.56 changes, but keep py2 compat. - Fix for chapter error report. Closes #641 - adapter_fanfictionnet: Start keeping story title part of storyUrl. Version 3.29.0 - 20 Jan 2021 - Re-enable adapter_fanfictionnet and bump up sleep times for same. - Update translations. - Add better chapter error reporting, refactor proceed_question code. - Add plugin options to mark success/failed/chapter error individually. - Clear metadata cache after adapter metadata fetch. Cached metadata values may not be replace_metadata processed if fetched before their conditional dependencies. Revealed by AO3 one-shots using title for chapter name. - ffnet fpcom, continue_on_chapter_error:true by default, increase sleep times. - First rough version of reporting continue_on_chapter_error chapters. - Report chapter_error in custom error column and marked (when configured). - Update to cloudscraper v1.2.52 - Increase times between retries on fetch error. - Tweek ffnet/fpcom sleep times again. - slow_down_sleep_time: randomize between 0.5 time and 1.5 time. - Report cloudscraper exceptions as such, plus hide the potentially misleading 'opensource' part. - adapter_fanficsme: do an extra fetch before login for cookie(?) Closes #633 - adapter_webnovelcom: Fixes for site changes. Closes #629 - quotev.com: site change in date parse, use utf8:ignore as first encoding choice. Closes #625 Version 3.28.0 - 11 Jan 2021 - Disable adapter_fanfictionnet with warning about site blocking. - Catch exception from emails not decoding, skip & logger.error(). - Add a fake get_image_size() method for when no image processing available. Closes #621 (CLI only) - Change adapter_twilightednet to https - Change for adapter_fanfictionnetadapter_fanfictionnet to make skip_author_cover work again. - Make included certifi and requests use same tmp file code and store under calibre tmp dir for cleanup. - Add append_datepublished_to_storyurl option for storiesonline.net, finestories.com, scifistories.com only. Version 3.27.0 - 24 Dec 2020 - Add use_cloudscraper code to use with CloudFlare sites, like fanfiction.net now does. - Changes to allow email chapter update URLs to work in adapter_wattpadcom - Updates for many included dependencies Version 3.26.0 - 15 Dec 2020 - Use refresh_screen=False when calling Reading List add/remove, refresh book_ids. - Clear user_agent for literotica.com - Fix finding imgs in existing epubs. Closes #608 Many thanks to Epicpkmn11 for finding this before I released. - Fixes for adapter_fictionlive, thanks HazelSh - Make default CSS for fiction.live and royalroad.com use em instead of pt, thanks HazelSh - Fix for genre change in adapter_royalroadcom - Fix for adapter_storiesonlinenet 'access' issue. - Don't error on <img> w/o class in replace_failed_smilies_with_alt_text - Allow tab to leave edit boxes. - Revert(ish) 'fix' for ffnet covers--they fixed it. - Change convert_inline_images default to false. - Fix http/https matching in identifiers:url search. - Allow <img> tags without src attr in epub to update - Fix for ffnet cover images changed? Or broken? - Warn, not crash on when cover_min_size fails. - Add 2nd dup-story URL check after fetching metadata for when story URL changes. - Fix adapter_thesietchcom for site change - Add (optional, default on) convert support for data:image in-line <img>s. - Adding pass-through support for data:image in-line <img>s. - XenForo: Fixes for extra /s in normalized URLs. - Set default cover_min_size: 10,10 to avoid spacer images as covers. - New Site: squidgeworld.org - shares code with AO3. - adapter_wuxiaworldco: added status #592 from Rikkitp - Don't use polyglot, not included until Calibre3. Remove some debug output. - adapter_scribblehubcom: Accept chapter URLs. - adapter_wwwnovelallcom: Accept chapter URLs, must change to true storyId/URL after. - Make adapter_novelupdatescc share code with adapter_wuxiaworldco - adapter_literotica: Keep language domains & use for language metadata. #588 - adapter_alternatehistorycom now uses same thread group HTML as XenForo2. Closes #590 - adapter_wuxiaworldco/adapter_novelupdatescc: Re-add Don't include grayed out 'In preparation' chapters Version 3.25.0 - 09 Nov 2020 - On drag and drop, accept text/html and remove %0D at end of text/uri-list URLs. Closes #587 - New site: fastnovel.net, thanks Rikkitp - Update translations. - Don't error out on non-editable custom columns ValueError. - Add Yes/No to all to most question_dialog boxes. - fiction.live: fixed crash with stories with achievements (introduced in last set of commits) - Thanks, HazelSh - Fixes for drag-n-drop features. - Allow better editing of story URLs in edit box. - Change seriesHTML to not be filled without series. - Fix for Xenforo2 change (SB/SV) - Update adapter_ficbooknet for site changes. - Fix for latest storiesonline login change, thanks mrEd - Add checks for 'from saved column' when not config'ed and update-epub when default format isn't epub. - Don't disable Update Mode with By Action menus. - Do 'not an anthology' dialog outside busy_cursor - Fixes for Fiction.live URLs re: #559 and #573 -- Thanks, HazelSh! - Adds 'Actions by Update Mode' menu - Include icons for 'Actions by Update Mode' menu - Fix for email immediate download when not using English. - "Hide"(setVisible(False)) rather than disable unused menu items. - Disable rather than "hide"(not create) unused menu items, reorg into sub menus. Version 3.24.0 - 15 Oct 2020 - fiction.live - handle api returning non-int values for votes PR #568, thanks muchtea - adapter_scribblehubcom: Include author notes/news in chapters unless in exclude_notes - thanks, Epicpkmn11! - archive.hpfanfictalk.com -> fanfictalk.com plus site changes for same. - Change ponyfictionarchive.net to https by default - Making eFiction series name/desc collection work with more sites. - Apply CLI --json-meta to --list to see series name/desc. - Fix adapter_storiesonlinenet login. Closes #562 - Add AO3 Series 'status'. - Don't save cover image size for dedup_img_files - Calibre might replace it. Also fixes #561 - Better GUI for series anthology - Adding eFiction series parsing attempt to base_adapter. - ensure_text plugin-example.ini for py3 - New site: www.the-sietch.com XenForo2 site with weird URL scheme. Closes #430 - Add get_urls_from_page() and get_series_from_page() to adapters, add support. AO3 and TtH only so far. - Add include_author_notes option (defaults on) to adapter_royalroadcom Closes #556 - adapter_fictionlive: Handle stories with missing contentRating, storyStatus & support beta.fictionlive.com domain, thanks HazelSh! - Add setting `remove_tags:script,style` replacing script remove hardcode, adding style remove. Closes #553. - New Site: novelupdates.cc (possible transition dest for wuxiaworld.co?) - Thanks ElminsterAU! - Fix for adapter_wuxiaworldsite not setting authorUrl. - Add dedup_img_files option(default:false). #550 - wuxiaworld.co and novelupdates.cc don't author links after all? Version 3.23.0 - 14 Sep 2020 - adapter_valentchambercom - requires SSL and only allows w/o www. - adapter_hpfanficarchivecom - SSL cert SSL_ERROR_RX_RECORD_TOO_LONG, back to http - Update translations. - fiction.live - add support for multi route stories, thanks muchtea! - New Site: wuxiaworld.site, thanks, Kolbo5! - Handle more fiction.live URLs -- closes #541, thanks HazelSh! - fiction.live: null handling in format_readerposts -- closes #539, thanks HazelSh! - fiction.live: changed time formats for livetime metadata, chunk timestamps to avoid localized names -- fixes #538, thanks HazelSh! - adapter_occlumencysycophanthexcom needed another 'needs login' string. - Fix anthology comments for changes in how Calibre handles them. - Display number of URLs found for an anthology. - New site fiction.live, thanks HazelSh! - Fix for Anthology bug when no story has a series. - Added a string for translation. - Add a 'shouldn't happen' error check for anthology merge. - Add note about anthologies and epub3 to plugin-defaults.ini - Show busy cursor during anthology merge & update. - adapter_literotica: Fix for language domain name links on author page. - Fix chapter URLs in wuxiaworld.co. - Update for site changes, wuxiaworld.co update -- thanks, teffalump! - More fixes for wuxiaworld.co update -- thanks, teffalump! - Added wuxiaworld.co specific setting dedup_order_chapter_list to optionally apply teffalump's chapter dedup and ordering code. Defaults to false. Version 3.22.1 - 13 Aug 2020 - Fix for Reject list not working for new users/libraries. Version 3.22.0 - 09 Aug 2020 - Accept storyUrl with title in it for adapter_webnovelcom. Addresses #520 - Fix adapter_mcstoriescom getSiteExampleURLs() - Remove outdated rejecturls from plugin prefs--replaced by rejecturls_date last 18+ month back. - Fix for adapter_quotevcom site changes. - Fix adapter_harrypotterfanfictioncom desc parse for site change. - Changes for Python3 deprecation warnings (mostly) from eschwartz - Normalize literotica.com URLs to www.literotica.com - New Site: scribblehub.com - Thanks, mavi0! - Fixes for site changes: adapter_ficbooknet - Change INI error link blue color in dark mode. - Add 'Series [0]' option for new anthologies. - For anthologies, look for common val in numbered series00 if not all share 'series'. Version 3.21.0 - 07 Jul 2020 - New site: chireads.com -- Thanks, Kolbo! - Fix for recursion in add_genre_when_multi_category caching bad value. - Change INI edit highlight colors when dark theme. - Add cover_min_size setting. - Fix add_genre_when_multi_category so it can include_in_ without breaking and move above doreplacements. - Add .SHOW_EMPTY feature for titlepage_entries. - Check for epub before polishing cover into it. - Change site efiction.esteliel.de to faerie-archive.com, also changed siteabbrev eesd->fae - Allow for no genre stories in adapter_fanficauthorsnet. - Fix adapter_webnovelcom sitetags for site changes. Version 3.20.1 - 06 Jun 2020 - Fix for collision issue with translations and email direct d/l. (Bug fix release for problem described here.) Version 3.20.0 - 01 Jun 2020 - Add more URLs to cover_exclusion_regexp for base_xenforoforum. - Fix for is_adult needing &showRestricted URL in adapter_harrypotterfanfictioncom. - Better auth page parsing due to own-favorite story in adapter_harrypotterfanfictioncom. - Add characters and increased category collection for adapter_fanfiktionde. - Suppress output_css on CLI -z - Fix numWords parsing in adapter_fanficsme. - Update translations, add Russian. - Fix broken series parsing in adapter_adastrafanficcom & adapter_lotrgficcom. - New Site: www.silmarillionwritersguild.org, thanks Alistair! - Allow /post/ story URLs with adapter_gravitytalescom. - Change <td> to <div> in chapter text adapter_adultfanfictionorg - Now actually *use* translated strings in prefs.py. - Need to include prefs.py in messages.pot for translation. - Update Translations. - Catch exception in exception handling for French user. - Remove '.' from numWords in adapter_fanfiktionde - Fix for adapter_bloodshedversecom site changes. - Find both 'Translator' and 'TranslatorS', except in Russian. adapter_fanficsme Version 3.19.0 - 01 May 2020 - Comment out a debug, user_agent for wuxiaworld.com - Fix adapter_fictionmaniatv image page parsing, thanks smutandrea - Fix adapter_fanficsme for date tags change. - Fix a py2/py3 issue in Calibre Plugin CLI call, thanks eschwartz - Change inject_chapter_title back to h3. - Allow for author without link & id in XF2. - Change inject_chapter_title code in adapter_storiesonlinenet due to clean up weirdness. - Change defaults.ini recommendations for inject_chapter_title and change injected titles to h4--had problems with epub update. - Fix for py2/3 differences in final strip-non-ASCII decode fall back. - Remove some 'watermarking' tags from adapter_webnovelcom - De-obfuscate emails in XenForo posts. - Change default setting for new users for 'Update Calibre Cover (from EPUB):' to 'Yes, if EPUB has a cover image' - Add scifistories.com to valid site list for universe_as_series setting. - New Site: scifistories.com (extends finestories.com). Version 3.18.0 - 01 Apr 2020 - Resurrect fanfiction.tenhawkpresents.com and change to fanfic.tenhawkpresents.ink - fictionalley.org needs a slow_down_sleep_time or it starts rejecting conns. - Changes to adapter_archiveofourownorg for AO3 changes re: view_adult=true - Accept https URLs for adapter_wwwutopiastoriescom, but don't use https--doesn't work with python. - Remove extra spaces from replace_metadata examples - Fix Description parsing with series/universe/contest links in adapter_storiesonlinenet. - Fixes for ficbook.net site changes. - Correct comments for universe_as_series setting in defaults.ini. - Fix for adapter_ficbooknet when no ships/characters. - Make sure all timestamps are using Calibre's local_tz. - Need to unicode() ini data passed in from Calibre CLI. - Add inject_chapter_title feature to adapter_storiesonlinenet. - Fix for XF logins using manual user/pass instead of personal.ini. Version 3.17.0 - 14 Mar 2020 - Add base_xenforo2forum feature skip_sticky_first_posts(on by default). Closes #470 - Ignore AO3's chapter numbers for use_view_full_work and use chapter offset instead. Closes #473 - Add order_threadmarks_by_date to base_xenforoforum, improve defaults.ini. For #469 Version 3.16.0 - 13 Feb 2020 - New Site: archive.hpfanfictalk.com (eFiction non-base) - Reduce debug output in base_xenforoforum_adapter. - Add replace_xbr_with_hr feature. - Update translations. - Fix for adapter_storiesonlinenet requiring 'v' from login.php. - Add more domains for AO3. - Use storyUrl from metadata for checking library, for those sites that make canonical storyUrl difficult, like adapter_literotica. Closes #461. Plugin only. - Optional EPUB 3.0 output Version 3.15.0 - 15 Jan 2020 - Remove site nfacommunity.com, parked domain, last worked Dec2018. - Remove site fannation.shades-of-moonlight.com, parked domain, last worked Dec2018. - Kludge fix for incorrect HTTP response 500 code from trekfanfiction.net. - trekfanfiction.net uses utf8 now - Make sure storyUrl has &->& and then change it back for Calibre. Matches how authorUrl is handled(in all_metadata). Closes #460 for adapter_sugarquillnet . - adapter_sugarquillnet change chapter text td to div. Issue #460 - Update adapter_alternatehistorycom for XenForo2. Issue #457 - Order custom columns in config page. - Add -U/--update-epub-always option to CLI. - Don't do URL quoting on file: URLs. Fix for spaces->+ breaking default cover. - Catch ',' in front of 'Thread' in forum titles. XenForo sites. - Set minimum_calibre_version to v2.85.1, last of 2 series. - Changes for Python3 compatibility, thanks eschwartz! Version 3.14.0 - 16 Dec 2019 - Different email URL for royalroad.com. Closes #452 - Update adapter_fictionmaniatv to use HTML versions containing images and fall back if not found. - Update adapter_fictionmaniatv to use HTML versions vs text by default. - Update Translations - New Site fanfics.me (Russian language site). - (Fix incorrect version number.) - Base_eFiction - Get Rating/Rated from TOC page if not found on print page. Remove from 2 individual adapters. - Failsafe for max_zalgo setting. Closes #449. - Add plugin option for toolbar button to pop menu. - Fix AO3 chapterstotal replace_metadata for multi digits. - Add <div class='fff_chapter_notes'> around AO3 chapter head/foot notes. Issue 447 - Remove feature to save cookiejar between downloads and BG jobs--causes some obscure problems with QQ at least. Closes #466 Version 3.13.0 - 15 Nov 2019 - Add some code to handle 24 hr clocks w/o changing adapters. - Don't escape # in URLs, causes problems with ficbook.net. - Bypass expired SSL cert by not using SSL. adapter_thehookupzonenet - Bypass expired SSL cert by not using SSL. adapter_spikeluvercom - Remove site twilightarchives.com - Closed as per web site. - Remove site lotrfanfiction.com - Closed as per web site. - Remove site www.13hours.org. Moved to AO3. - Add site specific chapterslashtotal and chapterstotal for adapter_archiveofourownorg. - Fixes for adapter_webnovelcom site changes to JSON. - Add parentforums site specific metadata for base_xenforo, include partial list in category. - Add user/pass to adapter_fictionhuntcom, required to see chapter text now. - Discard cookie cache on library change--might use different users/settings. - At least one efiction site said Completed: Completed instead of Yes. - Adding some html class attrs to epub output for ease of CSS. - Add --no-output CLI option. Closes #443 - Save cookiejar between downloads during same calibre session, including BG jobs. - Avoid post URLs in XenForo notification emails for QQ & AH too. - Avoid post URLs in XenForo notification emails better w/o catching post in thread title. Probably. - Fix for 404 error on XF always_login. Closes #438 - Fix for CLI update fail on one story causing all subsequent to also skip update. Issue #438 - Avoid post URLs in XenForo notification emails better. - Treat spacebattles /post/ URLs in emails the same as sufficientvelocity to avoid extra URLs in thread notifications. Version 3.12.0 - 14 Oct 2019 - Update Translations - Add defaults.ini CSS for ficbook.net to preserve line breaks. - Changes for adapter_forumsspacebattlescom to use base_xenforo2forum. - Correct AO3 author parsing for high-byte characters. - Additional warnings about imaptags added to manually added story URLs. - Fix for adapter_trekfanfictionnet URL change. Closes #433. - Add 'Restricted to Registered Users'(restricted) metadata to AO3. - Fix for unicode chars in url params, fixes 427 - Add feature to automatically add optional tags for stories downloaded from email URLs. - New Russian Site added: www.swi.org.ru - Thanks gunmetal313 - Fix for wordcount in adapter_fanfiktionde when max_zalgo:1 Version 3.11.0 - 04 Sep 2019 - Update Translations - Add URL prefix for XF2 authorUrl if relative. Circa Aug 23, 2019 SV changed the author URL FFF collects to a relative link and I didn't notice it until now. - Add dedup_chapter_list option for buggy chapter lists. Optional in case they're not buggy. - Add fetch_last_page for base_xenforo--SB doesn't send notice emails if user not up-to-date now. - Fix for corner-case with deleting Rejects. - Fix for XF1 regression caused by XF2 threadmarks metadata code. - Add XF2 threadmarks_cover/status/desc/title options. Version 3.10.5 - 30 Jul 2019 - Fixes for IMAP folder parsing. - ensure_str on IMAP4 folder name for Python3. Fixes #419 - Fix adapter_inkbunnynet incorrect example URL, caused problems with get URLs from page. Version 3.10.0 - 27 Jul 2019 - Additional error checking and output for IMAP4 fetch. - Add always_include_first_post_chapters to base_xenforoforum_adapter - XF posts can include a tags without href, look for href searching for links. Closes #417 - Add work around to fix XF2 issue with multiple '...' in threadmarks. - Tweak getting URLs from email for SV XF2 changes, don't get post URLs. - Changes to adapter_forumssufficientvelocitycom for XenForo2 migration. - Fix for Plugin: Group reported results better for meta-only updates. - Plugin: Group reported results better. - Add a de-dup check to XF threadmark collection due to at least one SB story having TM bug. - Adjust reader_posts_per_page for forum.questionablequesting.com. - adapter_wuxiaworldco: Don't include grayed out 'In preparation' chapters - Move BS version debug so it doesn't appear in CLI without -d. Version 3.9.0 - 25 Jun 2019 - Fix for regression on XF not-first index post. - Fix for a corner-case global_cache written by py2, then read by py3 bug. - Update included dependencies -- mostly for Calibre 2.85.1. - adapter_asianfanficscom json fixes - thanks oh45454545 - adapter_asianfanficscom foreword json fix - thanks oh45454545 - Change metadata separator to ' & ' when filling 'Contains names' custom columns. - Fix for adapter_asianfanficscom change for views metadata - Fix for site change adapter_novelonlinefullcom - More fixes for adapter_asianfanficscom site now giving different HTML to FFF. - Fix for some(older?) adapter_asianfanficscom stories not have json links. - Fixes for site changes adapter_asianfanficscom - Fix for extended chars in text email imap fetchs on py3. - Show debug output BeautifulSoup version. - adapter_mediaminerorg: Fix for not finding a block in chapter download. - Fix for newer BS4/soupsieve enforcing CSS selector rules about :/ chars. - Fix for site date change adapter_wuxiaworldcom Version 3.8.0 - 27 May 2019 - Fix for adapter_asianfanficscom site change. - Update Translations - Add 'publisher' metadata as a copy of 'site' and use to fill Publisher in Calibre. - Fix title casing for base_xenforo feature capitalize_forumtags. - Fix for adapter_storiesonlinenet not detecting login failure. - Some fixes for Russian language adapter_masseffect2in. - Fixes for adapter_quotevcom due to site changes. - Removing filter()/map() calls--not consistent between Py2/Py3. - Some Py3 compat / optimization fixes, thanks eschwartz - Fixes for adapter_storiesonlinenet site changes--login and use datetime by default because one was missing date-only. - adapter_finestoriescom shares code with adapter_storiesonlinenet, also do datetimes. - Comment out some debugs in XF/XF2 - Yet another fix for tagsfromtitle on base_xenforo. Don't put whole title as a tag when no [( in title. - Fix for base_xenforo's tagsfromtitle needing to be split. - base_xenforoforum: include forumtags in genre and tagsfromtitle in category instead of including both in subject_tags. - Don't hardcode extratags into subject tags--it's in include_subject_tags in defaults.ini. - Refactor base_xenforoforum for upcoming XenForo2 update for SV. - Fix for series contain 'collection from' adapter_storiesonlinenet. - Fix for anthology titles (and generate cover settings) not needing encode() anymore. - Fix for BS halping with string conversions on PI update from Saved Meta Column. - More improvements for adapter_asianfanficscom, including auto_sub feature, thanks oh45454545 - Improvements for adapter_asianfanficscom, thanks oh45454545 - Update adapter_asianfanficscom to fetch chapter texts from JSON url. - Ad wall indicator has changed for adapter_webnovelcom. - Fix use_archived_author in AO3. Version 3.7.0 - 19 Apr 2019 - Revert "Remove defunct site www.destinysgateway.com" - Recognize destinysgateway.com and www.destinysgateway.com - Remove ncisfic.com -- moved to AO3. - Fix date format for adapter_gluttonyfictioncom - Comment out some old debugs. - Add debug output for encoding used. - Fix some comments. - Add another StoryDoesNotExist string for adapter_fanfictionnet - Closes #390 - RoyalRoad click link in emails. - Update a comment link in setup.py. - Include status 'Hiatus' for adapter_royalroadcom. - Correct a comment in defaults.ini. - Fix for saved custom column metadata and boolean values. - Add bookmarked site specific metadata for adapter_archiveofourownorg. - Fix for PI saved metadata not reading False & empty strings. - More fixing for bool metadata values--convert to string when set. - Add remove_authorfootnotes_on_update feature for AO3. - Update Translations. Version 3.6.0 - 12 Mar 2019 - Make CLI -j/--json-meta option work on download/update as well as -m/--meta-only. - Fix & improve universe_as_series for adapter_storiesonlinenet - Update translations - Update adapter_fictionhuntcom for stories with no chapters. - Update adapter_fictionhuntcom for significant site changes. - Collect ships and description in adapter_harrypotterfanfictioncom. - Some AO3 stories don't have fandom tags. Version 3.5.0 - 11 Feb 2019 - Update Translations. - Remove firefly.populli.org -- now on AO3. - Remove fhsarchive.com -- now on AO3. - Add www.mugglenetfanfiction.com as replacement for removed fanfiction.mugglenet.com. - Fix for int(pages) in adapter_adultfanfictionorg. Closes #375 - Fix author parsing at webnovelcom - pull request #372 from Rikkitp - Remember original href in data-orighref attr with epub internalize_text_links so inserted 'earlier' chapters don't break internal links. - Add always_login setting to base_xenforo for SV login-required story with 404 result. - Ignore current Virtual Library when checking for existing story ID. Version 3.4.0 - 07 Jan 2019 - Fix defaults.ini add_to_titlepage_entries for hentai-foundry.com - Fix metadata parsing for adapter_siyecouk - Fix adapter_whoficcom for site changes. - Update translations. - Fix AO3 logout url used to detect when already logged in. - Add conditionals_use_lists(default:true) setting for replace_metadata & Include/Exclude metadata conditionals. Might change existing behavior for some users. - Remove outdated comment. - Allow ==, !=, =~ and !~ in replace_metadata conditionals like in/exclude_metadata. - Additional metadata edit recursion proofing. - Allow animated gifs through Calibre Image proc -- need to remove gif.py later. - Update some comments in adapter_archiveofourownorg - Additional fix for AO3 login site changes. - Fix for AO3 login site changes. - Add bookmarkprivate and bookmarkrec site-specific metadata to adapter_archiveofourownorg Version 3.3.0 - 18 Dec 2018 - Accept archiveofourown.com for archiveofourown.org. archiveofourown.org remains the 'canonical' domain. - Update translations - Workaround for adapter_hentaifoundrycom bad dateUpdated value. - New Site: www.hentai-foundry.com - Stories only. - Improve recursion-proofing of replace_metadata for performance and duplicate lines. - Don't cache file: URLs. Option --save-cache can mask changes to _filelist files while debugging. - Don't sleep when fetching file: URLs. - Remove defunct site www.artemis-fowl.com - Remove defunct site asr3.slashzone.org - Remove defunct site tolkienfanfiction.com - Remove defunct site fanfiction.tenhawkpresents.com - Remove defunct site unknowableroom.org - Remove defunct site mujaji.net - Update adapter_harrypotterfanfictioncom for site change. - Change for adapter_storiesonlinenet for 'Full Access' stories. - base_xenforoforum_adapter - Fix for buggy threadmarks on SV thread 46020. Version 3.2.0 - 17 Nov 2018 - Add background_color ini verbiage and check before image conversion. - Add feature for manually editing plugin settings JSON. Only shown in debug mode. - Plugin Reject list changes: show numbers, edit title/author, save rejects as data. - Refactor busy_cursor, busy cursor around saving rejects & settings, bump copyright years. - Add verbiage to [www.asianfanfics.com] about site censoring words when not logged in. - Detect 'fake' 404 page (with HTTP 200) for adapter_royalroadcom - Fix for adapter_wuxiaworldco for Python3. - Added volumes to chapter titles adapter_wuxiaworldco - thanks Rikkitp - Fix adapter_wuxiaworldco description decomposition, remove outdated testing `raise` from `configurable.py` - Thanks, Rikkitp - Fix for adapter_wuxiaworldcom site change. - Minor improvement to adapter_asianfanficscom logging. - Update for adapter_storiesonlinenet(& finestories) for login change. - adapter_fanfiktionde login doesn't use ssl.fanfiktion.de anymore. Version 3.1.1 - 19 Oct 2018 - Fix for problem with new collision code and rejected URL. Version 3.1.0 - 17 Oct 2018 - Fix for Calibre Metadata update called with URLs not in library. - Fix adapter_wuxiaworldco date format for 24 hour clock. Closes #345 - Change adapter_lightnovelgatecom to adapter_novelonlinefullcom for site change. Closes #346 - Add max_zalgo feature. - Handle stories without cover correctly adapter_wwwlushstoriescom. Closes #344 - Add cover images for adapter_wwwlushstoriescom - Rename adapter_royalroadcom appropriately. - Fix for royalroad.com warnings. - Put SV(base_xenforo) prefix spans from title into 'genre', comment out some debugs. - Fix for issues with single-chapter stories not getting correct chapter title after chapter meta refactor Jul 2018. - Add fix calibre title/author cases options, move force title/author sort values to Standard Columns config Tab. - Add 'date' chapter metadata to AO3. Closes #336 - Move mobi TOC back to after title page. Requested by jxxtan. Version 3.0.0 - 10 Sep 2018 - adapter_chosentwofanficcom: use pagecache and extracategories:Buffy the Vampire Slayer - Fix FimF login. - Fix adapter_harrypotterfanfictioncom date and characters/genre splitting. - Fix adapter_fanficauthorsnet metadata parsing and genre splitting. - Add --no-meta-chapters/-z CLI option. - Restore cursor in finally: clauses in case of issues.(plugin) - Update Translations - Fix for base_xenforoforum (SB/SV specifically) change to 'hide' sections of threadmark lists behind '...'. Issue #332 - Fix empty Genre parsing for adapter_ficwadcom - Fix genre parsing for adapter_fanficauthorsnet. - Tweak mobi output--move TOC to end. - Remove some CLI debug output (conflist). - Improve CLI --save-cache, save on each fetch/post, fix a py2/py3 cross bug. - Small fix for <> appearing in text format. - Remove defunct site www.area52hkh.net - Remove defunct site www.fiction.thebrokenworld.org - Remove defunct site dramione.org - Remove defunct site writing.whimsicalwanderings.net - Remove defunct site www.destinysgateway.com - Remove defunct site imrightbehindyou.com - Remove defunct site nocturnal-light.net - Remove defunct site national-library.net - Add latestonly option to mark_new_chapters feature to remove pre-existing (new) chpater marks on update and only mark chapters that are new in this update. Closes #330 - Attempting to get password protected stories in FimF working again. - Fix fanfiction.net metadata parsing -- genre was ending up in language after BS change. - Fix mobi output -- Fix an encoding issue, Kindle Goto-TOC works, TOC links are more accurate - Accept both [royalroad.com] and pre-existing [royalroadl.com] - Change [royalroadl.com] to [www.royalroad.com] - royalroadl.com has changed to www.royalroad.com.- Update included_dependencies - Many, many changes to make code run on both python 2.7 and python 3. Version 2.28.0 - 02 Aug 2018 - Fix html appearing in txt summary by default. - Remove in-story ad links from adapter_asexstoriescom. - adapter_royalroadl site uses relative dates now, including months and years ago. - Update plugin & web service html2text included package to fix text <>& output. - Fix for corner case screwing up chapter html(attr quotes). Closes #324 - adapter_webnovelcom: update title selection (#323), thanks Ea - Remove accidental file. - Change AO3 description blockquote to a div tag. - Fix section links in html output(broken in def6b39) - Remove Google Plus icon (web service only) - Fix base_xenforoforum_adapter bug when no threadmarks. - Get fanficauthors.net story URL from existing epubs downloaded from the site. - Fix for site change: adapter_wuxiaworldcom - Add note to use_threadmark_wordcounts setting--base_xenforo sites' wordcounts ignore words insite Spoiler tags. - adapter_wuxiaworldco: Some older stories use a different date format. - Fix origtitle/toctitle for mark_new_chapters. Broken in chapter metadata revamp. - Fix tocpage links and correct index04 vs index, issue #320. - Refactor chapter internals for additional site-specific metadata per chapter. - Fix base_xenforo_list for AH & QQ prefered domains. - base_xenforoforum: Adding date, words & kwords per chapter metadata (SB/SB/QQ). - Whitespace clean up in code (#316) - thanks mcepl - Add alternate domains for SB, SV & QQ xenforo adapters. - base_xenforoforum: Sum threadmark word counts into numWords(when present). INI option use_threadmark_wordcounts defaults to true. - Add ignore_chapter_url_list feature. - adapter_trekfanfictionnet: don't set numWords to *character* count. - Add adapter_harrypotterfanfictioncom for new version of returned harrypotterfanfiction.com. - Add adapter for http://wuxiaworld.co/ (#315) - Thanks cryzed Version 2.27.0 - 03 Jul 2018 - Change adapter_storiesonlinenet to https (and derived finestories) - thanks davidfor. - Yet more site change for adapter_webnovelcom - Add status states Paused & Cancelled to adapter_fanfiktionde as well as site specific native_status. - adapter_webnovelcom: ignore 'ad-walled' chapters--the ad-wall bypass code stopped working, but isn't yet removed. - Calibre Plugin: Remove ebook formats before update, overwrite or unnew so that the previouis version ends up in trash in stead of just copied over. - Add adapter_classes metadata for developer testing. - Revert archive.skyehawke.com back https -> http. - Remove replace_br_with_p sentinels in desc HTML before giving to Calibre. - Fix for author in adapter_lcfanficcom - Fix for adapter_inkbunnynet author search. - base_efiction: use getProtocol for images too. - Change all sites that will work with https to use it all the time. - Remove fanfiction.mugglenet.com -- mugglenet.com is there, but no fanfic section anymore. - adapter_adultfanfictionorg used urllib2 exceptions without importing it. - Updates for site changes for adapter_gravitytalescom. - Fix author for adapter_inkbunnynet. - Site update fixes for adapter_inkbunnynet, thanks GComyn. - Fixes for adapter_webnovelcom for site changes. - Add status to webnovelcom (#306) - Thanks, rikkitp Version 2.26.0 - 30 May 2018 - base_xenforoforum_adapter: exclude threadmarks URL as chapter URL. - adapter_webnovelcom - use_pagecache - mostly for debugging. - Fix some metadata collection in adapter_webnovelcom. - Change adapter_whoficcom to https. - Add rating and sitetags to adapter_webnovelcom. - Fix date for adapter_gluttonyfictioncom - Remove defunct sites thealphagate.com and harrypotterfanfiction.com - Adding website_encodings:ignore feature for adapter_wwwnovelallcom. - fix chapter names in www.novelall.com - thanks Rikkitp - remove unnecessary br around advert in www.novelall.com - thanks Rikkitp - Consolidate URL chapter range code and apply to CLI for #302 - fixes dateUpdated ang datePublished for lightnovelgate (#303) - thanks Rikkitp - https for starslibrarynet, abstract protocol a bit for eFiction Base. - Clarify some tooltip text and add 'FFF Frozen URL' feature. Version 2.25.0 - 29 Apr 2018 - Fix adapter_hpfanficarchivecom to not take author from banner by mistake. - New Site www.novelall.com - Thanks rikkitp! - Fix downloading illustrated stories from literotica. (#295) - Thanks davidfor - Add remove_spoilers & legend_spoilers options to royalroadl.com for Issue #287 - Fix author URL/Id fetch for adapter_wwwlushstoriescom. - Fix www.webnovel.com adapter with volumes (#293) - Thanks rikkitp - Added status metadata to wuxiaworld and royalroadl (#289) - Thanks rikkitp - Add reformating option fix_excess_space to lightnovelgate (#291) - Thanks rikkitp - Change ficwad.com to https. - Fixes for tables, add keep_empty_tags,td,th and add to keep_html_attrs colspan,rowspan. - Allow domain sufficientvelocity.com for forums.sufficientvelocity.com. - Fix for wuxiaworld adapter when image is null (#288) - Thanks rikkitp Version 2.24.0 - 27 Mar 2018 - Update translations. - Fix for SB/SV threadmarks.rss becoming incomplete list--move extract_threadmarks from QQ back to base. - Update adapter for wuxiaworld.com -- thanks cryzed! - Remove extra CSS line from default ini files. - Fix fix_pseudo_html in configurable.py for plugin edit check. - adapter_storiesonline(FineStories.com) fix for missing author link in header tag, from GComyn. - Add output_filename to --meta-only (#271), from theit8514 - Add fix_pseudo_html option for webnovel.com site only, from cryzed Version 2.23.0 - 28 Feb 2018 - Update translations. - Calculate number of chapters using start-end range when doing updates. - Make Get URLs from Page work better with TtH is_adult. - Fix rating, warnings, add ships to adapter_harrypotterfanfictioncom - Update adapter_efpfanficnet to use https and remove www. by default. - *Don't* include fandoms in category for fimfiction.net by default. - Handle new VIP chapter types in adapter_webnovelcom (#263) (Thanks cryzed) Version 2.22.0 - 23 Jan 2018 (I accidentally skipped v2.21.) - Tweak 'Chapter not found...' check for ffnet for changed/new text. - Set siteabbrev for adapter_wattpadcom - Handle QQ threads w/o threadmarks correctly. - Additional CLI python version checking. - fimfiction adapter: add new tag types, fix groups (#259), thanks FaceDeer! Version 2.20.0 - 14 Dec 2017 - Strip commas from numChapters in CLI for urlchaptercount. - Fix to adapter_storiesonlinenet author from GComyn. - Apply is_adult&user/pass dialogs to CALIBREONLY update. - Adding pre_process_cmd for CLI. - Don't 'fix' file:/// to //. - Skip #post- URLs in xenforo emails even when on first page. - Update translations. - Fix author parsing for webnovel.com (#254) from cryzed Version 2.19.0 - 13 Nov 2017 - Remove site obidala.net, content moved to AO3. - Fix adapter_tolkienfanfiction for site changes, remove strip_chapter_numeral site specific option--use strip_chapter_numbers option. - New site added: lightnovelgate.com -- thanks Rikkitp! - Add --non-interactive CLI flag (defaults to true when run without a TTY), thanks theit8514, sorry for not adding this earlier. - adapter_webnovelcom: normalize story URL. - adapter_harrypotterfanfictioncom: https default now. - Fix for webnovel.com escaping issue--thanks cryzed. - Fix problem with --download-list from plugin CLI, move StringIO for passed INIs down to point of use. Version 2.18.0 - 16 Oct 2017 - Remove AO3 login from get_urls_from_page--login is failing and it isn't required anymore for 'adult'. 'Restricted' (user-only) won't work. - Plugin: Save 'Show Download Options' check in gprefs like dialog geometries. - Fixes for QQ and AH changes. - base_xenforo: Fix for extended chars in threadmark chapter names. - base_xenforo: Couple small fixes for corner cases. -- Except one of them isn't, I think it would be pretty common; namely a notice being using as first chapter. - adapter_literotica: Build the chapter a little better especially if there is mutiple pages (#225) - Thanks, davidfor - base_xenforo: Use '/posts/' not 'post' to find thread vs post URLs. - Add sectionUrl metadata and mechanism for internally normalizing story URLs *and* [story URL] sections. For base_xenforo when including thread titles in storyUrl. Doesn't effect base_xenforo *post* URLs. - base_xenforo: Move skip_threadmarks_categories to save a fetch if skipping anyway. Will also effect minimum_threadmarks. - base_xenforo: Don't include thread title in *chapter* url, perfomance impact is smaller and keeps from marking a bunch of stuff (new). - Add delays for base_xenforoforum_adapter. - Use thread-title URL for storyUrl with base_xenforo to save redirect fetches. - Comment out some debug output. - Remove webnovel.com manual escaping of HTML entities, the website now seems to take care of it (#224)--thanks cryzed Version 2.17.1 - 14 Sep 2017 v2.17.1 is just for Plugin Translations; otherwise it's identical to 2.17.0 - Update Translations. - Remove AO3 login from get_urls_from_page--login is failing and it isn't required anymore for 'adult'. 'Restricted' (user-only) won't work. - Plugin: Save 'Show Download Options' check in gprefs like dialog geometries. - Fixes for QQ and AH changes. - base_xenforo: Fix for extended chars in threadmark chapter names. - base_xenforo: Couple small fixes for corner cases. -- Except one of them isn't, I think it would be pretty common; namely a notice being using as first chapter. - adapter_literotica: Build the chapter a little better especially if there is mutiple pages (#225) - Thanks, davidfor - base_xenforo: Use '/posts/' not 'post' to find thread vs post URLs. - Add sectionUrl metadata and mechanism for internally normalizing story URLs *and* [story URL] sections. For base_xenforo when including thread titles in storyUrl. Doesn't effect base_xenforo *post* URLs. - base_xenforo: Move skip_threadmarks_categories to save a fetch if skipping anyway. Will also effect minimum_threadmarks. - base_xenforo: Don't include thread title in *chapter* url, perfomance impact is smaller and keeps from marking a bunch of stuff (new). - Add delays for base_xenforoforum_adapter. - Use thread-title URL for storyUrl with base_xenforo to save redirect fetches. - Comment out some debug output. - Remove webnovel.com manual escaping of HTML entities, the website now seems to take care of it (#224)--thanks cryzed Version 2.16.0 - 18 Aug 2017 - Restore sycophanthex.com sites. - Fix for gravitytales.com--thanks cryzed! - AO3 - drop out of use_view_full_work when missing chapters. - Escape webnovel.com chapter texts for HTML, thanks cryzed - Add AO3 inspiredlinks after last chapter. - Fix AO3 always_login and bookmarktags/bookmarksummary site metadata. - Save AO3 'associations' link 'inspired by' links -- included with authorheadnotes. - Limit adapter_wuxiaworldcom removed links to prev/next chapter. - Don't cache metadata list while building from include_in_ -- Calibre version causes problems with removeallentities=True vs False cache. - Calibre image processing chokes on SVG images. Rejects svg images--use no_image_processing to include svg images. - Make default for fanfic.hu https, thanks botmtl. - Fixes for webnovel.com site changes (PR #206), thanks cryzed. - Fix xenforo threadmarks change for SB/SV. - Calibre removed sanitize_html function. - Explicitly (instead of implicitly) set is_adult:false in defaults.ini. - Comment out bookmarks for AO3 temporarily. - Fix for adapter_asianfanficscom caching vs login issue. Version 2.15.0 - 26 Jul 2017 - Restore adapter_dramioneorg after site came back. - Fix for AO3 login change. - Fixes for // problem in images. - Fix replace_br_with_p creating nested div tags, does NOT remove ones added previously. - Make utf8FromSoup() copy soup to avoid side effects. - Add markers and check to prevent replace_br_with_p running more than once on the same text. - Adding replace_failed_smilies_with_alt_text option for base_xenforo. - Consolidate and display some aggregate times for perf prof. - Fix published and update date for gravitytales.com adapter - import feedparser (#204) - adapter_fanficauthorsnet replace 'In progress' with 'In-Progress' to match standard. - adapter_finestoriescom and adapter_storiesonlinenet share code, but they need different Themes set now. - Fix to adapter_asexstoriescom for site change. Version 2.14.0 - 08 Jul 2017 - Update translations. - Fix typo in error catching - base_efiction - XenForo alternatehistory.com follows QQ more than SV/SB. - Remove 9 defunct sites - occlumency.sycophanthex.com, lumos.sycophanthex.com, erosnsappho.sycophanthex.com, chaos.sycophanthex.com, ashwinder.sycophanthex.com, pommedesang.com, dramione.org, www.indeath.net and fanfiction.lucifael.com. - Fixes for fanfiktion.de site changes. - fimfiction adapter: views/total_views fix for site change -- thanks FaceDeer! - Fix for XenForo(SB/SV) threadmarks with non-ascii chars. (web & CLI) - Fix plugin config check for _filelist. - Add `include_author_notes` option to collect Fimfiction author's notes, thanks FaceDeer. - Changes to base_xenforoforum_adapter to use threadmarks.rss for SV/SB, separate threadmark collection for QQ. - Also add show_chapter_authors option. - Fix for XenForo Threadmarks change on SB & SV--not on QQ. Version 2.13.0 - 22 Jun 2017 - Update translations. - Fix for finestories.com using Modern theme rather than Classic, thanks, davidfor! - Fix for adapter_fimfictionnet -- missed the "st" ordinal case when parsing dates, thanks FaceDeer! - Fix for webnovel.com site change, thanks Etana! - Fix for storiesonline.net site change, thanks davidfor! - Allow multiple range URLs (url[1-5]) for same story in one download. - Change adapter_fimfictionnet to use makeDate for non-USEnglish locales. - Add keep_prequel_in_description option for fimfiction.net. - Fix base_xenforoforum_adapter for QQ--it doesn't have threadmark categories or reader mode. - Fix fimfiction datePublished (Merge pull request #190 from FaceDeer/master) - http->https for adapter_midnightwhispers - Update adapter_webnovelcom for site changes. Thanks, Ser4nb2LUY6e - Tweak skip_threadmarks_categories comments in INI. - Special error msg for storiesonline.net about Listing Theme. - Change adapter_fanfiktionde to https. - Extend base_xenforoforum_adapter Reader Mode to other Threadmark Categories. - Correct an error log message. - Additional updates for fimfiction.net for changes, thanks FaceDeer! 2017-06-06 - Add skip_threadmarks_categories option to base_xenforoforum_adapter. - Update adapter_fimfictionnet for site changes. - Fix for get-story-urls from page, affected adapter_adultfanfictionorg. 2017-06-04 - Fix for RoyalRoadL adapter - thanks, cryzed! - Update translations. 2017-05-31 - Reduce debug output from replace_br_with_p. - Apply minimum_threadmarks in base_xenforoforum based on all threadmarks, not marks per category. - Change AO3 to https, normalize chapter URLs, remove view_adult from chapter URLs. - Update translations. 2017-05-28 - Add rating for starslibrarynet, fix [www.starslibrary.net] as section name. - Add apocrypha_to_omake option for base_xenforoforum_adapter threadmark category. 2017-05-26 - wattpad - Separate category from tags, include rags in genre by default, use larger cover image. - Thanks, botmtl! - wattpad - need to pass utf8FromSoup a soup... - Add comma_entries option to add commas to metadata entries--numbers only. - wattpad - add defaults slow_down_sleep_time:2 and comma reads. - Update translations. 2017-05-25 - adapter_storiesofardacom - td->div in description, catch parse excpetion after bad html in description. - Adapters' getSiteExampleURLs() value has to be able to pass their own getSiteURLPattern() for geturls.get_urls_from_page() to work correctly. 2017-05-24 - Add xenforoforum Categorized threadmarks after regular threadmarks. - Fix processing for <center> <u> etc, soup.recursiveChildGenerator() not working anymore. - Take image .ext from end of whole URL if not found at end of path. 2017-05-21 - Fix for asianfanficscom site change. - New site wattpad.com -- thanks, botmtl! Version 2.12.0 - 20 May 2017 - FIX for issue with Epub Update discarding existing images in Epub. Oops. :-( (Came from ffnet img referer fix.) Version 2.11.0 - 17 May 2017 - Change fanficauthors.net to https. - Catch other common complete/in-progress statuses for calibre yes/no columns. - adapter_wwwaneroticstorycom: 'Complete'->'Completed' - Reorder sections in defaults.ini files alphabetically, save script that does it. - Remove a debug output from adapter_fanficauthorsnet - One-off normalize Reject List URLs to save doing it all the time. Also, automatically save plugin version in prefs. - Update translations. (For: Let PI search inside zip(html) and txt formats for story URLs.) - Clear extratags: for tgstorytime.com and fictionmania.tv. - Fix error with std_cols_newonly if user has never saved config. - Adapt to masseffect2.in redesign - thanks PlushBeaver - Let PI search inside zip(html) and txt formats for story URLs. - Fix AO3 use_view_full_work feature for 1 chapter works. - New site alternatehistory.com as a base_xenforoforum_adapter. Plus base_xenforoforum_adapter fixes. - Add site specific extracategories to new sites. - Fix for PI suppressauthorsort/suppresstitlesort interacting wrong with Author/Title New Only. (PI only) - Fix CLI -f option help for text vs txt. - Add AO3 feature use_view_full_work -- true by default. - Update included dependency packages - Update html5lib from 0.9x7 to 0.9x9. - Update to BeautifulSoup 4.5.3. - Update six.py to 1.10.0. - Update chardet to 3.0.2. - Update html2text to (2016, 9, 19). - Add chardet_confidence_limit option for 'auto' encoding setting. - Add webencodings to included_dependencies. Needed by in web service with newer html5lib. - Don't include html5lib(and webencodings) and six in PI zip--uses calibre's versions anyway. - New sites from GComyn: - Add calibre_series_meta optional feature to include series metadata like calibre in epubs. For CLI & Web Service. - Updated date added to webnovel by cryzed - AO3 site-specific metadata bookmarktags bookmarksummary and option always_login added. - Fixes for adapter_gravitytalescom from GComyn. - New sites from GComyn: - inkbunny.net - lcfanfic.com - noveltrove.com - gravitytales.com - imrightbehindyou.com - mtt.just-once.net - obidala.net - sword.borderline-angel.com - tasteofpoison.inkubation.net - unknowableroom.org - www.13hours.org - www.aneroticstory.com - www.deandamage.com - www.fiction.thebrokenworld.org - www.narutofic.org - www.starskyhutcharchive.net - www.thedelphicexpanse.com - www.thundercatsfans.org - www.webnovel.com - Add Story Notes to base_efiction_adapter. - Don't send Referer:None -- hpfanficarchive.com doesn't like it. - Additional tags collected for wuxiaworld--thanks GComyn - Add download.archiveofourown.org for AO3 due to old downloaded AO3 epubs - Fix for author including Updated in desc in adapter_ashwindersycophanthexcom. - Fix "got more than 100 headers"-issue adapter_royalroadl.py only. - Fix ffnet referer for cover images. - Fix for a mistaken Norwegian Bokmål translation. - Fix ffnet referer for cover images. Version 2.10.0 - 14 Apr 2017 - Bump release version. - Update translations. - Remove defunct sites: restrictedsection.org, lucifael.com, onedirectionfanfiction.com, samdean.archive.nu, hpfandom.net, ficsite.com, sinful-desire.org, thehexfiles.net, portkey.org and psychfic.com. - Fix for adapter_asianfanficscom, thanks 444555. - Enhancements for Storiesonline and Literotica, thanks davidfor. - Add option chapter_categories_use_all for Literotica, thanks davidfor. - Can't skip numChapters - adapter_trekfanfictionnet - Refactor to move fetches to Configuration class for _filelist feature - Remove self.decode to defaults.ini, fix use_pagecache(). - Add *_filelist feature - Add titleHTML to mirror authorHTML - Change ncisfiction.net to ncisfiction.com - users & storyIDs *not* the same. - Add <meta charset="UTF-8"> to html output by default. - Add use_archived_author option for archiveofourown.org. - Add --progressbar option for CLI. - Change http to https for FimF - thanks baggins41 - Improve metadata caching for performance. - Remove unnecessary line that can cause problems with abbreviated ffnet URL. - Renamed midnightwhispers.ca domain midnightwhispers.net. - Fix for authors and New Only. - Fix for base_xenforoforum cached post used more than once. - Normalize anthology URLs both from page and from epub. - Allow https in adapter_hpfanficarchivecom Version 2.9.0 - 13 Feb 2017 - Make base_efiction_adapter honor keep_summary_html:true option. - Add author_avatar_cover option for base_xenforoforum. - Edge case fixes for errorcol and lastcheckedcol. - adapter_bloodshedversecom needs to be able to change storyId. - Tweak to adapter_whoficcom from GComyn. - New Site: asianfanfics.com - Thanks 444555! - Fixes for asianfanfics.com user/adult checks - Thanks 444555! - Fix for error column when not an error. - base_xenforoforum: Add more caching and page lookahead in reader mode. - Fix for adapter_adultfanfictionorg for site change. - adapter_asianfanficscom chapter URL update fix - Thanks 444555! - Fix for storiesonlinenet Daily Limit msg change, from GComyn. - Update translations Version 2.8.0 - 12 Jan 2017 - Changes to adapter_wwwarea52hkhnet from GComyn. - Minor fix to adapter_squidgeorgpeja from GComyn. - New site by GComyn: fanficauthors.net - New site by GComyn: www.lushstories.com - New site by GComyn: www.wuxiaworld.com - New site by GComyn: trekfanfiction.net - New site by GComyn: archive.shriftweb.org - New site by GComyn: firefly.populli.org - New site by GComyn: sebklaine.net - New site by GComyn: www.utopiastories.com - New site by GComyn: www.fireflyfans.net - Replace twcslibrary.net with starslibrary.net - No covers from smilies on royalroadl plus label debug output from royalroadl. - Fix resetting confirm dialog checks. - Add 'Delete on Reject by Default' option. - Fixes for extended/accented chars in URLs for adapter_wwwlushstoriescom. - Add iso-8859-1 to default decode list. - Fixes for utf8 in desc for adapter_wuxiaworldcom - Fix for adapter_spikeluvercom desc containing extra stuff. - NEW - Experimental support for more than one adapter under the same domain name: - New Site: sinful-dreams.com/wicked/temptation - New Site: sinful-dreams.com/whispered/muse - New Site: sinful-dreams.com/unicorn/fic - Fix for tthfanfic.org change from http to https - Add chapter URL normalization to adapter_tthfanficorg for http to https change to recognize pre-existing chapters. Also protects against title changes. - Strip 'Crossover' prefix from SV titles--base_xenforoforum_adapter. - Get non-label rating for base_efiction adapter_darksolaceorg. - Fixes for wuxiaworld.com chapter URLs. - Metadata fixes for adapter_wwwlushstoriescom from GComyn. - Adding chapter_title_error_mark for continue_on_chapter_error, force errors to always retry on update. - Generalize continue_on_chapter_error so all adapters can use it. - Update translations. Version 2.7.0 - 14 Dec 2016 - New site: writing.whimsicalwanderings.net - Thanks GComyn! - New site: www.giantessworld.net - Thanks GComyn! - New site: www.looselugs.com - Thanks GComyn! - New site: www.tomparisdorm.com - Thanks GComyn! - New site: www.valentchamber.com - Thanks GComyn! - New site: www.gluttonyfiction.com - Thanks GComyn! - New site: www.lotrgfic.com - Thanks GComyn! - New site: www.sugarquill.net - Thanks GComyn! - New site: www.area52hkh.net - Thanks GComyn! - Change from GComyn for eFiction base story with internal <b> tags. - Additional URL normalization in base_xenforoforum_adapter. - Fixes for adapter_bdsmlibrarycom and adapter_sugarquillnet from GComyn. - Adding 'reader' mode for base_xenforoforum_adapter - only SV has it so far. - Fix for storiesonline.net site changes - Thanks, davidfor! - Comment out some debug output. - Replace post_process_apply_filename_safepattern with post_process_safepattern so it can have its own pattern. (CLI only) - Remove adapter for fanfiction.csodaidok.hu. It's been broken for a while and it's a difficult site in Hungarian language, which none of current devs can read. - Add always_use_forumtags to valid options lists. (plugin ini editor only) - Comment out largish debug output in adapter_storiesonlinenet - Make QQ ask for user/pass if necessary instead of just fail. - Remove more script tags from squidge.org/peja metadata. - Update translations. (plugin only) Version 2.6.0 - 17 Nov 2016 - Fix for wraithbait.com - no longer displays review counts, remove code that collects them. - New site: royalroadl.com Thanks wassname! - Allow '_u#.xhtml' file names in updates. For Calibre Convert on Anthologies, then manually split. - Add Last Checked Column feature - Fixes for adapter_adultfanfictionorg.py from GComyn. - New site: chosentwofanfic.com -- Thanks GComyn! - New site: www.asexstories.com -- Thanks GComyn! - New site: www.bdsmlibrary.com -- Thanks GComyn! - New site: www.ficsite.com -- Thanks GComyn! - Tweaks and fixes across several sites from GComyn. - Site lotrfanfiction.com changed date format. - Improve quotev.com not found reporting a little. - Fix for potterfics.com layout change. - Remove duplicate adapter for fanfiction.lucifael.com--still supported. - Update translations. - Fix to handle incorrect HTML better in Get URLs from Page. - Add strip_text_links INI param to allowed list for asexstories.com. - Change comments sanitization for calibre to be less draconic. - Fix author fetch for post URL base_xenforoforum. - Don't use 'uparrow' quote links as chapter links in base_xenforoforum. - Adding remove_spoilers and legend_spoilers features and css example for spoilers for base_xenforoforum. - Remove noscript tags from base_xenforoforum content--otherwise double images appear in Kindle and Nook. - Copy make_soup to epubutils.py for noscript handling, otherwise noscript contents get & escaped. - Use DOTALL regular expression processing on replace_metadata and in/exclude_metadata. Should only effect description where it will allow full replacement. - Update translations. Version 2.5.0 - 18 Oct 2016 - Fixes for unusual (changed?) chapter URLs on storiesonline.net. - Adding words_added metadata for epub logpage on epub updates only. - Fix for CLI not working correctly with -u epubfile - Tiny fix to html output--close TOCTOP <a> tag. - Adding normalize_chapterurl() for xenforoforum and normalize_text_links option. - Add internalize_text_links option for epub and html formats(xenforoforum only right now). Also fix for growing whitespace in epub updates and missing always_reload_first_chapter in highlight list. - Update translations. - Bump versions. Version 2.4.0 - 30 Sep 2016 - Adding Update Existing Only option to Email URL Fetch. (plugin only) - Add support for Pillow (vs PIL) image lib in CLI. - Adding CLI options for --imap and download from imap and list. - Add 'Reject w/o Confirm' option for Series Anthology Check. (plugin only) - Improvements to CLI/defaults.ini suggested by MrTyton. - Fix for poor HTML in some nfacommunity.com descs - Thanks GComyn for finding that. - Fix for calibre series w/injectseries always being applied when doing BG metadata. (plugin only) - Fix for webservice over-long error msgs causing problems, specific errmsg for unknown site. - Need to provide 'more info' on failure with individual URL in CLI. - New site: fictionhunt.com - Update translations. - New version updating tool. - Bump versions--start bumping minor per version instead of micro. Version 2.3.6 - 24 Aug 2016 - Fix for change to AO3 author links. - Force overall cover for Anthologies if any sub-books have covers to avoid Calibre Polish issues. - Fix ffnet category fall back. - Add extra decode code for calling get_urls_from_imap() from outside calibre. - Fail more gracefully when anthology cover doesn't exist. Polish can remove them. - Adding logpage_at_end INI option. - Fix for Publisher and Language metadata for Anthologies. - Fix date parsing for masseffect2.in. Thanks PlushBeaver! - Tweaks to adultfanfictionorg - Add options for controlling Anthology book comments on the Standard Columns config tab. (plugin only) - Add always_reload_first_chapter setting for base_xenforoforum stories with index chapter. - Progress Bar - add extra timer loop for Win10 display. - New site: adult-fanfiction.org - Thanks GComyn! - New site: www.deepinmysoul.net/fiction - Thanks GComyn! - New site: fanfiction.lucifael.com - Thanks GComyn! - New site: harem.lucifael.com - Thanks GComyn! - New site: mujaji.net/repository - Thanks GComyn! - Make base_efiction code accept https story urls. - Tweaks for tthfanfic.org, including a slow down. - For literotica.com, throw a StoryDoesNotExist exception for 'This submission is awaiting moderator's approval' - Tweaks for quotev.com, including a slow down. - Update translations. Version 2.3.5 - 22 Jul 2016 - Change ffnet metadata collection to allow for chars with (' - ') in them. - Fix for SIYE when author puts story URL in bio. - Allow old goto/post chapter URLs in base_xenforoforum. - Remove Django from app.yaml--old version going away. (Webservice only) - Add n_anthaver and r_anthaver modes to custom_columns_settings for averaging metadata for anthologies before setting in integer and float calibre custom columns. (Plugin only) - Include 'prefix' tags in forumtags in base_xenforoforum. - Save addheaders when setting cookiejar. For ffn referer. - Update translations. (Plugin only) Version 2.3.4 - 23 Jun 2016 - Fix for previously failedtoload img tags causing lookup sleeps. - Fix for older harrypotterfanfictioncom stories lacking reviewjs.js. - Change adapter_fictionmaniatv to set status Completed instead of Complete (no d). - Update StoriesOnlineNet/FineStoriesCom login URL. - Different detect StoryDoesNotExist string for ficwad.com. - Allow old showpost.php chapter URLs in base_xenforoforum. - Update (& Fix) Translations. Version 2.3.3 - 23 May 2016 - Fix for adapter_ashwindersycophanthexcom login. - Add merged tags to anthology epubs. (plugin only) - Fix for ProceedQuestion got an unexpected keyword argument 'log_viewer_unique_name' (plugin only) - Remove defaults.ini sections for removed sites. - Make 'Go back to fix errors?' dialog scroll error list for smaller dialog size. (plugin only) - Update Translations. (plugin only) Version 2.3.2 - 17 May 2016 - Remove some more print output (hopefully the last) in the hopes it will help with Mac. - Fix for %p (am/pm) date parsing on non-en_US locales. - AKA Fix for edeniz's date issues with SB. - Fix for Yet Another Site Change on quotevcom. - Fix for Mac OS X crashes - changes to progress bar dialogs implementation. - Update translations. - Fix for Mac OS X freezes - set log level to CRITICAL unless calibre in debug or in BG job. - Update included html2text for web/plugin, require as dependency for CLI. (Fix for obscure problem with URLs in story with text output.) - Change adapter_ncisfictionnet to eFiction Base due to site change. - Fixes for ficbook.net changes. - Remove dead site: bdsm-geschichten.net - Remove dead site: scarhead.net - Remove dead site: www.therabidreader.com - Remove dead site: grangerenchanted.com - Remove dead site: www.nickngreg.nl - Remove dead site: tokra.fandomnet.com - Remove dead site: buffynfaith.net Version 2.3.1 - 19 Apr 2016 - Add additional strings for translations. - Add 'Save All Errors' checkbox for plugin save-errors column. - Update translations - Add exception for bad HTML breaking img finding. - Fix for Overwrite if Newer not working with BG Metadata. - Comment out some debug output. - Updates to adapter_literotica from davidfor - Clean up a stray print. - Catch more img tag exceptions. - Fix series/universe processing in adapter_storiesonlinenet. - Fix for literotica.com using str() instead of unicode(). Version 2.3.0 - 20 Mar 2016 - Fix for adapter_thehexfilesnet missing chapter text. - Fixes for finestories.com, now shares code with storiesonline.net, thanks davidfor for this. - Allow ini keyword universe_as_series in finestories.com as well as storiesonline.net. - Fix for fimfiction.net site update -- thanks Facedeer - New site: www.artemis-fowl.com - Thanks gcomyn! - New site: www.naiceanilme.net - Thanks gcomyn! - New site: fanfiction.lucifael.com - Thanks gcomyn! - New site: buffygiles.velocitygrass. - Thanks gcomyn! - New site: www.andromeda-web.com - Thanks gcomyn! - New site: www.therabidreader.com - Thanks gcomyn! - Performance improvements (extra caching) for complex metadata manipulation. - Changes to all plugin logging output (debug) to add datetime and reduce inadvertent smilies. ("FFF ![]() - Additional ini options for base_xenforoforum adapters. - Add storyUrl ini section feature. Add custom configuration for individual stories by adding personal.ini sections specifically for them. - Fixes for quotev.com, author and chapter list. - Add 'averrating' and tweak description: adapter_literotica - Fix adapter_literotica setDescription - Make HTTP 410 StoryDoesNotExist in tthfanfic.org, make conn fail trace debug, not error level. - Allow a second kind of 'chapter missing' for portkey.org. - Change fanfiction.mugglenet.com to base_efiction after site update. - Hide user/pass in debug log, add 'View Safe personal.ini' option that also hides user/pass. - Re-organize personal.ini config tab in plugin. - Yet more fixes for quotev.com changes. - Find and include chapter specific images for quotev.com. - Fix for a bug on a TtH story (empty category tag). - Add site specific reads, reviews for hpfandom.net. - Fix for base_efiction_adapter stories with spans w/o class attr. - Add support for 'This story has not been validated' in base_efiction_adapter - Some mcstoriescom stories include <h3> tags that aren't title/chapter/byline. - Update translations. Version 2.2.18 - 18 Feb 2016 - Fix for quotev.com change to story image. - Fix for tthfanfic.org author story list change. (Manifests as 'Adult required'.) - Add byline site specific metadata for AO3. - Apply *_format ini option to date/time types. For calibre_* columns passed in. - Change deprecated has_key() to has_attr() on BS objects. - Adding Word Count post-processing option, like Smarten Punct. - Fix for html5lib handling noscript oddly, noticed with fictionalley.org. - Fix fictionally.org description so calibre doesn't <code> it. - Add code for lazyload images in base_xenforoforum. - Correct outdated ini comment re *_filename. - Fix for replace_br_with_p(htmlheuristics) when author includes <>, thanks Feynor! - Fix for portkey.org--Don't use cache on first hit in case added adult cookie. - Add (partial) translations for Estonian and Norwegian Bokmål - Add automatic adding of unrecognized metadata in base_efiction. For tgstorytime.com. - Fix 'In Progress' to 'In-Progress' in fanfiktion.de & ficbook.net like all the others. - Fix for Calibre generated covers. - Adding Incomplete status state to adapter_storiesonlinenet - Add new AccessDenied exception for one line output in CLI. - Allow Pairing w/o Centered category -> chars in TtH. - Update translations. Version 2.2.17 - 18 Jan 2016 - Fixes for problems with urlparse.parse_qs in adapters and new unique_list with authorId. Also BS4 fixes to adapter_spikeluvercom.py - Adding additional metadata collection, potionsandsnitches & walkingtheplankorg - Allow Anonymous author for quotev.com. - Skip (instead of error) if asked to UnNew non-FFF epubs. - Update translations. - Update base_xenforoforum for SV threadmark change. - Fix so ships_CHARS and sort_ships_splits work together. - Remove defunct sg1-heliopolis.com site after down for +1 month. - Update quotev.com adapter. - Fix for TtH Story-42 matching Story-421 while searching auth pages. Version 2.2.16 - 19 Dec 2015 - Update for changes to storiesonline.net site. - Set is_adult cookie for FimF on 'Get URLs from Page' if set in personal.ini. - Fix for hpfandom.net change so one-shot stories will work correctly. - Improvements to basic chapter_title_strip_pattern, add warning comments for same. - Add dblquotes around folder name on IMAP lookup. (plugin only) - Update to BeautifulSoup 4.4.1 everywhere, remove included BS3. Effected parts: ---- MOBI generation ---- replace_br_with_p feature ---- base_efiction adapters ---- Most site adapters. - Update embedded html5lib from 0.99999 to 0.9999999. (plugin/webservice only) - Strip <script> tags from HTML. Added for FimF, but applies to all sites. - Remove 'like' from XenForoForum chapter links in index post. - Make metadata lists unique even when keep_in_order_. - Change entities to actual utf8 chars in adapter_fanfictionjunkiesde.py. - Add keep_html_attrs feature - deprecates keep_style_attr and keep_title_attr. - Add replace_tags_with_spans feature. - Fix for yet another storiesonline.net site change. Thanks davidfor for figuring it out for me. - New site mcstories.com. Thanks user39189!. Fair warning: mcstories.com is titled "The Erotic Mind-Control Story Archive". - Fix for literotica.com. Thanks again to davidfor for figuring out the problem. - New centeredcat_to_characters pairingcat_to_characters_ships and romancecat_to_characters_ships features for tthfanfic.org. These default to 'true', set them to false in your personal.ini if you want the old behavior. See: https://www.mobileread.com/forums/sh...&postcount=829 - Remove HTML comments when using replace_br_with_p. Version 2.2.15 - 23 Nov 2015 - Add series00-04HTml to defaults.ini for AO3. - Comment out debug that can cause additional errors depending on content. - Add html5lib to more BS4 calls, convert another place to BS4. - Fix for whofic.com with replace_br_with_p. - Fix for UnNew epubs with & or double quote in chap title. - Add sort_ships_splits and ships_CHARS. - Reduce over long error msgs when editing personal.ini(plugin). - Update translations(plugin). - Change str() to unicode() many places. - Make sort_ships honor doreplacements (and .NOREPL) flag. - Updates for mediaminer.org. Version 2.2.14 - 18 Oct 2015 Fix for some stories on quotev.com failing -- thanks, cryzed. More fixes for some stories on quotev.com failing -- thanks, cryzed. Move site ninelives.dark-solace.org to new domain ninelivesarchive.com while still accepting old URLs. Remove thequidditchpitch.org, domain is parked. Change site www.nickandgreg.net to www.nickngreg.nl while still accepting old URLs. Add check for non-existance/removed story to potterfics.com. Fixes for hpfandom.net changes. Strip leading/trailing single or double quotes from chapter URLs XenForo Base. Author typo fix. Remove site thequidditchpitch.org - domain is parked. base_xenforoforum: Workaround for when author uses reply URL instead of post URL, continue_on_chapter_error feature, remove 'Story' in front of 'Thread' in title. Change site www.nickandgreg.net to www.nickngreg.nl in defaults.ini. base_xenforoforum: Add user/password login for QuestionableQuesting NSFW subforum. Note that this will mark posts 'read' in the forum for your user. Add Background Metadata feature during Updates. When updating/overwriting existing books, there's now an option to Collect Metadata from sites in a Background process. This returns control to you quicker while updating, but you won't be asked for username/passwords or if you are an adult--stories that need those will just fail. Only available for Update/Overwrite of existing books in case URL given isn't canonical or matches to existing book by Title/Author. Fix for Overwrite mode. Fixes for base_xenforoforum #post- URLs -- might effect other site URLs with # anchors. Account for base href in XenForo so emoticon images work. - Use [epub] nook_img_fix:false to show emoticon images in line. Correct cover_exclusion_regexp for base_xenforoforum. Fix for unNew with & in chapter title. Fixes/New Features for test1. Update wiki link in defaults.ini. Tweak to epub logpage that helps with finding desc. Improve replace_metadata comments in defaults.ini Change default HTML output to HTML5 header. Update html tag header at beginning of each epub file. Prompted by failure of old header on latest tolino ereader. Accept only forum.questionablequesting.com, not questionablequesting.com. Fix for issue with Email fetch using last used Add options instead of default Add options. Fix replace_hr feature. Version 2.2.13 - 17 Sep 2015 - New site: quotev.com - Thanks, cryzed! - Couple minor fixes - Convert dark-solace.org to eFiction Base adapter - In XenForum Base adapter, convert #post-12345 anchor chapter URLs to permalink URLs before fetching chapter. For problems with some stories linking to posts by the wrong page. - On UnNew of an anthology, also update individiual toc.ncx files used for EpubMerge UnMerge. - Fix fall back for FimF cover image when there's a 'medium' but not a 'large' available. - Fix for author URLs in eFiction Base code. Was using sid instead of uid. - Fixes for changes to mediaminer.org site. - Changes to hpfandom.net adapter to allow storyUrl to change when given a chapter URL. - Changes to plugin to allow for storyUrl changing--there are other existing adapters that can do it, too. - Fix for mediaminer.org site story URL changes. - Allow forum.questionablequesting.com now as well as questionablequesting.com. Version 2.2.12 - 17 Aug 2015 - New site forum.questionablequesting.com (base_xenforoforum adapter) https://forum.questionablequesting.c...ve-writing.19/ - Add minor fix for portkey.org chapter parsing. - Don't require trailing slash on base_xenforoforum. - Change dramione.org default encoding to utf8. - Add additional check for check_next_chapter on ffnet when site it down. Version 2.2.11 - 31 Jul 2015 - Fixes for spikeluver.com - Add new site ninelives.dark-solace.org (Base eFiction adapter) - Add new Russian language site masseffect2.in -- Thanks to PlushBeaver for adding this. - New sites forums.spacebattles.com and forums.sufficientvelocity.com, both base_xenforoforum adapters sharing almost all their code. (Forums are not really designed to host story, but people use them that way anyway. I recently started reading a fandom (the Worm web serial by Wildbow) and the largest collection of stories I found for it was on a couple of near identical forum sites.) SpaceBattles Creative Writing https://forums.spacebattles.com/foru...ve-writing.18/ SufficientVelocity User Fiction https://forums.sufficientvelocity.co...ser-fiction.2/ The details are complex enough that I've started a new wiki page for future reference. Please refer to it for more details: https://github.com/JimmXinu/FanFicFa...oForumAdapters - New [base_efiction] and [base_xenforoforum] sections for common settings for eFiction Base and XenForoForum Base adapters respectively. - Add chapter range to title if used. Can be disabled in ini with title_chapter_range_pattern. - New description_limit feature to explicitly limit the allowable length of the description. (description_limit) - New feature to mark "New" chapters when updating existing epub stories. When mark_new_chapters:true is placed in personal.ini, the system will now mark the new chapters. The string "(new)" is prepended to the chapter title (but after added chapter numbers, if enabled). If an epub already contain "New" chapter marks is updated again adding more new chapters, the "New" marks will show on both until explicit removed (or file is overwritten). Users who have customized chapter_start for epub will need to add some additional tags to use the new features. - Save additional chapter metadata in header of epub chapter xhtml files. Used to determine which chapters to download on update and 'Remove "New" Chapter marks'. - Remove "New" Chapter Marks from Selected books feature added to Plugin Menu Once you start marking new chapters to read, you also need a way to unmark them. Configurably auto 'Remove "New"' on 'Mark "Read"' (see checkbox on config 'Reading Lists' tab). Automatically apply 'Delete other formats' and 'Auto Run convert' features when you use Remove "New" Chapter Marks--both explicitly and by marking 'read'. - New CLI --unnew option - same as above, but for CLI. - Add 'Download from Email Immediately' optional feature to plugin Email settings tab. Version 2.2.10 - 14 Jul 2015 Updates for mediaminer.org changes. Add feature - make it optional to set the Calibre Author URL (on Standard Columns tab) Automatically strip leading/trailing whitespace when saving IMAP settings. Write IMAP server setting to debug log. Add new config option: "When checking If Story Already Exists FanFicFare will first match by URL Identifier. But if not found, it can also search existing books by Title and Author(s)." Now you can disable that behavior. Update translations. Version 2.2.9 - 25 Jun 2015 Update adapter_nhamagicalworldsus, make a Base eFiction adapter. Default bulk_load true for all (eFiction Base) adapters. Exclude doReplacements on add_genre_when_multi_category call to getList('category'). Prevents a possible infinite recursion. Make passing Calibre Columns in optional and only pass savemetacol data when column is configured to reduce data passed to/from BG processes. Update translations. Version 2.2.8 - 08 Jun 2015 Preserve order of URLs fetched from page--especially important for anthologies. Version 2.2.7 - 08 Jun 2015 Fix add_genre_when_multi_category when genre is empty. Fix dump_html_metadata for non-string values. Change 'Fetch from Email' to get longest URL instead of normalized story URL. -- Change by cryzed. Update translations. Version 2.2.6 - 29 May 2015 Update html5lib to 0.99999. Add exception catch for possible corner case on Linux. Fix add_genre_when_multi_category for AO3 changes to genre/category. Fix for storiesonline universe parsing (from davidfor). Change AO3 genre & category to fill with freeformtags, ao3categories & fandoms from defaults.ini instead of by hardcode. Add support for specific story covers on storiesonline.net -- Thanks, davidfor. Add feature to optionally save all FanFicFare metadata to a custom column. Add feature to update Calibre metadata from saved custom column, when configured. Add feature to include pre-existing calibre column data in FanFicFare metadata on story updates. Set Busy/Wait mouse cursor and emit status message while doing Fetch from Email or Fetch from Web Page. Normalize story URLs with Fetch from Email to include only one per story (mostly AO3 emails). Add optional feature to auto-reject URLs from Fetch from Email when on Reject URLs List. Don't flag ini error on do_update_hook in [archiveofourown.org]. Version 2.2.5 - 07 May 2015 Fix ficwad.com changing author URLs. Fix for ponyfictionarchive.net stories with neither In-Progress or Complete flag. Fix for grangerenchanted.com bad HTML summary causing crash. Update translations. Version 2.2.4 - 29 Apr 2015 More fixes for storiesonline.net site changes. Exclude FimF emoticons as covers by default. Fall back to smaller cover image in FimF when there's a problem with the larger linked-to cover. Detect and reject animated gifs in Calibre. They don't work well with the included Calibre image lib. FimF's new fall back will be activated. Fix for an error in Spanish translation that caused an exception. Make 'include_images' on by default, remove config checkbox. Enhance/Clarify Calibre Cover update and Cover Generation. Add feature to use Calibre's built-in Generate cover. Improve Reject listing. Version 2.2.3 - 18 Apr 2015 Fix storiesonline.net site changes. Add site it-could-happen.net. Updated PI translations (de & es) Version 2.2.2 - 15 Apr 2015 Change the name to FanFicFare. Change the FanFicFare icon to green so it's visibly distinct from FFDL. Fixes for literotica changes. Fix error in debug output that uses wrong variable. Change date format for onedirectionfanfiction.com. Explicit html parse for BS4 when reading in existing epub. For cal1.48. Fix for PI - eFiction Base adapter Anthology Series string. Update translations. Change some menu & gui details to be clearer. Fix for ffnet's latest change to story/cover image. Fix problems found during trawl through all sites -- thehookupzone.net and libraryofmoria.com now use eFiction Base. Remove defunct sites - netraptor.org www.simplyundeniable.com www.wizardtales.net www.checkmated.com stargate-atlantis.org www.henneth-annun.net www.twiwrite.net www.dotmoon.net Add option to check ffnet auth img vs cover img and not use author images as book covers. Defaults to on, add skip_author_cover:false to [fanfiction.net] section if you like author image covers. Add site tgstorytime.com as an eFiction Base Adapter. Fix for anthology from URLs immediately after making non-EPUB single book. Version 2.1.05 - 26 Mar 2015 Add devianthearts.com as a Base eFiction site. Allow https URLs for fictionmania.tv. Allow storiesofarda.com/chapterAllview.asp?SID=999 urls. Bug fix: Change print to logger calls because of caliber pipe errors. Better error handling of generate_cover_settings params. Version 2.1.04 - 27 Feb 2015 Add 'Get Story URLs to Download from Email' feature. Add use_ssl_unverified_context option for SSL issues with fictionpad.com. Change potionsandsnitches.net to potionsandsnitches.org. Add multi-author support for ksarchive. Add keep_title_attr option. Some sites(AO3) use a tags with title for in-text foreign language translations. Add language metadata for AO3. Version 2.1.03 - 28 Jan 2015 Add slow_down_sleep_time:2 to AO3 defaults. Fix setDescription for adapter_tolkienfanfiction. Some improvements to replace_br_with_p heuristics, thanks Asbjorn. Fix for Sequels for FimF. Updates to Plugin translations from Transifex. Version 2.1.02 - 12 Jan 2015 Color coding, find text and some error checking of personal.ini edits. Add universe & crossoverfandom site-specific to ksarchive. Fixes for FimF, thanks FaceDeer. Version 2.1.01 - 27 Dec 2014 Fixed fictionmania.tv adapter and updated to use new HTML parser -- thanks, cryzed. Fixes for FicWad changes and problems with FicWad login. Collect either Codes or (Site) Tags for storiesonline.net. Add 'score' site specific metadata for storiesonline.net -- thanks davidfor. Accept alternate story URL forms for fictionmania.tv -- thanks, cryzed. Deal with squidge/peja injecting Google Analytics script block. Change www.hpfanficarchive.com -> hpfanficarchive.com. Fix for nested HTML comments with old HTML parser. Remove a debug print in TtH--causes problems with web version. Optional Progress Bar time estimate feature -- thanks, FaceDeer. Fix for first-time plugin install so it offers initial add-to-menu dialog. Known issue: Specific metadata 'eroticatags' for literotica.com doesn't work on all stories. Known issue: Metadata collection is not as complete for 'Base eFiction' adapters. Version 2.1.00 - 10 Dec 2014 The big change this version is the inclusion of new HTML parsing libraries BS4, html5lib and a couple supporting packages. Not all sites are parsed using the new parser, but several are including fanfiction.net and AO3. New Site: fanfiction-junkies.de--thanks scout78 Fixes for FimFiction.net changes--thanks FaceDeer. Update for csiforensics.com adapter--make site specific instead of Base eFiction--thanks scout78. Add new site fanfiction-junkies.de--thanks scout78. Rename castlefans.org to fanfic.castletv.net Known issue: Specific metadata 'eroticatags' for literotica.com doesn't work on all stories. Known issue: Metadata collection is not as complete for 'Base eFiction' adapters. Version 2.0.10 - 18 Nov 2014 New Site: fhsarchive.com -- eFiction Base adapter. Fixes for storiesonline.net site changes--'codes' are now 'sitetags', thanks Jeff. Fix for literotica.com HTML. Fix for AO3 fetch after login. Fix for User-Agent with saved cookie jar. Fix for ffnet adapter for 'get urls from page'. Fix for images in FimFiction.net stories. Fix handling of new books and custom_column_settings. Fix for fimf not working with manual is_adult (caching issue). Fix for calibre 2.10 keyboard shortcuts change. Known issue: Specific metadata 'eroticatags' for literotica.com doesn't work on all stories. Known issue: Metadata collection is not as complete for 'Base eFiction' adapters. Version 2.0.9 - 03 Nov 2014 Fix for changed login behavior for the fanfiktion.de adapter (Thanks, cryzed). Changes for potterfics.com(Spanish) to login for adult rated stories. Updates for Fimfiction.net changes, fixes for image inclusion and password protected stories (Thanks Facedeer and cryzed). Change thewriterscoffeeshop.com to twcslibrary.net. (you'll need to change your personal.ini from [www.thewriterscoffeeshop.com] to [www.twcslibrary.net] if you saved your TWCS login.) Fix for ficwad.com adult rated stories to properly log in. Improved error reporting for regular expressions in personal.ini. Version 2.0.8 - 20 Oct 2014 Additional fix for site updates to: ficwad.com Version 2.0.7 - 20 Oct 2014 Fixes for site updates to: fimfiction.net (thanks, facedeer) Fixes for site updates to: ficwad.com Fixes for site updates to: archiveofourown.org Known issue: Metadata collection is not as complete for 'Base eFiction' adapters. Known problem: Password protected FimFiction.net stories aren't working. FimF changed API access. Known problem: specific metadata 'eroticatags' for literotica.com doesn't work on all stories. Version 2.0.6 - 06 Oct 2014 New Site: lotrfanfiction.com New Site: csi-forensics.com, thanks scout78. New Site: samandjack.net, thanks scout78. Fixes for sheppardweir.com, thanks scout78. Fixes for Base eFiction. Known issue: Metadata collection is not as complete for 'Base eFiction' adapters. Known problem: Password protected FimFiction.net stories aren't working. FimF changed API access. Known problem: specific metadata 'eroticatags' for literotica.com doesn't work on all stories. Version 2.0.5 - 23 Sep 2014 - Fix for AO3 get story list URLs that already have a '?' in them. - Fix for squidge.org/peja using a story URL for 'Site Map'. (Messed up series and series numbers.) - Fixes for storiesonline.net site update, from davidfor. - Add 'extratags' to AllMetadata so it's available for custom columns. - Only support from calibre v1.48.0 and up for plugin. - Known problem: Password protected FimFiction.net stories aren't working. FimF changed API access. - Known problem: specific metadata 'eroticatags' for literotica.com doesn't work on all stories. Version 2.0.4 - 09 Sep 2014 - New site bdsm-geschichten.net, thanks John Doe. - New site: sheppardweir.com, thanks scout78. - New eFiction base adapter courtesy of John Doe. This should make it easier for new developers to add eFiction type sites. But it doesn't support all type of metadata. - New site using eFiction base adapter: fannation.shades-of-moonlight.com, thanks John Doe. - New site using eFiction base adapter: themaplebookshelf.com, thanks John Doe. - Fix numChapters in adapter_literotica.py. - Fixes for nhamagicalworldsus changes. - Fix for changes to fanfiktion.de. - Add/update translations in Spanish, French, Portuguese (Brazil), German. - Fix so autoconvert won't delete FFDL's own output. - Add cookie and page caching between stories and between front and background processing for selected sites: fanfiction.net, tthfanfic.org, archiveofourown.org, fanfiktion.de, fimfiction.net, portkey.org and buffynfaith.net. Version 2.0.3 - 13 Aug 2014 Fix for AO3 authorUrls and authorIds. Version 2.0.2 - 13 Aug 2014 Fix for AO3 authors all coming out Anonymous. Version 2.0.1 - 04 Aug 2014 - New German language site bdsm-geschichten.net, thanks to doe5716. - New site tolkienfanfiction.com, thanks to doe5716. - Add other languages for literotica.com, thanks to doe5716. - Fixes for bloodshedverse & spikelover having html tags in title, etc. - Fix for non-split list replace_metadata. - Fix for anthology books, don't put author in default anthology comments if only one author. - Fix to plugin identifiers:"~ur(i|l)..." search string for finding existing books. - Known problem: Password protected FimFiction.net stories aren't working. FimF changed API access. - Known problem: specific metadata 'eroticatags' for literotica.com doesn't work on all stories. Version 2.0.0 - 23 Jul 2014 Now supporting Qt5 and Calibre 2.0 (currently in beta). Translations updates to French and German and new translation Spanish, courtesy of the volunteers at Transifex. Apply cover_exclusion_regexp to specific cover images, too Add site specific reviews to wraithbait.com Allow ffnet story specific covers by default Add "Reject Without Confirmation" feature (plugin only) Add Spanish translation (plugin only) Change default encoding for bloodshedverse.com to Windows-1252 Allow chapterless Fimf stories Fix for login needed for efpfanfic.net 'red' rated stories Known problem: Password protected FimFiction.net stories aren't working. FimF changed API access. Known problem: specific metadata 'eroticatags' for literotica.com doesn't work on all stories. Version 1.8.26 - 25 Jun 2014 Fixes for some metadata problems on various sites. Known problem: specific metadata 'eroticatags' for literotica.com doesn't work on all stories. Version 1.8.25 - 21 Jun 2014 New site: fictionmania.tv -- Thanks, cryzed! Fix for site recognizer to handle with/without www. using https URLs. Fix for some utf8 descriptions on fimf. Site specific metadata 'eroticatags' for literotica.com. Fix for 'a' flag on custom_columns_settings not working as intended. Changes to '\,' to better implement split list feature to avoid infinite recursions. Fix for calibre-injected series--don't treat series as a list, it isn't. Auto-add http: to URLs starting with //. Switch to transifex.com for translations. Version 1.8.24 - 14 Jun 2014 Now supporting over 100 different sites! Thanks, cryzed, for pushing us over the top. New site: nocturnal-light.net -- Thanks, cryzed! New site: fanfic.hu (Hungarian language) -- Thanks, cryzed! New site: fanfiction.csodaidok.hu (Hungarian language) -- Thanks, cryzed! Updates for sites: bloodshedverse.com, voracity2.e-fic.com -- Thanks, cryzed! Fix for making anthology books when source books don't have number of words. New '\,' feature to 'split' metadata items in replace_metadata. Example: replace_metadata: category=>Captain America \(Movies\)=>Captain America\,Marvel The category list will then contain both "Captain America" and "Marvel". Version 1.8.23 - 07 Jun 2014 New site: spikeluver.com -- Thanks, cryzed! New site: bloodshedverse.com -- Thanks, cryzed! Updates for site: voracity2.e-fic.com -- Thanks, cryzed! Version 1.8.22 - 04 Jun 2014 New site: voracity2.e-fic.com -- Thanks, cryzed! Version 1.8.21 - 23 May 2014 Fix for dark-solace.org Rating. Fix for literotica.com URLs. Version 1.8.20 - 13 May 2014 Fix for AO3 story not found. Fix for storiesonline.net changing urls. Fix for fictionpad.com removing 'dislikes' in some(all?) cases. Fix for dark-solace.org metadata parsing. Version 1.8.19 - 05 May 2014 Allow https URLs for fimfiction.net. Both allow https URLs and change canonical URLs for squidge.org/peja to https. Fix for some stories' summaries on onedirectionfanfiction.com. Add include/exclude metadata feature. And wiki page for it. Slightly improved connection refused handling. Version 1.8.18 - 19 Apr 2014 Added workaround for an issue with fimfiction.net and blockquotes. Can be turned off by adding fix_fimf_blockquotes:false to the [www.fimfiction.net] section in personal.ini if it causes problems. Version 1.8.17 - 09 Apr 2014 Fix for a problem with literotica.com multi-page chapters on Kobo readers. Version 1.8.16 - 29 Mar 2014 Add Pairing for hpfanficarchive.com Remove some outdated checks against calibre versions that aren't supported now. Version 1.8.15 - 16 Mar 2014 Fix for fictionpress.com https urls. Add options to turn off author notes on AO3 chapters. Version 1.8.14 - 09 Mar 2014 Fix for potionsandsnitches.net, extra text after date. Change Job Log output so URLs are more copy/pasteable. Configurable connection timeout as per FaceDeer's recommendation. Fix for seriesUrl check. Fix for AO3 https urls. On auto-convert, delete target format else convert doesn't run. Version 1.8.13 - 28 Feb 2014 Fix for https vs http on ffnet (Story does not exist) problem. Fix for KeyError:'site' problem. Version 1.8.12 - 24 Feb 2014 Fixes for FimFiction change, thanks FaceDeer. Set Boolean custom columns from custom_columns_settings, looking for true/t/yes/y/1 vs false/f/no/n/0. Add a feature to reduce sleep between ffnet requests in initial metadata collection for small download sets. Make ffnet look-for-next chapter feature optional and default to off. Version 1.8.11 - 15 Feb 2014 Fix for fanfiction.net cover download. This is turned off by default in CLI and plugin due to how many stories in ffnet show the author's picture. In section [www.fanfiction.net] add never_make_cover: false to turn covers on. Add feature to automatically inject cover from Generate Cover into epub using calibre's Polish feature. Don't do auto-convert when Updating Calibre Metadata Only. Version 1.8.10 - 5 Feb 2014 Fix French translation typo that prevents download. Add auto-convert on download/update feature. Fix divide by zero error in replace_br_with_p on chapters with no content. Change to storiesonline.net by davidfor to address overzealous culling in text. Version 1.8.9 - 22 Jan 2014 Leading zeros in version number makes it octal. Remove and bump to 1.8.9. ![]() Version 1.8.08 - 21 Jan 2014 Allow literal strings in custom_columns_settings to set columns. Version 1.8.07 - 13 Jan 2014 Change default encoding for finestories.com. Change default encoding and improve metadata for storiesonline.net, thanks davidfor. Fixes for hpfanficarchive.com changes. Fix for 'update' with no updates and 'mark' enabled. Now with French translation, thanks Ptitprince. Version 1.8.06 - 23 Dec 2013 Fix for latest ffnet change. Additional sleep added to ffnet metadata downloads. New site: literotica.com. Thanks to de3sw2aq1. Tweak to htmlheuristics for literotica.com (unicode vs str). Version 1.8.05 - 12 Dec 2013 Fix issue with AO3 single chapter stories introduced in 1.8.04 Version 1.8.04 - 12 Dec 2013 (v1.8.03 was a testing only version) Raise minimum calibre version due to changes in identifier:url searching Alternate URL efiction.trekiverse.org for trekiverse.org/efiction Add do_update_hook to AO3 for updated chapters in the middle Reorder defaults.ini files to put user/pass is_adult first in all sections Graceful fail for 'k'HTML when no 'k'Url Version 1.8.02 - 05 Dec 2013 New Site: trekiverse.org/efiction Fix for higher rated stories with not logged in on tthfanfic.org Add prequels/sequels & fix groups site specific metadata for fimfiction.net Now including German translation, thanks ILB! Fix for identifier searchs and Overwrite if Newer with ffnet timestamps. Version 1.8.01 - 18 Nov 2013 Fix for stories with more than 999 chapters. Fixes/Enhancements for replace_br_with_p heuristic processing feature. Thanks, Asbjørn Grandt. Fix for dc:language when none given and defaulting to English. Fix for 'Default' Generate Cover setting with Internationalization/Localization. Version 1.8.00 - 18 Nov 2013 Internationalization/Localization code added. If people volunteer to do translations, they'll be able to use FFDL in their own languages. More fanfiction.net fixes. Don't included Updated/Published as characters, don't include excess Misc/Movies/etc categories on crossovers, start using https instead of http. Improved error messaging for ficwad & squidge.org/peja Version 1.7.54 - 13 Nov 2013 Fix for fanfiction.net more changes. Version 1.7.53 - 11 Nov 2013 Fix for fanfiction.net changes. Fixes/Enhancements for replace_br_with_p heuristic processing feature. Thanks, Asbjørn Grandt. Version 1.7.52 - 09 Nov 2013 Fixes for storiesonline.net, thanks davidfor. Fixes/Enhancements for replace_br_with_p heuristic processing feature. Thanks, Asbjørn Grandt. Version 1.7.51 - 30 Oct 2013 New site: storiesonline.net Add replace_br_with_p heuristic processing feature. Thanks, Asbjørn Grandt. Handling for fictionpad.com empty chapters. "This chapter has no text." Handling for fanfiction.net's 'Pairings'. Version 1.7.50 - 23 Oct 2013 Fix for ffnet changes. Version 1.7.49 - 19 Oct 2013 Fixes for dark-solace.org Tweaks to Config dialog for small screens Version 1.7.48 - 13 Oct 2013 Fix for an HTML change on fanfiction.net Version 1.7.47 - 13 Oct 2013 New site: fictionpad.com Debug/information output reduced and changed to logging New Basic option "Mark added/updated books when finished?" Version 1.7.46 - 29 Sept 2013 Fixes for indeath.net - Thanks Besnef! Better Non-BtVS/AtS detection for tthfanfic.org do_update_hook for fimf, find newest chapter and update from there when true. Version 1.7.45 - 21 Sept 2013 Fix for whofic.com. Don't include empty string dc:subject tags in epub. Set custom column only if there's a value (mostly for int/float columns). Version 1.7.44 - 14 Sept 2013 Remove dateutil dependency Fix for certain portkey.org stories. Fix for PI for int/float custom columns setting empty. Version 1.7.43 - 11 Sept 2013 Fix dates for fimfiction.net Additional groups as site specific data for fimfiction.net. Add default_value_status (etc) feature. Version 1.7.42 - 09 Sept 2013 Longer sleep for ffnet, config User-agent Version 1.7.41 - 08 Sept 2013 Fix for AO3 stories without any series. Version 1.7.40 - 07 Sept 2013 Better doc section override order in ini files. Fix for calibre pre-1.0.0. Additional series as site specific data for AO3. Fixes for changes to harrypotterfanfictioncom. Add User-agent="FFDL/1.7" for all adapters for fanfiction.net changes. (Remove from specific adapters.) Version 1.7.39 - 31 Aug 2013 Remove work around for last_modified vs author link update issue in calibre 1.0.0--fixed in 1.1.0. New Feature: add_genre_when_multi_category setting Work around calibre's auto-split when author contains 'and' 'with' ',' or '&'. Version 1.7.38 - 24 Aug 2013 Work around for last_modified vs author link update issue in calibre 1.0.0. Better error reporting of metadata update problems. Version 1.7.37 - 24 Aug 2013 Work around minor bug (1216398) in calibre 1.0.0. Tags 'A' and 'a' (for example) conflict and prevent metadata update. Version 1.7.36 - 20 Aug 2013 Make check for Story URL change configurable. Add configurable options to keep Title/Author the same in Title/Author Sort. Version 1.7.35 - 06 Aug 2013 Remove some debugging output. Minor optimizations for adapter lookup. Get story url lists from sites with adapter, get urls from non-fic sites in CLI. Warning on update if existing epub has no recognizable chapters. Version 1.7.34 - 28 Jul 2013 Fixes for fanfiktion.de, storiesofarda.com, hpfanficarchive.com, and dark-solace.org/elysian sites. Version 1.7.33 - 24 Jul 2013 Fix for smarten_punctuation setting in pre-0.9.39 calibre. Version 1.7.32 - 23 Jul 2013 Fixes for fanfiktion.de & thehexfiles.net, add entries to teststory valid list. Version 1.7.31 - 18 Jul 2013 Drag and drop onto the FFDL plugin button Smarten Punctuation sort_ships option join_string_<entry> option keep_in_order_<entry> option replace_metadata <entry>_LIST options Version 1.7.30 - 09 Jul 2013 New Site: scarhead.net - Thanks Ida! Improved error handling when ffnet is having problems. Phoenixsong can have individual chapters req login. Add force_login parameter. GUI improvements to Basic config and Add/Update dialogs. Version 1.7.29 - 28 Jun 2013 New Site: fanfic.potterheadsanonymous.com - Thanks Ida! New Site: www.simplyundeniable.com - Thanks Ida! Allow domain fanfic.mugglenet.com for mugglenet.com Version 1.7.28 - 22 Jun 2013 Minor fixes to plugin Fix for siye.co.uk stories with HTML in the title Version 1.7.27 - 10 Jun 2013 Fixes for nha.magical-worlds.us and scarvesandcoffee.net. Fall back category parsing for fanfiction.net when story has a broken crossover category link. Restrict url list search on scarvesandcoffee.net. Add 'Download as New Book?' dialog after 'Change Story URL?', fix author URLs when new author. Version 1.7.26 - 30 May 2013 New site: nickandgreg.net - Thanks, Ida! Add Read & Review counts to dramione.org and grangerenchanted.com Fix for numeric site specific values into float/int custom columns for anthologies. Version 1.7.25 - 26 May 2013 Add keep_style_attr option. Add [teststory] feature. Version 1.7.24 - 28 Apr 2013 Catch errors on db.set_cover(). Don't strip lead/trail whitespace from replace_metadata, add feature \s->' ' in replace_metadata replacements. After adding to reject list, delete only rejects, not those removed from list. Offer user chance to skip update when the story URL would be changed. Version 1.7.23 - 12 Apr 2013 New site: netraptor.org New site: asr3.slashzone.org New site: tokra.fandomnet.com Remove defunct site: www.jlaunlimited.com Fix author URLs for several sites with leading 'dir' in URL. Fix for no chapter name for one chapter stories on TtH. Improved error handling for mobi issues. Add 'url' to chapter custom formats and class="skip_on_ffdl_update" for updates. Add anthology_title_pattern feature. Version 1.7.22 - 08 Apr 2013 Fix for AO3 series URL. Include notes with chapter text for thewriterscoffeeshop.com. Remove support for defunct site: prisonbreakfic.net Remove support for defunct site: svufiction.com Version 1.7.21 - 05 Apr 2013 Fixes for change to site dark-solace.org/elysian. Allow ini site section names both with and without www. IE, [www.fanfiction.net] and [fanfiction.net] will both work now. If both are included, the section without www overrides the section with it. Fix for finding URLs during drag & drop of text emails. Fix for persistent AddDialog size. Version 1.7.20 - 01 Apr 2013 Another fix for fanfiction.net changes. Version 1.7.19 - 28 Mar 2013 Another fix for fanfiction.net changes. Version 1.7.18 - 28 Mar 2013 Fix for failure to correctly load old JSON settings. Allow partial download with <url>[1-5] in addition to <url>[1,5]. Add author to chapter TOC for multi-author stories on TtH and WraithBait. (AO3 doesn't reliably report chapter author.) Version 1.7.17 - 26 Mar 2013 Another fix for fanfiction.net changes. Fix for collision setting when re-opening the add dialog. Shorten button name to FanFictionDL. Version 1.7.16 - 25 Mar 2013 Fix for fanfiction.net changes. Version 1.7.15 - 25 Mar 2013 Make Add from URLs and Create Anthology for URLs modeless. That means you can open the Add/Create dialogs to put URLs in while still using the calibre library to look for duplicates, etc. Add seriesUrl metadata. All sites that FFDL collects series info for now also collect a series URL. The default series on title_page is now a link. Used for... Check for existing Series Anthology books (by seriesUrl) on story add/update. Similar to Reject List check, but offers to skip if you already have an anthology book for that story's series. (It doesn't offer to update the anthology for you.) Add user/pass for dokuga.com. Improvements to Reject List feature--allow sorting of reject list by url, title, author (when present). Improve readability of the reject dialogs. Version 1.7.14 - 18 Mar 2013 Fix for filling int/float custom columns with favs/etc with commas. Fix for HTML entities in complex replace_metadata setups. Fixes for fimfiction.net site changes. Version 1.7.13 - 15 Mar 2013 Remove BBCode--fimfiction.net adapter doesn't use it anymore. Add "add_to_" feature to ini config. Allow higher priority sections to *add* to any ini param rather than replace it. Add calibre CLI. Add "marked:ffdl_success/failed" to added/updated/failed books. Add "Show added/updated" pref using above. Preserve log page in epub across overwrites as well as updates. Drag and drop emails from Thunderbird on FFDL URL box to add URLs. Version 1.7.12 - 04 Mar 2013 Use existing anthology title on update, even when a series. Add anthology=true metadata for anthology covers, etc. Page scrape story descriptions again for fimfiction.net due to API issues. Fix login failure for tth. Version 1.7.11 - 27 Feb 2013 www.ficwad.com -> ficwad.com. Ficwad changed their canonical domain. You'll need to change [www.ficwad.com] to [ficwad.com] in your personal.ini. Version 1.7.10 - 19 Feb 2013 Include author notes in chapters on fimfiction.net. Add Epub Anthology feature. - Requires EpubMerge 1.3.1+ Plugin. Version 1.7.9 - 06 Feb 2013 New site: www.henneth-annun.net -- Thanks Ida! New site: www.psychfic.com -- Thanks Ida! Now accepting www.skyehawke.com/archive URLs for archive.skyehawke.com stories. Version 1.7.8 - 04 Feb 2013 Fix author URLs for multiple author stories. Version 1.7.7 - 04 Feb 2013 Improve error handling, add retry for restrictedsection.org. Strip leading 0s from story ids for canonical ids in AO3. Include hyphenation test case in test1 adapter. Make get list url from page fill add dialog, not view log. (PI only) Better fix for Nook hyphenation issue--Nook now honors adobe-hyphenate: none. Remove extra newlines introduced by writer_epub on updates. Fix broken lastupdate tags feature. Defaulted off for PI. Optimize adding to Reading Lists on add/update. (PI only) Version 1.7.6 - 28 Jan 2013 Fix for a change in fimfiction.net's handling of password protected stories. Fix for thewriterscoffeeshop.com's changed date format. Version 1.7.5 - 15 Jan 2013 New site: buffynfaith.net (Thanks Dan!) Version 1.7.4 - 14 Jan 2013 New site: imagine.e-fic.com (Thanks Ida!) Improved error reporting in background jobs. Version 1.7.3 - 05 Jan 2013 New site: www.dotmoon.net (Thanks Ida!) New site: efiction.esteliel.de (Thanks Ida!) New site: pommedesang.com (Thanks Ida!) New Spanish language site supported: www.potterfics.com (Thanks Dan!) New site: www.restrictedsection.org (Yes, this site has been frozen since March 2009.) More workarounds for fimfiction.net's API issues. Version 1.7.2 - 02 Jan 2013 New Spanish language site www.potterfics.com (Thanks Dan!) Remove site www.yourfanfiction.com--it's been gone for awhile. Correct AO3 extra metadata freefromtags to freeformtags. freefromtags will continue to work for those already using it. Workaround for fimfiction.net's API issue with non-viewable chapters given. Add feature to set reason for several Reject URLs at once. PI only. Version 1.7.1 - 15 Dec 2012 Allow % escapes in ffnet story URLs and use larger ffnet story cover images. Force bgcolor in JPG output images when source images have transparency. Add 'collections' to AO3 specific metadata. Clear Reject List cache when switching libraries. Version 1.7.0 - 26 Nov 2012 Set Language to Italian for www.efpfanfic.net. Allow replace_metadata to effect Language metadata. Fix fimfiction.net cover images Default calibre language to English for new stories not otherwise marked New Rejected URL list feature Version 1.6.19 - 14 Nov 2012 Fixes for www.efpfanfic.net. Allow 'On Hiatus' status for fimfiction.net. Recognize calibre identifier uri as well as url. Version 1.6.18 - 07 Nov 2012 Update potionsandsnitches.net date format. Switch ponyfictionarchive.net from BeautifulStoneSoup to BeautifulSoup. Precompile metadata_replace regexps for performance. Change summary td to div in thehexfiles.net for table titlepages. Tidy some more poor HTML on fictionalley.org Honor begin/end chapters on update. For testing purposes. Version 1.6.17 - 31 Oct 2012 New site: www.efpfanfic.net (Italian language site) Version 1.6.16 - 28 Oct 2012 New site: indeath.net (thanks besnef) New site: www.jlaunlimited.com (thanks besnef) Fixes for changes to fanfiktion.de formatting. Fix for bad author on twiwritenet with some skins. Change from www.ncisfiction.com to www.ncisfiction.net due to the ncisfiction.com domain expiring. Version 1.6.15 - 23 Oct 2012 Fix for some stories on hpfandom.net Fix for some stories on fimfiction.net Add conditional replace_metadata feature Extra metadata for fimfiction Version 1.6.14 - 17 Oct 2012 Changes to logging to make more logging visible in PI and the same across web/CLI/PI. Don't number chapter when only one chapter even if add_chapter_numbers is on. Fix a bug where cover could still be partially set to an image in the cover_exclusion_regexp list. Add include_images support for HTML format. Preserve id and class attributes on the HTML tags. (This is for users who want more control from output_css. I don't *think* it will hurt anything for other users...) Change grangerenchanted.com to use more relaxed HTML parser due to problems with some stories. Change HTML format output to include title/author in file name that appears inside zip file. Version 1.6.13 - 08 Oct 2012 Fix for identifiers URL search. Version 1.6.12 - 03 Oct 2012 New site www.qaf-fic.com (thanks, Ida) Fix grangerenchanted.com, sg1heliopolis.com & themasque.net. Add add_chapter_numbers: toconly option. Better handling of 'Anonymous' stories on AO3. Allow empty descriptions(summary). Make just about all the output formatting customizable. See http://code.google.com/p/fanficdownl...erCustomOutput Version 1.6.11 - 26 Sep 2012 Fix bbcode'd summary issue with fimfiction.net. Fix get urls from web page bugs. Fix bug with custom_column_settings 'a' when no data. Add fanfictiondownloader_macmenuhack.txt 'feature' for Mac users with crash issue. Improved include_in_* handling. Change 'version' metadata to plugin version. Add replace_metadata by metadata key feature. Additional site-specific metadata for AO3. Fix 'www.' handling for input URLs. Fix bug with dokuga.com. Fix extratags bug. Version 1.6.10 - 21 Sep 2012 New sites bloodties-fan.com, thehookupzone.net (thanks Marillapm) Allow individual site adapters to add extra metadata entries to the standard ones. (key word: extra_valid_entries) Allow custom labels on title/log pages for extra metadata entries. (key words: themes_label, cliches_label, etc) Allow those extra metadata to be included in titlepage/logpage, or added to existing metadata entries. (key words: extra_titlepage_entries, extra_logpage_entries, include_in_genre, etc) Allow new, purely composite, metadata entries to be made from existing and extra metadata entries. (key words: include_in_*) Allow existing metadata entries to be redefined. If one site has what you think should be category and genre reversed, for example, you could swap them. (key words: include_in_category, include_in_genre, etc) Allow calibre custom columns to be populated from the new extra metadata entries. (key word: custom_columns_settings) New configuration options to add to titlepage_entries, logpage_entries or include_subject_tags for specific sites (instead of replace it). (key words: extra_titlepage_entries, extra_logpage_entries, extra_subject_tags) Allow the format for Published, Updated and Packaged dates on titlepage/logpage to be configured in personal.ini. (key words: dateCreated_format, datePublished_format, dateUpdated_format) Cover support for dramione.org. A fix for squidge.org/peja Rating. Loosen url check on AO3 to allow more copy/paste URLs. Fix author on castlefans.org due to site/skin changes. Version 1.6.9 - 14 Sep 2012 New site merlinfic.dtwins.co.uk (thanks, Ida) New option features strip_chapter_numbers and add_chapter_numbers to remove and add numbers to chapter titles. Fix BBEncoded summaries for fimfiction.net, improved handling for HTML in summaries in general. Default keep_summary_html:true to now. Added code to prevent crashing when include_images accidentally turned on for non-epub formats. Version 1.6.8 - 06 Sep 2012 Add 'Relationships' metadata for sites that support it, or are dedicated to a 'ship. Add 'extracategories', 'extragenres', etc to ini to avoid hard coding them in the adapters. Special code to *not* include Config & About menu options for Mac users. (Can still configure plugin from calibre's configuration.) Causes some Macs to crash. Fix for dracoandginny.com adapter for different skins. Fix for & in tags. Scroll custom column config tab for users with lots of custom columns. Version 1.6.7 - 27 Aug 2012 Allow shortcuts for config & about menu items to prevent crashes on some unpatched Macs. Allow https urls (replace to http). Fix for extra tags inside metadata on ksarchive.com Version 1.6.6 - 25 Aug 2012 New site: www.sinful-desire.org Add adobe-text-layout: optimizeSpeed; to epub CSS to prevent hyphenation on Nook STR(it loses parts of the hyphenated word sometimes.) Version 1.6.5 - 23 Aug 2012 New site: www.dracoandginny.com New site: www.scarvesandcoffee.net New site: www.thepetulantpoetess.com New site: www.wolverineandrogue.com Version 1.6.4 - 18 Aug 2012 Fix for Flesch-Kincaid Grade Level Count Page setting. Workaround for bad html in some story summaries on yourfanfiction.com. Version 1.6.3 - 06 Aug 2012 Optionally keep an Update Log of past updates (epub only). See personal.ini include_logpage option. Fix for nha.magical-worlds.us stories with more than 9 chapters. 'Get Story URLs from Web Page' now uses AO3 user/pass if saved in personal.ini. 'Collection' style AO3 story URLs now work. Version 1.6.2 - 01 Aug 2012 Fix for fanfiction.net to prevent genre(s) appearing as a character on certain stories. Version 1.6.1 - 01 Aug 2012 Remove extra html body from ancient ffnet chapters. Add 'newonly' feature for standard and custom columns in plugin. Version 1.6.0 - 27 Jul 2012 Options now stored inside the Library rather than an external JSON file. Version 1.5.46 - 22 Jul 2012 Correct integration of grangerenchanted.com, hlfiction.net & nha.magical-worlds.us Version 1.5.45 - 22 Jul 2012 New Site: grangerenchanted.com New Site: hlfiction.net New Site: nha.magical-worlds.us Minor fixes for finestories.com, finestories.com, thewriterscoffeeshop.com. Important Plugin Change: FFDL now uses a different, calibre system dialog before updating the library now. This dialog cannot be automatically skipped like the old one. The way it worked before risked corrupting your library if something else was trying to modify it at the same time. Version 1.5.44 - 15 Jul 2012 New Site: finestories.com New Site: www.hpfanficarchive.com New Site: svufiction.com New Site: www.twilightarchives.com New Site: www.wizardtales.net New Feature: Multiple authors per story. Currently supported for AO3, TtH and wraithbait.com. More will be added as we become aware that they use multiple author. New Plugin Feature: Option to call 'Count Pages' plugin on new/update. Requires Count Pages 1.6.0 or better. Fixes for latest fanfiction.net change. Version 1.5.43 - 08 Jul 2012 New Site: dark-solace.org New Site: pretendercentre.com New Site: themasque.net Fixes for a couple obscure problems with calling Generate Cover. Version 1.5.42 - 06 Jul 2012 Fix for latest fanfiction.net change to prevent id:12345 appearing as a character. Version 1.5.41 - 04 Jul 2012 Fix for thehexfiles.net on iBooks Fix for img urls with spaces Fix for 'Adding/Updating BAD books' status message Version 1.5.40 - 02 Jul 2012 New Site: ncisfic.com New Site: national-library.net Added Support for www.fanfiktion.de and archiveofourown.org username and password. Set Updated Date to Published Date when not found (fix for recent FFNet changes.) Fix for fallback metadata labels, allow other text in titlepage_entries New 'Error Column' feature - On update/overwrite fail, save error msg to a custom column. Note: As part of the archiveofourown.org fix, the configuration section for AO3 is now [archiveofourown.org], not [www.archiveofourown.org]. Please change your personal configuration accordingly, if you have customized your settings for archiveofourown.org. Note that www.fanfiktion.de doesn't just require you to say 'yes, I'm an adult'. To see adult content there outside certain hours, you have to have an official government German, Austrian or Swiss ID card or passport number. Version 1.5.39 - 28 Jun 2012 Another fix for fanfiction.net's latest changes--prevent 'Status: Complete' from appearing as a character. Version 1.5.38 - 28 Jun 2012 New Site: www.fanfiktion.de New Site: ponyfictionarchive.net New Site: sg1-heliopolis.com Fix for poor summary html on thewriterscoffeeshop.com Version 1.5.37 - 28 Jun 2012 Fixes for fanfiction.net's latest changes. Version 1.5.36 - 18 Jun 2012 (1.5.35 skipped) - Better error handling for bad image_max_size parameter. - Fix issue with fanfiction.net covers and non-epub formats. - Fix series# with javascript and different warning#s. geturls w/javascript. Version 1.5.34 - 16 Jun 2012 Another fix for changed metadata on ffnet. Version 1.5.33 - 16 Jun 2012 New sites: - samdean.archive.nu - www.yourfanfiction.com - www.destinysgateway.com - www.thealphagate.com - stargate-atlantis.org - www.ncisfiction.com That's 51 different supported sites now. Thanks, Ida! New features: - Add 'Get Story URLs from Web Page' feature to plugin and CLI(-l). - Plugin - Add some title output lists in the jobs detail window. - Add cover image to fanfiction.net, but default 'never_make_cover: true' for ffnet. Fixes: - Fixes for ffnet characters metadata. - Fix error in ashwinder from using a different skin. Version 1.5.32 - 11 Jun 2012 Fix for AO3 'anonymous' stories. Fix for ashwinder.sycophanthex.com. Allow www.squidge.org/~peja as well as www.squidge.org/peja. Version 1.5.31 - 09 Jun 2012 Fix for SIYE metadata for stories in a series. Fix for ashwinder.sycophanthex.com login. Fix for onedirectionfanfiction.com login. Version 1.5.30 - 08 Jun 2012 Add login/is_adult for onedirectionfanfiction.com Version 1.5.29 - 07 Jun 2012 New Site: onedirectionfanfiction.com by Ida New Site: www.prisonbreakfic.net by Ida New Site: www.storiesofarda.com by Ida Version 1.5.28 - 06 Jun 2012 Fix new/overwrite missing 'begin' KeyError. Plugin only. Version 1.5.27 - 05 Jun 2012 Fix for fanfiction.net's latest changes. Allow chapter range after URLs in Add New. Preserve META-INF/calibre_bookmarks.txt on epub update. Option to only create/overwrite cover on new, not update. Make thehexfiles.net accept www.thehexfiles.net too. New site: www.ik-eternal.net by Ida. Version 1.5.26 - 29 May 2012 New Site: www.dokuga.com by Ida. New Option: Under [txt] wrap_width to control word wrap width in text output. Version 1.5.25 - 27 May 2012 Fix for ffnet genres, characters, status. Version 1.5.24 - 25 May 2012 New Site: thehexfiles.net by Ida New Option: Inject calibre series if no series on site. Version 1.5.23 - 20 May 2012 New Site: ashwinder.sycophanthex.com by Ida New Site: chaos.sycophanthex.com by Ida New Site: erosnsappho.sycophanthex.com by Ida New Site: lumos.sycophanthex.com by Ida New Site: occlumency.sycophanthex.com by Ida New Site: dramione.org by Ida New Site: www.phoenixsong.net by Ida New Site: www.walkingtheplank.org by Ida Version 1.5.22 - 18 May 2012 New Site: www.checkmated.com by Ida Version 1.5.21 - 18 May 2012 New feature - Option to search epub text for story URL when not found in metadata. New feature - Option to only run GC on new books, not updates. Version 1.5.20 - 12 May 2012 (1.5.19 skipped) New Site: www.libraryofmoria.com by Ida New Site: www.wraithbait.com by Ida New Site: www.squidge.org/peja (WWOMB) by Jim (This does not support other sections of www.squidge.org, or the other files under www.squidge.org/peja that aren't in the Fiction instance.) Version 1.5.18 - 08 May 2012 (1.5.17 skipped) Allow calls to Generate Cover plugin on create/update. Version 1.5.16 - 25 Apr 2012 Fix for Yet Another numeric entity issue. Version 1.5.15 - 22 Apr 2012 Fix for 'Hide this banner' title issue on Archive of Our Own. Changed implementation of fimfiction to use provided API, thanks to Althaine. Version 1.5.14 - 17 Apr 2012 Change "Include images in EPUBs?" to effect [epubs], not [defaults]. Kludge for incomplete story image URLs on fimfiction.net Version 1.5.13 - 11 Apr 2012 New Site: archive.skyehawke.com -- Thanks to Ida Leter for implementing this. Fix for Python GC'ing menu objects if they don't have an explicit Python reference saved. Version 1.5.12 - 09 Apr 2012 Set calibre's author link field from authorUrl. Thanks to jackr for pointing out it's existence, and davidfor for showing where to find it. Version 1.5.11 - 24 Mar 2012 Another work around for when SGMLParser's poor entity handling meets poor HTML. Version 1.5.10 - 19 Mar 2012 New site: ksarchive.com, thanks to Jade Aislin for implementing this Fixes for mugglenet.com--added user/pass, better handling for summary and is_adult levels. Allow default_cover_image to use ${title}, etc; add cover_exclusion_regexp feature to exclude images from being covers. Version 1.5.9 - 16 Mar 2012 Remove site gayauthors.org following complaints from the site administration. New Site: nfacommunity.com New Site: www.midnightwhispers.ca. Thanks to Sam for implementing these. Make 'Update Calibre Only' add a new book if no matching book found. Minor improvement to column updates for new stories. Improve image support for a couple of obscure cases. portkeyorg.org only - Write 'Chapter does not exist' chapter when chapter is in list, but does not exist. Add is_adult check to twiwrite for when user on site is not set to adult. Change td in portkey chapter text to div for nook. Version 1.5.8 - 06 Mar 2012 New Site: fanfiction.mugglenet.com New Site: fanfiction.portkey.org New Site: thequidditchpitch.org New Site: www.hpfandom.net Also improved category handling of www.tthfanfic.org. Version 1.5.7 - 01 Mar 2012 Support for downloading images in the story text. Support for cover image from three different sources. Support to resize, make grayscale, and convert images to jpg. Option for plugin to update calibre cover image on metadata update. Major re-write of EPUB update to support images. Improved handling of ini section priority. New 'Stay on Top' option for 'Add New from URL(s)' dialog for easier drag-n-drop. Add replace_hr option to replace <hr> tags with '* * *' Support for fimfiction.net's locked story passwords, including an option to declare locked stories 'failed'. Add an 'Include images in EPUBs' checkbox to duplicate some personal.ini settings. nook_img_fix option - wrap img tags with div if not already wrapped with div or p for a nook problem. Defaults to true. Version 1.4.6 - 24 Feb 2012 New Site: gayauthors.org -- Thanks to Ida Leter for implementing this. Fix for URL copy/paste from Chrome. Improvements to metadata for AO3. Version 1.4.5 - 22 Feb 2012 Fix for ffnet minor format change. Version 1.4.4 - 21 Feb 2012 Minor fixes to ffnet and fictionalley.org. Version 1.4.3 - 15 Feb 2012 New Russian language site: ficbook.com -- Thanks to Ida Leter for implementing this. Language metadata now collected for ficbook.com and fanfiction.net. Fix Character metadata on fanfiction.net. Version 1.4.2 - 13 Feb 2012 Fix a bug with HTML entity processing. Version 1.4.1 - 12 Feb 2012 New feature - Allow user to set custom CSS in personal.ini for HTML and EPUB output. New feature - Allow user to set custom regular expressions in personal.ini to modify metadata. New feature - Use Accept-Encoding=gzip to speed download. (Not sites will use it--it's common for sites to block gzip based on User-Agent.) Add progress bars while collecting URLs from stories for list and for updates. Make ini edit Courier and 1pt larger than default font. Version 1.3.4 - 04 Feb 2012 Fixed a bug that caused stories with a footer to crash for AO3. (Thanks, Ida) Removed sleep from ficwad adapter. Fixed menu/hotkey update when switching libraries. Version 1.3.3 - 31 Jan 2012 Better date kludge for fimfiction.net--they don't give years for updated/published. Version 1.3.2 - 30 Jan 2012 New site: archiveofourown.org -- Thanks for Ida Leter for implementing this. Change fimfiction.net to use genre instead of category. Version 1.3.1 - 28 Jan 2012 New feature: Fill Custom Columns with Story Metadata. Look in Config to set it up. New feature: Collect and update Series column. Improved drag-and-drop of URLs onto the Add New URL text box. Dragging URLs in adds now instead of replaces, and copies the URL, not the pretty text. Added a 'show this again' checkbox to the dialog for reviewing updates before applying them. When unchecked, updates will be applied immediately if there were no problems. Added a progress bar while applying updates, which can be lengthy. Don't disable menu items(like update) when there are no books selected. It broke the keyboard shortcut if the menu hadn't rebuilt since books were selected. Make the FanFictionDownLoader button (which does add or update, depending on whether books are selected) available for keyboard shortcut. Fix date change for adastra. Fix URL pattern, metadata collection for SIYE. Version 1.2.3 - 22 Jan 2012 Fix for tz aware vs naive dates. 'Fix' for ffnet look ahead for 1 chapter stories. Version 1.2.2 - 19 Jan 2012 Fix to 'Keep tags'. Fix to extratags. 'Fix' for ffnet updates coming out before the web site updates everywhere. Version 1.2.1 - 17 Jan 2012 Fixes for date updating. Fix for English name months for users running non-English locale computers. Version 1.2.0 - 16 Jan 2012 New feature - Options to update Reading List plugin lists for device sync and keeping a list of new books to read. Plugin configuration now tied to library. Different libraries can have different settings. Shortcut button in plugin config to dialog for assigning hotkeys. List of Characters now parsed and saved for most supported sites. Version 1.1.3 - 10 Jan 2012 Fixed lastupdate feature in include_subject_tags. Separated Plugin defaults.ini from web/CLI defaults.ini to remove unusable options. Config option to keep existing tags when updating metadata. Complete/In-Progress will still be updated, and Last Updated tags will be updated if lastupdate in include_subject_tags. Version 1.1.2 - 09 Jan 2012 Restructure of background processing, improved update of existing books, added SIYE, other fixes. Version 1.0.3 - 30 Dec 2011 Initial Release on mobileread.com forums. Last edited by JimmXinu; 08-01-2024 at 09:38 AM. Reason: Update plugin version |
![]() |
![]() |
![]() |
#2 | |
Plugin Developer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 6,482
Karma: 4277235
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
|
Latest Test Version
Latest Test Version
Rather than posting test versions in line, the newest test version will be in this posting, so it's always in the same place. If there's no plugin zip here, there hasn't been a test version yet since the last release. 2024-08-14 - adapter_scribblehubcom: Allow for changing title in story URL. - Update adapter_syosetucom.py (#1095) Fix update retrieval for series not completed, thanks dado330 - Make CLI username prompt more visible Installation instructions from Introduction to plugins: Spoiler:
Quote:
Last edited by JimmXinu; 08-14-2024 at 02:17 PM. Reason: Update test version |
|
![]() |
![]() |
Advert | |
|
![]() |
#3 | ||
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() Posts: 56
Karma: 510
Join Date: Dec 2013
Device: PB TL2 /PB TL3 (M) STOLEN/ PB SURFpad 3 (7.85") / thl T11
|
![]()
Hello...
Quote:
![]() Quote:
![]() Im using Calibre 2.24 release version. |
||
![]() |
![]() |
![]() |
#4 | |
Plugin Developer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 6,482
Karma: 4277235
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
|
Quote:
![]() The forum thread has to be created before it can appear in the plugin list. I suppose I should have noted that in the text and then changed it later. Sorry about that. But it doesn't matter anymore, because it's in the list now. |
|
![]() |
![]() |
![]() |
#5 |
Ex-Helpdesk Junkie
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 19,421
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
Should this plugin deprecate FFDL?
|
![]() |
![]() |
Advert | |
|
![]() |
#6 | |
Connoisseur
![]() ![]() ![]() ![]() ![]() ![]() Posts: 56
Karma: 510
Join Date: Dec 2013
Device: PB TL2 /PB TL3 (M) STOLEN/ PB SURFpad 3 (7.85") / thl T11
|
Quote:
![]() |
|
![]() |
![]() |
![]() |
#7 |
Plugin Developer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 6,482
Karma: 4277235
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
|
If you're asking if you should install and use this now instead of FFDL, yes. It will copy your settings from FFDL (but not saved window sizes, disabled warnings or hot keys). You may uninstall FFDL whenever you are comfortable doing so.
If you're asking if the FFDL thread should be removed, no, not yet. I plan to have some time with both up to ease the transition. And possibly one last version of FFDL with a one-time notification pop-up of the change over. |
![]() |
![]() |
![]() |
#8 |
Ex-Helpdesk Junkie
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 19,421
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
I meant, should the FFF plugin, when installed, auto-remove the FFDL plugin?
There are some plugins which when installed via the plugin updater will remove plugins that they replace, because people shouldn't/don't need to be using both. I guess if you are still transitioning it, then maybe not. |
![]() |
![]() |
![]() |
#9 | |
Wizard
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 1,327
Karma: 5306
Join Date: Jan 2014
Device: none
|
When I try to reach the plugins, it just says:
Quote:
https://www.mobileread.com/forums/sho...77&postcount=4 |
|
![]() |
![]() |
![]() |
#10 |
Ex-Helpdesk Junkie
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 19,421
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
That means calibre cannot connect to the internet to download the Plugin Updater info. Not a problem with any specific plugin per se.
![]() |
![]() |
![]() |
![]() |
#11 | |
Well trained by Cats
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 30,250
Karma: 57979022
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
This affects the Get plugins pulldown. The question is: Should the Index entry for FFDL be move down there? (the thread stays) |
|
![]() |
![]() |
![]() |
#12 |
Wizard
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 1,327
Karma: 5306
Join Date: Jan 2014
Device: none
|
I never had a problem before, and as you can see, I have plenty of internet
![]() |
![]() |
![]() |
![]() |
#13 | |
Plugin Developer
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 6,482
Karma: 4277235
Join Date: Dec 2011
Location: Midwest USA
Device: Kindle Paperwhite(10th)
|
What eschwartz said. That's outside the specific plugin.
Quote:
Code:
join_string_characters:\s&\s |
|
![]() |
![]() |
![]() |
#14 |
Ex-Helpdesk Junkie
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 19,421
Karma: 85397180
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
|
The fact that your browser has internet has no bearing on whether calibre does.
The usual culprit is an overeager antivirus suite. |
![]() |
![]() |
![]() |
#15 |
Junior Member
![]() Posts: 3
Karma: 10
Join Date: Apr 2015
Device: Kindle Paperwhite
|
I keep getting error: "'NoneType' object has no attribute 'find'" when trying to import from StoriesOnline.net. I googled around and haven't found any solution though.
|
![]() |
![]() |
![]() |
Tags |
fanfiction ![]() |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
[GUI Plugin] KindleUnpack - The Plugin | DiapDealer | Plugins | 494 | 05-18-2024 02:34 AM |
[GUI Plugin] Open With | kiwidude | Plugins | 403 | 04-01-2024 08:39 AM |
[GUI Plugin] Marvin XD | Philantrop | Plugins | 126 | 01-29-2017 12:48 PM |
[GUI Plugin] KiNotes | -axel- | Plugins | 0 | 07-14-2013 06:39 PM |
[GUI Plugin] Plugin Updater **Deprecated** | kiwidude | Plugins | 159 | 06-19-2011 12:27 PM |