05-19-2012, 03:10 PM | #166 |
Member
Posts: 14
Karma: 18852
Join Date: Nov 2011
Device: Kindle DX, Icarus Excel
|
thank u @kiwidude
but ı have already tried it, it doesnt work. but I'm still working on it. |
06-08-2012, 07:44 PM | #167 | |
Wizard
Posts: 1,821
Karma: 4985051
Join Date: Sep 2010
Location: Maryland
Device: ...lots! ;) mostly reading on a Kindle Voyage
|
I am having problems with the 'FictionDB for Book' option.
Did I muck up the code somehow or is it having issues? Spoiler:
It returns: Quote:
Thanks! |
|
Advert | |
|
06-08-2012, 08:12 PM | #168 |
Calibre Plugins Developer
Posts: 4,661
Karma: 2162064
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
@copyrite - it seems that they have changed their website.
It's a pretty simple fix: Change the url to this: Code:
http://www.fictiondb.com/search/searchresults.htm?styp=5&srchtxt={author}+{title} Alternatively use the same URL with a space where the + is between {author} and {title}, and keep the method as "POST". Both seem to work equally from my quick tests. |
06-08-2012, 08:15 PM | #169 |
Wizard
Posts: 1,821
Karma: 4985051
Join Date: Sep 2010
Location: Maryland
Device: ...lots! ;) mostly reading on a Kindle Voyage
|
That works - thanks, kiwidude!
|
06-25-2012, 10:12 AM | #170 |
Member
Posts: 11
Karma: 10
Join Date: Jun 2012
Device: None
|
How to Extract the Title from Web Page and Place in Calibre
Using the OnePetro website to search for technical papers, the site address is:
http://www.onepetro.org/mslib/app/newSearch.do And a manual address to get a paper is: http://www.onepetro.org/mslib/app/Pr...ocietyCode=SPE And the plugin address using the series_index is: http://www.onepetro.org/mslib/app/Preview.do?paperNumber=SPE-{series_index:re(0$,)}-PA&societyCode=SPE And this works. My question is how to I extract the Title and other fields from the web page and place them in Calibre? Any help will be greatly appreciated. |
Advert | |
|
06-25-2012, 10:19 AM | #171 |
Calibre Plugins Developer
Posts: 4,661
Karma: 2162064
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
You can't with this plugin - its purpose is to display a web page in a browser, nothing more. So any "extraction" would be manually copy/pasting.
For what you want to do you need to write a metadata download plugin, such as those included with calibre like Amazon & Google or various examples in this forum like Goodreads, Fantastic Fiction, Webscription, etc etc. |
06-26-2012, 09:50 PM | #172 |
Member
Posts: 11
Karma: 10
Join Date: Jun 2012
Device: None
|
Thanks Kwidude.
It would have been nice for your plugin to have fields, one for title, author, comments etc. where one could use a regular expression to pickup the title etc.; similar to the way Calibre reads the metadata from the file names. So instead of file names it reads the source from the web page. I guess I am going to have to learn python :-( |
06-27-2012, 07:29 AM | #173 |
Calibre Plugins Developer
Posts: 4,661
Karma: 2162064
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
A metadata download plugin is one of the easiest types of plugins to write, but then I might be biased from having written so many of them. Most of their pain comes from having to continually update them as the website changes, which is annoying. Unfortunately your particular website requirement is very niche - you could well be the only calibre user in the world storing those particular documents, or else I would just knock it up for you. If you really can't face the learning curves and it means enough to you I can always be bribed via PM of course .
I wouldn't say that scraping data is a functional match for this particular plugin, but I understand what you are asking for. In fact another plugin I have written recently but not released yet does something similar in concept, scraping title/author data from pages using user configurable xpath and regex expressions. It wouldn't be useful to you for this, but I'm certainly well aware of the "fun" involved. I did wonder ages ago about making a generic metadata scraping plugin which would allow a knowledgable end user to configure a website to pull data from specifying similar xpath/regex expressions. However you are talking very niche usage, and there would always be some sites where the generic approach could not work since every site is different. Then there is also the issues of interaction with the existing metadata download processes etc. It isn't impossible, but it just hasn't been asked for enough for someone to be motivated enough to write it. |
06-28-2012, 01:11 AM | #174 |
Member
Posts: 11
Karma: 10
Join Date: Jun 2012
Device: None
|
I agree I will probably be the only user of this plugin as it is so specialized. So I think I will try to do this myself first and see how it goes. Out of curiosity, if you were to write the plugin how much is the bribe :-) ? Remember there will be a few "issues" with this site as I have found out myself.
Last edited by dFGJByjm4898IssG; 06-28-2012 at 05:37 AM. |
08-21-2012, 12:56 PM | #175 |
Junior Member
Posts: 5
Karma: 18
Join Date: Aug 2012
Device: iPad 3
|
Hi Guys,
Just incase you have a lot of roleplaying books that need sorted, here are some settings for DriveThru RPG. For Book - http://rpg.drivethrustuff.com/index.php?keywords={title}&x=0&y=0&author=&artist= &pfrom=&pto= For Author - http://rpg.drivethrustuff.com/index.php?keywords=&x=0&y=0&author{author}=&artist =&pfrom=&pto= Favicon Link = http://rpg.drivethrustuff.com/themes/dtrpg/favicon.ico (though that didnt work when I tried it, will probably just make the .ico a .png and add it manually) I was having a hard time being motivated to edit all of my White Wolf stuff manually, and came across this page. In the short term Search the Internet will work, but I am actually VERY tempted to try writing some form of RPGBooksDB type page with an API, since its likely a community people would get behind Anyway hope this helps someone |
08-21-2012, 02:03 PM | #176 |
Calibre Plugins Developer
Posts: 4,661
Karma: 2162064
Join Date: Oct 2010
Location: Australia
Device: Kindle Oasis
|
Thanks for sharing dtrounson. It is of course possible to export your settings into a little zip file that others can then import which makes it a little easier but the important part is figuring out the search syntax which you have done. HOpefully others will find it useful.
|
08-23-2012, 06:15 AM | #177 |
Junior Member
Posts: 1
Karma: 10
Join Date: Aug 2012
Device: ipad
|
Memory hogging
Hi,
I just installed this plug-in and noticed that when I go to configure the plugin the memory usage for calibre shoots up to nearly 2gig (1,802,652K in windows task manager) before i noticed this i had added a couple of my own searches so i thought i might have messed it up, so i uninstalled and re-installed the plugin, but it still does it. other than that it works great any reason for this? cheers, chris Last edited by UFS; 08-23-2012 at 06:23 AM. |
09-02-2012, 07:09 PM | #178 |
Absolute beginner
Posts: 8
Karma: 10
Join Date: Feb 2012
Location: Milano (Italy)
Device: Iconia A500
|
For those italians, this is the configuration line for searching on HOEPLI bookseller database:
http://www.hoepli.it/cerca/libri.aspx?query=%22{author}%22+%22{title}%22&ty=1 Enjoy |
09-02-2012, 07:12 PM | #179 |
Absolute beginner
Posts: 8
Karma: 10
Join Date: Feb 2012
Location: Milano (Italy)
Device: Iconia A500
|
For the author of the plugin: it crashes all the time during configuration operation.
I'm using the last version 0.8.67 Any workaround ? Guba |
09-02-2012, 08:34 PM | #180 |
Well trained by Cats
Posts: 30,107
Karma: 57259780
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Search The Internet is Not part of the Calibre didtribution, but a User controlled update. (Preferences: Get plugins.. :Installed ) I believe V1.71` is the latest (and it does not crash on XP when selecting 'configure')
|
Tags |
book details, search the internet |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Any web-to-epub plugin for internet browser? | bthoven | ePub | 7 | 07-10-2011 05:14 AM |
Fictionwise Browser Search Plugin | Zero9 | Deals and Resources (No Self-Promotion or Affiliate Links) | 17 | 07-27-2009 03:15 PM |
Diesel eBooks Browser Search Plugin | Zero9 | Deals and Resources (No Self-Promotion or Affiliate Links) | 10 | 07-27-2009 12:16 PM |
eReader.com Browser Search Plugin | Zero9 | Deals and Resources (No Self-Promotion or Affiliate Links) | 0 | 07-24-2009 09:44 PM |
BooksOnBoard Browser Search Plugin | Zero9 | Deals and Resources (No Self-Promotion or Affiliate Links) | 10 | 07-24-2009 03:27 PM |