![]() |
#1 |
Enthusiast
![]() Posts: 37
Karma: 10
Join Date: Nov 2009
Device: SM-T820, Galaxy S7
|
Using GPT4All as a research tool
On my PC I've just installed GPT4All and selected as model the 'Llama 3 8B Instruct'. It is presently indexing my Calibre library to what it calls LocalDocs.
For anyone interested, I suggest to check it out at GPT4All's homepage (it's free and promises to fully respect privacy). It's not that much of an install and that way you can quiery the AI to your heart's content to get an idea of its use. I expect it to be a significant tool to access specific information in my largely non-fiction library, but by no means do I consider it a replacement for Calibre for the simple reason that it is not - and doesn't pretend to be - a library manager. Among the benefits listed by the LLM, I particularly paid attention to: - Contextual search: allowing for additional questions and provision of additional context to refine results - Natural Language Processing - Integration with Chat interface For anyone linking to their Calibre library, and who have many books, I suggest to create a sub-library in its own folder and run GPT4All on that. Do it with books that you know fairly well, so you have some possibility for evaluting produced results. Checking GitHub and elsewhere, I understand that a GPT4All summarizer is in the pipeline, which would really be nice. However, I would still carry on what I've done so far, which is to export my marked text to a text file (which my ePub reader allows to create and export). Then I use - say DuckDuckGo's Chat AI - to consolidate it into a coherent summary. From now on I expect to use GPT4All to do that. I bet, at least for a long time, this sort of wetware curated summary (i.e. using my brain) will surpase what any AI have to offer, since who-better-to-know than I what is important for me. Unless you're fanatically interested in certain topics and just prefer to enjoy fictions, all of this may surely not be important. If you're an (aspiring) writer then it may be different. What I expect from GPT4All is to better understand the three existential threats presently facing humanity, which I find to be: Climate Change, Depletion of Biodiversity and Inequality at Local, Country and Global levels. I got lots of relevant literature in my library but finding it is a challenge that I hope will be reduced significantly with the use of AI. Cheers! |
![]() |
![]() |
![]() |
#2 |
Resident Curmudgeon
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 75,582
Karma: 134254544
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
I hope the answer is never to AI being added to calibre.
|
![]() |
![]() |
Advert | |
|
![]() |
#3 | |
the rook, bossing Never.
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 12,220
Karma: 89531599
Join Date: Jun 2017
Location: Ireland
Device: All 4 Kinds: epub eink, Kindle, android eink, NxtPaper11
|
Quote:
Last edited by Quoth; 08-13-2024 at 09:28 AM. |
|
![]() |
![]() |
![]() |
#4 |
null operator (he/him)
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 20,820
Karma: 27405122
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
Moderator Notice
I moved this from the Calibre forum to the Related Tools subforum. I have deleted the almost identical post in Plugins. BR |
![]() |
![]() |
![]() |
#5 |
the rook, bossing Never.
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 12,220
Karma: 89531599
Join Date: Jun 2017
Location: Ireland
Device: All 4 Kinds: epub eink, Kindle, android eink, NxtPaper11
|
Calibre built-in Full Text Search (FTS) is very powerful, with phrase and near features.
You can run the search, when index is up to date, on a sub-range of titles by any normal Calibre search. It's fantastic for research. |
![]() |
![]() |
Advert | |
|
![]() |
#6 |
Enthusiast
![]() Posts: 37
Karma: 10
Join Date: Nov 2009
Device: SM-T820, Galaxy S7
|
@Quoth
I'll be sure to check out the Calibre FTS results. With respect to your previous response I think you're referring to the means used and present stranglehold Big Tech has on LLMs where they try to force people to use their cloud-based systems. I surely agree that this is a very negative development and that's why I'm keeping an eye on open source alternatives. Also, AI has already had significant impact on various scientific domains enhancing research and practical applications. Just ask an AI ![]()
|
![]() |
![]() |
![]() |
#7 |
the rook, bossing Never.
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 12,220
Karma: 89531599
Join Date: Jun 2017
Location: Ireland
Device: All 4 Kinds: epub eink, Kindle, android eink, NxtPaper11
|
Mostly lies and marketing. The so called AI of Watson to win Jeopardy was unrelated to the Watson IBM sold for Medicine, which didn't work.
Most of the so called success of AI is pattern-matching of human curated work branded as AI. The LLM, on Cloud or local is even less use. "Deep Learning" is a lie. AI Jargon along with terms like Machine Learning and Neural Networks (which aren't). I started my study of programming due to interest in AI, which was marketed as Expert Systems from the late 1980s. AI didn't do any of the things on your list. Pattern matching aided by computer databases and software from human curated sources achieved the results. Also none of that list applies to how LLM work. AI after 60 years is still a toy, now being hyped like cryptocoins and NFT. Analysis suggests this is hype bubble and will fail as the costs of builing the LLM and feeding the data exceed any income possible, which is not even considering that the productivity gains claimed to sell it are by the people selling and are lies. Misleading: https://www.theregister.com/2024/08/...y_creation_of/ This is like Big McD saying big Macs are healthy: https://www.theregister.com/2024/08/...ai_roi_report/ https://www.theregister.com/2024/08/..._going_to_pay/ This is separate to the question "Does it even work". Last edited by Quoth; 08-16-2024 at 04:49 AM. |
![]() |
![]() |
![]() |
#8 |
Enthusiast
![]() Posts: 37
Karma: 10
Join Date: Nov 2009
Device: SM-T820, Galaxy S7
|
@Quoth
At least you're persistently negative in the subject matter ![]() A shame that not a single of the 10 examples of useful application of AI are real and all part of a mayor conspiracy... ![]() |
![]() |
![]() |
![]() |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
Confused. Is Calibre an eBook creation Tool or tool for readers? | Fran_3 | Calibre | 12 | 10-25-2020 08:19 PM |
Wanted: research tool on Android | nekokami | Android Developer's Corner | 2 | 07-10-2010 09:27 PM |
iPad A useful Wikipedia research tool | 6charlong | Apple Devices | 2 | 04-26-2010 09:29 PM |
Anyone want to help me out with a little research? | PorterHarbold | Lounge | 2 | 10-24-2008 03:52 AM |