![]() |
#1 |
Connoisseur
![]() Posts: 56
Karma: 74
Join Date: Oct 2010
Device: Kindle 3
|
![]()
I'm hoping to try and get some kind of a working form of voice control going for the Kindle.
This would be a great help to anyone who doesn't have the use of their hands and can't control their Kindle by pressing buttons. I specifically wanted to try and get this functionality working for a friend of mine who has Multiple Sclerosis. This would allow her to read on her own, which she hasn't been able to do for a long time. The practical stuff: I'm not going to attempt to use the built in microphone, or anything like that. I'm just going to try and get remote execution of key input so that the voice recognition stuff can happen on a computer. So the main thing I need to work out is, how do you simulate key presses via the command line? I have a feeling that h1uke's Launchpad hack does exactly this, but I'm having trouble working out exactly what part of his code is responsible for sending the actual command, and how it is doing this. If anyone could explain to me how one simulates a key press, then I could have a script on the computer trigger those keypresses over SSH when it receives the correct voice commands. Thanks! UPDATE: I've got working remote execution of Kindle key commands that can be interacted with using voice recognition software. Still a work in progress, but give it a go and let me know what you think! Just remember to put the right settings in config.ini, and make sure you have the usbnetwork hack installed with ssh over wifi. Last edited by Acorn; 01-31-2011 at 08:15 PM. |
![]() |
![]() |
![]() |
#2 | |
Member
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 23
Karma: 22222
Join Date: Oct 2010
Device: kindle3
|
Quote:
echo "send 104" > /proc/keypad on a Kindle3 is the same as moving to next page. You can find the device names and keycodes in keydefs.ini and launchpad.ini from my "Kindle Terminal" at http://info.iet.unipi.it/~luigi/kindle/ Finally, the microphone is available e.g. arecord test.wav records a file (you can stop with ctrl-c) that you can later play with aplay test.wav (and in C you can access the device using the ALSA API) cheers luigi |
|
![]() |
![]() |
Advert | |
|
![]() |
#3 |
Connoisseur
![]() Posts: 56
Karma: 74
Join Date: Oct 2010
Device: Kindle 3
|
Wow, thanks for the help!
If I'm going to start by just having the voice recognition side of things on a computer, I assume the easiest way would be to just send the commands over SSH? The idea of getting simple speech recognition working with the built in microphone is really exciting, but it's way over my head. I have no knowledge of C ![]() If it was possible to get Python working on the Kindle, I might be able to give it more of a try, but that's probably a crazy way to go about it. Thanks again! Edit: Is there a simpler way to send commands to the Kindle than SSH? It seems a little bit overkill. It also has the downside that you need to fiddle around with drivers to get SSH over USB working. Telnet? Last edited by Acorn; 01-26-2011 at 10:19 AM. |
![]() |
![]() |
![]() |
#4 | |
Zealot
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 121
Karma: 82565
Join Date: Aug 2010
Location: Maryland, USA
Device: dxg, k3w,k4nt,kpw
|
Quote:
launchpad daemon. This addition will be listening to incoming UDP multicast packets sent by your desktop application and translate them directly to whatever Kindle shell commands you want. You can also use Kindle serial console, this solution will not require any hacks at all. Some mechanical/soldering work will be required in this case. But this approach can noticeably simplify the whole thing. |
|
![]() |
![]() |
![]() |
#5 | |
Enthusiast
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 35
Karma: 1566
Join Date: Nov 2010
Device: kindle 3wifi
|
Quote:
|
|
![]() |
![]() |
Advert | |
|
![]() |
#6 | |
Connoisseur
![]() Posts: 56
Karma: 74
Join Date: Oct 2010
Device: Kindle 3
|
Quote:
|
|
![]() |
![]() |
![]() |
#7 |
Connoisseur
![]() Posts: 56
Karma: 74
Join Date: Oct 2010
Device: Kindle 3
|
|
![]() |
![]() |
![]() |
#8 | |
Member
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 23
Karma: 22222
Join Date: Oct 2010
Device: kindle3
|
Quote:
|
|
![]() |
![]() |
![]() |
#9 |
Kindle Dissector
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 662
Karma: 475607
Join Date: Jul 2010
Device: Amazon Kindle 3
|
Doesn't the kindle 3 have a microphone? Anyone know how to access it?
|
![]() |
![]() |
![]() |
#10 | |
Connoisseur
![]() Posts: 56
Karma: 74
Join Date: Oct 2010
Device: Kindle 3
|
Quote:
I don't know much about networking/socket programming/ssh, so these thoughts are just based on my limited knowledge and what I've read. |
|
![]() |
![]() |
![]() |
#11 | |
Connoisseur
![]() Posts: 56
Karma: 74
Join Date: Oct 2010
Device: Kindle 3
|
Quote:
|
|
![]() |
![]() |
![]() |
#12 | |
Enthusiast
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 45
Karma: 10842
Join Date: Aug 2010
Device: Kindle DXG
|
Quote:
I think the "command and control" type of application you describe is perfectly doable using CMU's PocketSphinx with a finite state grammar. As far as I know there are already versions for IPhone and Android that can be used as a starting point. Last edited by vdp; 01-27-2011 at 04:02 AM. |
|
![]() |
![]() |
![]() |
#13 | |
Connoisseur
![]() Posts: 56
Karma: 74
Join Date: Oct 2010
Device: Kindle 3
|
Quote:
|
|
![]() |
![]() |
![]() |
#14 |
Connoisseur
![]() Posts: 56
Karma: 74
Join Date: Oct 2010
Device: Kindle 3
|
It turns out that having to send the commands over SSH is making things a huge headache. I'm wishing I could just send a packet
![]() |
![]() |
![]() |
![]() |
#15 |
Connoisseur
![]() Posts: 56
Karma: 74
Join Date: Oct 2010
Device: Kindle 3
|
Okay, I have a few more questions.
1. What is the command to make the Kindle wake up from sleep? Is it safe to use if the kindle is already awake? 2. How does the Kindle get assigned its IP address? My script needs to know the IP address of the Kindle, so it will need to be static. How can I achieve this? |
![]() |
![]() |
![]() |
Tags |
accessibility, key-press, simulate, voice, voice-control |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
Accessories DIY Kindle Cover | djulian | Amazon Kindle | 11 | 02-26-2011 08:12 PM |
iPad Enable voice control on iPad (jailbreak) | scottjl | Apple Devices | 0 | 05-03-2010 06:17 PM |
The Clerkenwell Presses | ShortNCuddlyAm | Writers' Corner | 16 | 01-30-2010 06:21 PM |
Free on Kindle - The Voice | koland | Deals and Resources (No Self-Promotion or Affiliate Links) | 0 | 12-09-2009 02:06 PM |
DIY Kindle Case | EnginerdLisa | Amazon Kindle | 3 | 09-27-2008 10:56 PM |