Geekmaster's adventures in K1 spelunking

[geekmaster]

Originally Posted by knc1

Great!
If you exhaust all ideas without finding the problem, just post about what doesn't work, I'll see if I can come up with more things to check.

= = = =

One techy note:
The ARMel Busybox was not being run in a chroot, just anywhere in the file system will do.
You need the binfmt-support and qemu-static packages installed to make it 'just work'.

I do have binfmt and qemu-static in my linux mint, and some K1 binaries run fine. Copying the K1 /bin to my chroot makes chroot fail (cannot find /bin/bash) which may be a problem with the K1 bash symlink. I could try to copy busybox and rename it as bash, instead of a symlink...

[knc1]

Originally Posted by geekmaster

I do have binfmt and qemu-static in my linux mint, and some K1 binaries run fine. Copying the K1 /bin to my chroot makes chroot fail (cannot find /bin/bash) which may be a problem with the K1 bash symlink. I could try to copy busybox and rename it as bash, instead of a symlink...

Depending on how the chroot was populated, if you don't specify the name of the shell as an argument to the chroot call, then it will try to find /bin/bash.

A sysmlink from /bin/bash to /bin/sh will work, if /bin/sh is linked to busybox (two levels of symlinks).

or
chroot '/bin/busybox sh' username (default 'root')

or
you don't have /proc mounted inside of the chroot.

this build of busybox acts as if it was built to look for: /proc/self
in its applet name decode.
But I haven't straced it to be sure.

= = = =

Stay away from Windows for awhile - it is poisoning your mind.

[geekmaster]

A little arm-qemu-static chroot test:

PHP Code:

mint17-32 K1 # mount
---<snip>---
/media/sf_SHARE/kindle/lenny.ext3 on /mnt/lenny type ext3 (rw)
---<snip>---
mint17-32 K1 # du -sk Angstrom-gumstix-directfb-image-uclibc-ipk-2007.9-test-20080513-gumstix-custom-basix.rootfs.jffs2 
10700    Angstrom-gumstix-directfb-image-uclibc-ipk-2007.9-test-20080513-gumstix-custom-basix.rootfs.jffs2
mint17-32 K1 # modprobe mtdram total_size=10700 erase_size=128
mint17-32 K1 # modprobe mtdblock
mint17-32 K1 # dd if=Angstrom-gumstix-directfb-image-uclibc-ipk-2007.9-test-20080513-gumstix-custom-basix.rootfs.jffs2 of=/dev/mtdblock0
21395+1 records in
21395+1 records out
10954556 bytes (11 MB) copied, 0.119878 s, 91.4 MB/s
int17-32 K1 # mount -t jffs2 /dev/mtdblock0 /mnt/uclibc
mint17-32 K1 # ls /mnt/uclibc
bin  boot  dev  etc  home  lib  media  mnt  proc  sbin  sys  tmp  usr  var
mint17-32 K1 # rm -rf uclibc/*
mint17-32 K1 # cp -a /mnt/uclibc/* uclibc
mint17-32 K1 # ls uclibc
bin  boot  dev  etc  home  lib  media  mnt  proc  sbin  sys  tmp  usr  var
mint17-32 K1 # file uclibc/bin/bash
uclibc/bin/bash: ERROR: cannot open 'uclibc/bin/bash' (No such file or directory)
mint17-32 K1 # cd uclibc/bin
mint17-32 bin # ls -al bash
ls: cannot access bash: No such file or directory
mint17-32 bin # ln -s busybox bash
mint17-32 bin # ls -al bash
lrwxrwxrwx 1 root root 7 May 11 10:03 bash -> busybox
mint17-32 bin # cd ../..
mint17-32 K1 # file uclibc/bin/bash
uclibc/bin/bash: symbolic link to 'busybox' 
mint17-32 K1 # file uclibc/bin/busybox
uclibc/bin/busybox: ELF 32-bit LSB  executable, ARM, EABI4 version 1 (SYSV), dynamically linked (uses shared libs), stripped
mint17-32 K1 # uclibc/bin/bash
/lib/ld-uClibc.so.0: No such file or directory
mint17-32 K1 # chroot uclibc
chroot: failed to run command '/bin/bash': No such file or directory
mint17-32 K1 # file /mnt/lenny/bin/bash
/mnt/lenny/bin/bash: ELF 32-bit LSB  executable, ARM, EABI4 version 1 (SYSV), dynamically linked (uses shared libs), for GNU/Linux 2.6.14, stripped
mint17-32 K1 # /mnt/lenny/bin/bash
/lib/ld-linux.so.3: No such file or directory
mint17-32 K1 # chroot uclibc
chroot: failed to run command '/bin/bash': No such file or directory
mint17-32 K1 # chroot /mnt/lenny
mint17-32:/# gcc -v
Using built-in specs.
Target: arm-linux-gnueabi
Configured with: ../src/configure -v --with-pkgversion='Debian 4.3.2-1.1' --with-bugurl=file:///usr/share/doc/gcc-4.3/README.Bugs --enable-languages=c,c++,fortran,objc,obj-c++ --prefix=/usr --enable-shared --with-system-zlib --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --enable-nls --with-gxx-include-dir=/usr/include/c++/4.3 --program-suffix=-4.3 --enable-clocale=gnu --enable-libstdcxx-debug --enable-objc-gc --enable-mpfr --disable-libssp --disable-sjlj-exceptions --enable-checking=release --build=arm-linux-gnueabi --host=arm-linux-gnueabi --target=arm-linux-gnueabi
Thread model: posix
gcc version 4.3.2 (Debian 4.3.2-1.1) 
mint17-32:/# 


The error messages above show that the arm-uclinux rootfs is looking for different libs than the arm-debian lenny rootfs. That lenny.ext3 was built using instructions provided by twobob. The gumstix arm-uclibc rootfs image was from here. It has been quite awhile since I mounted a jffs2 image, so it took some googling. What would we do without Google?

I have been looking for arm-debian-woody (no success so far) to try using for building K1 apps.

I can only do a build in folders (or loop mounts) that I can chroot into, and no luck with that uclibc rootfs so far.

EDIT: I can chroot into this one now. I forgot to copy arm-qemu-static to /usr/bin. It works after doing that. I can also chroot into debian lenny, but all those other uclibc-based images I cannot chroot into (even though they contain /usr/bin/arm-qemu-static). However, this chroot has no network access, and it has no ipkg or opkg (but it does have dpkg), and the gumstix apps (like gcc) are in .ipk packages, so need manual unpacking and installing.

[knc1]

Did you mount /proc, /sys, and /dev into your chroot?

[geekmaster]

Originally Posted by knc1

Did you mount /proc, /sys, and /dev into your chroot?

As you can see above, I did not mount them. They did not mount them at the armhf chroot link you provided earlier in this thread either (though they did mention a proc automount, giving no details or links or examples) I am new at this chroot stuff on a host PC, so I was not aware of needing such a thing. What do I mount there? My host PC equivalents? Bind mounts? Perhaps I thought the mntdebian script in twobob's thread was for mounting inside the kindle. Being a noob at this, it is difficult to guess what may be obvious to you. I will google some more, but a lot of what google finds does not work without adjustments (such as that whole jffs2 mount procedure). Like I said, maybe obvious to you, but just guesswork for me at the moment unless I find good working examples. And google does not necessarily return the same results for you and I (i.e. that filter bubble" problem).

Also, do you have any static compiled binaries you built that I can try on my K1? If so, please post one. Thanks.

[geekmaster]

Now I mounted my linux mint /proc, /sys, and /dev into my chroot, but no difference in behaviour:

PHP Code:

mint17-32 K1 # cd uclibc
mint17-32 uclibc # mount -o bind /proc proc
mint17-32 uclibc # mount -o bind /sys sys
mint17-32 uclibc # mount -o bind /dev dev
mint17-32 K1 # ls uclibc/proc
1      12695  159   1784  1886  2085  2142  2333  26690  351   5     589   810     buddyinfo    interrupts  misc          swaps
10     12737  16    1785  1898  2087  2143  2345  27     3524  50    601   865     bus          iomem       modules       sys
1047   12902  160   1786  19    2089  2163  2352  27523  3527  515   6073  881     cgroups      ioports     mounts        sysrq-trigger
11     1297   161   1787  1914  2090  2169  2357  27552  3528  516   6101  8900    cmdline      irq         mtd           sysvipc
1102   13     162   1790  1918  2093  2170  2379  28     36    52    6109  892     consoles     kallsyms    mtrr          thread-self
1110   1300   163   18    1919  2095  2180  2384  28294  37    520   618   9       cpuinfo      kcore       net           timer_list
1114   1374   164   1836  1971  21    2183  2396  28306  398   524   652   903     crypto       keys        pagetypeinfo  timer_stats
1122   15     17    1838  2     2102  2188  24    28364  405   53    7     905     devices      key-users   partitions    tty
1132   153    1775  1846  20    2111  22    25    28387  4588  54    735   911     diskstats    kmsg        sched_debug   uptime
1189   154    1776  1848  2023  2114  23    254   28414  459   545   762   913     dma          kpagecount  schedstat     version
12     155    1777  1851  2061  2125  2312  255   29     4592  547   767   916     driver       kpageflags  scsi          version_signature
12371  156    1780  1853  2072  2127  2317  26    3      4593  55    768   967     execdomains  loadavg     self          vmallocinfo
12379  1561   1781  1859  2075  2128  2321  2614  30     465   5508  78    969     fb           locks       slabinfo      vmstat
1245   157    1782  1860  2079  2134  2328  2617  35     479   57    79    acpi    filesystems  mdstat      softirqs      zoneinfo
125    158    1783  1876  2081  2138  2329  2618  350    49    588   8     asound  fs           meminfo     stat
mint17-32 K1 # ls uclibc/sys
block  bus  class  dev  devices  firmware  fs  hypervisor  kernel  module  power
mint17-32 K1 # ls uclibc/dev
autofs           fuse          mem               nbd6                ram12   sda1      tty12  tty28  tty43  tty59      ttyS15  ttyS30     vcs4
block            hidraw0       memory_bandwidth  nbd7                ram13   sda2      tty13  tty29  tty44  tty6       ttyS16  ttyS31     vcs5
bsg              hpet          mtd0              nbd8                ram14   sda5      tty14  tty3   tty45  tty60      ttyS17  ttyS4      vcs6
btrfs-control    input         mtd0ro            nbd9                ram15   sg0       tty15  tty30  tty46  tty61      ttyS18  ttyS5      vcs8
bus              kmsg          mtdblock0         net                 ram2    sg1       tty16  tty31  tty47  tty62      ttyS19  ttyS6      vcsa
cdrom            log           nbd0              network_latency     ram3    shm       tty17  tty32  tty48  tty63      ttyS2   ttyS7      vcsa1
char             loop0         nbd1              network_throughput  ram4    snapshot  tty18  tty33  tty49  tty7       ttyS20  ttyS8      vcsa2
console          loop1         nbd10             null                ram5    snd       tty19  tty34  tty5   tty8       ttyS21  ttyS9      vcsa3
core             loop2         nbd11             port                ram6    sr0       tty2   tty35  tty50  tty9       ttyS22  uhid       vcsa4
cpu              loop3         nbd12             ppp                 ram7    stderr    tty20  tty36  tty51  ttyprintk  ttyS23  uinput     vcsa5
cpu_dma_latency  loop4         nbd13             psaux               ram8    stdin     tty21  tty37  tty52  ttyS0      ttyS24  urandom    vcsa6
cuse             loop5         nbd14             ptmx                ram9    stdout    tty22  tty38  tty53  ttyS1      ttyS25  vboxguest  vcsa8
disk             loop6         nbd15             pts                 random  tty       tty23  tty39  tty54  ttyS10     ttyS26  vboxuser   vfio
ecryptfs         loop7         nbd2              ram0                rfkill  tty0      tty24  tty4   tty55  ttyS11     ttyS27  vcs        vga_arbiter
fb0              loop-control  nbd3              ram1                rtc     tty1      tty25  tty40  tty56  ttyS12     ttyS28  vcs1       vhci
fd               mapper        nbd4              ram10               rtc0    tty10     tty26  tty41  tty57  ttyS13     ttyS29  vcs2       vhost-net
full             mcelog        nbd5              ram11               sda     tty11     tty27  tty42  tty58  ttyS14     ttyS3   vcs3       zero
mint17-32 K1 # chroot uclibc
chroot: failed to run command '/bin/bash': No such file or directory
mint17-32 K1 # ls -al uclibc/bin/bash
lrwxrwxrwx 1 root root 7 May 11 10:03 uclibc/bin/bash -> busybox
mint17-32 K1 # 


Is that what you meant, or something else (still unknown to me)? I also mounted them in my lenny loop mount, also with no difference, but lenny could already complile apps that ran fine in the chroot, but not in my K1. I was hoping the uclibc chroot would work better, but chroot fails on that one (both the dir and the loopmount, but the jffs2 loopmount does not let me create the missing /bin/bash link -- no free space).

[knc1]

That Busybox version is too old to recognize 'bash'

K1 # chroot uClibc '/bin/busybox sh'
Note the quotes.

[geekmaster]

Originally Posted by knc1

That Busybox version is too old to recognize 'bash'

K1 # chroot uClibc '/bin/busybox sh'
Note the quotes.

PHP Code:

mint17-32 K1 # chroot uclibc '/bin/busybox sh'
chroot: failed to run command '/bin/busybox sh': No such file or directory
mint17-32 K1 # ls -al uclibc/bin/busybox
-rwxr-xr-x 1 root root 675368 Dec 31  1969 uclibc/bin/busybox
mint17-32 K1 # ls -al uclibc/bin/sh
lrwxrwxrwx 1 root root 7 Dec 31  1969 uclibc/bin/sh -> busybox 


Those dates look like linux "ground zero" (with timezone adjustment), so not sure about the "real" date. Those are the same dates as in the original jffs2 image. Also what may be found on a freshly reset kindle device in airplane mode (no hardware clock).

Another failed attempt. Next?

Also, do you have a potentially compatible custom K1 binary executable I can try to run on my K1? If so, please post it. Thanks.

[geekmaster]

I know that I can chroot the lenny loop mount just fine, so I did this:

PHP Code:

mint17-32 K1 # cd uclibc/bin
mint17-32 bin # rm bash
mint17-32 bin # cp /mnt/lenny/bin/bash .
mint17-32 bin # ls -al bash
-rwxr-xr-x 1 root root 700184 May 11 11:32 bash
mint17-32 bin # cd ../..
mint17-32 K1 # chroot uclibc
chroot: failed to run command '/bin/bash': No such file or directory
mint17-32 K1 # 


[geekmaster]

PHP Code:

mint17-32 K1 # uclibc/bin/busybox
/lib/ld-uClibc.so.0: No such file or directory
mint17-32 K1 # file uclibc/lib/ld-uClibc.so.0
uclibc/lib/ld-uClibc.so.0: symbolic link to 'ld-uClibc-0.9.29.so' 
mint17-32 K1 # file uclibc/lib/ld-uClibc-0.9.29.so
uclibc/lib/ld-uClibc-0.9.29.so: ELF 32-bit LSB  shared object, ARM, EABI4 version 1 (SYSV), dynamically linked, stripped
mint17-32 K1 # 


I executed that busybox binary without a chroot just to receive that missing library error message, then investigated that "missing" library. It acts like the problems I see on my K1, with apparently "missing" (but not missing) files too. Some kind of incompatibility or misconfiguration, surely, but I have no idea what to try next other that random poking around in the dark (and more googling tons more old web pages with dead links in them).

[geekmaster]

So basically, at this current state of affairs in K1 development, binaries that run on the K1 will not run in an arm-qemu-static chroot, and binaries that do run in an arm-qemu chroot (even statically compiled binaries) do not run on the K1. It is not firmware dependent -- I have tried on both old and new firmware (still installed on my two K1s). I have also tried running from both internal flash and from SD card.

Copying executables from elsewhere on the K1 to userstore seems to work fine, and scripts work fine too, but there is a limit to what can be done in a script (though I have run some of my eink algorithmic art scripts in my K1s, and that works great with suitable eink format adjustments). But I want to access ioctl, and I want to compile kernel modules, and script are not adequate for those goals.

I have other (non-kindle) projects begging for attention, and my lack of progress here may require me to shelf my kindle interests for awhile (unless I make rapid progress soon). After the K1, I want to do things for all my other kindles (K2 through PW3) as well. But lacking recent progress makes other projects more appealing than kindle stuff (such as my new Oculus Rift Consumer Version sitting in the corner for the past week -- it was free because I was a kickstarter backer; I certainly cannot afford to buy one)...

[geekmaster]

I just tried unpacking at chrooting a gumstix uclinix rootfs, which already included a /bin/bash. Same problem, where chroot claims '/bin/bash not found'. Though perhaps that means it MIGHT run on my K1, being incompatible with chroot?

Nope! It seems chroot does not like an uclibc stuff, and the K1 does not like any non-lab126 stuff. So far, at least...

Now to find something ELSE to try...

[geekmaster]

I found a debian arm woody rootfs in a debian archive, but on the K1 it also says "/mnt/us/woody/bin/busybox: not found".

Time to put this aside for awhile, until somebody can give me some additional guidance -- I am sure not finding a solution to building working binaries for my K1, and I am running out of things to try (google isn't helping)...

[geekmaster]

And another new message (where anomalies can be a good thing). I compiled hello-static using CodeSourcery 2005q3 arm-non-linux-gnueabi.exe (on Windows), and it says "Illegal instruction" when run. That is something I have not seen before on the K1. Not sure if a step in the right direction though.

I tried adding "-march=arm5te" and that still said "Illegal instruction", as did "-march=arm4".

[knc1]

-mtune=xscale -mno-unaligned-access