AoE Driver Initial Installation and Updating

Initial Driver Installation
Determine which driver you need by the kernel installed. To see the kernel version:

[root@backup backuppc]# uname -a

Linux backup.cvx.com 2.6.9-34.EL

Download the driver from Coraid's support site.

ATA over Ethernet (AoE) Linux driver for all 2.6 kernels, 2.6.2 and newer

aoe6-27.tar.gz aoe6 Changelog

[root@backup backuppc]# tar -xzvf aoe6-27.tar.gz

[root@backup backuppc]# cd /aoe6-27

[root@backup backuppc]# make install

DRIVER / KERNEL UPDATING

After a system reboot, the Coraid appliance wouldn't come online. I tried using aoe-stat and modprobe aoe, but got a Fatal Error. Looking at the yum log, I found where my automatic update cron job updated the kernel. I verified that the kernel version was newer using uname.  Therefore, I downloaded the latest aoe driver from Coraid and followed the procedure above. The make install command produced the following output:

[root@backup backuppc]# cd aoe6-29
[root@backup aoe6-29]# make install
ensuring compatibility … 1
patching file linux/drivers/block/aoe/disk_attr.h
2
patching file linux/drivers/block/aoe/aoechr.c
3 4
patching file linux/drivers/block/aoe/aoecmd.c
Hunk #1 succeeded at 642 (offset -1 lines).
5
patching file linux/drivers/block/aoe/aoenet.c
6
patching file linux/drivers/block/aoe/aoecmd.c
Hunk #1 succeeded at 427 (offset -1 lines).
ok
cd aoetools-9 && make NPERSHELF=16
make[1]: Entering directory `/root/backuppc/aoe6-29/aoetools-9'
+ sed -e 's!@devdir@!/dev/etherd!g' -e 's!@npershelf@!16!g' aoe-discover.in
+ sed -e 's!@devdir@!/dev/etherd!g' -e 's!@npershelf@!16!g' aoe-interfaces.in
+ sed -e 's!@devdir@!/dev/etherd!g' -e 's!@npershelf@!16!g' aoe-mkshelf.in
+ sed -e 's!@devdir@!/dev/etherd!g' -e 's!@npershelf@!16!g' aoe-revalidate.in
cc -Wall -O -g -o aoeping.o -c aoeping.c
cc -Wall -O -g -o linux.o -c linux.c
cc -Wall -O -g -o aoeping aoeping.o linux.o
make[1]: Leaving directory `/root/backuppc/aoe6-29/aoetools-9'
make -C /lib/modules/2.6.9-34.0.1.EL/build CONFIG_ATA_OVER_ETH=m EXTRA_CFLAGS="-DAOE_PARTITIONS=16" KDIR=/lib/modules/2.6.9-34.0.1.EL/build SUBDIRS="/root/backuppc/aoe6-29/linux/drivers/block/aoe" modules
make[1]: Entering directory `/usr/src/kernels/2.6.9-34.0.1.EL-i686'
CC [M] /root/backuppc/aoe6-29/linux/drivers/block/aoe/aoeblk.o
CC [M] /root/backuppc/aoe6-29/linux/drivers/block/aoe/aoechr.o
CC [M] /root/backuppc/aoe6-29/linux/drivers/block/aoe/aoecmd.o
CC [M] /root/backuppc/aoe6-29/linux/drivers/block/aoe/aoedev.o
CC [M] /root/backuppc/aoe6-29/linux/drivers/block/aoe/aoemain.o
CC [M] /root/backuppc/aoe6-29/linux/drivers/block/aoe/aoenet.o
LD [M] /root/backuppc/aoe6-29/linux/drivers/block/aoe/aoe.o
Building modules, stage 2.
MODPOST
CC /root/backuppc/aoe6-29/linux/drivers/block/aoe/aoe.mod.o
LD [M] /root/backuppc/aoe6-29/linux/drivers/block/aoe/aoe.ko
make[1]: Leaving directory `/usr/src/kernels/2.6.9-34.0.1.EL-i686'
Install directory is /lib/modules/2.6.9-34.0.1.EL/kernel/drivers/block/aoe
mkdir -p /lib/modules/2.6.9-34.0.1.EL/kernel/drivers/block/aoe
install -m 644 linux/drivers/block/aoe/aoe.ko /lib/modules/2.6.9-34.0.1.EL/kernel/drivers/block/aoe
/sbin/depmod -a
sh linux/Documentation/aoe/autoload.sh
+ cp linux/Documentation/aoe/udev.txt /etc/udev/rules.d//60-aoe.rules
cd aoetools-9 \
&& make install SBINDIR=/usr/sbin DEVDIR=/dev/etherd MANDIR=/usr/share/man NPERSHELF=16
make[1]: Entering directory `/root/backuppc/aoe6-29/aoetools-9'
+ sed -e 's!@devdir@!/dev/etherd!g' -e 's!@npershelf@!16!g' aoe-discover.in
+ sed -e 's!@devdir@!/dev/etherd!g' -e 's!@npershelf@!16!g' aoe-interfaces.in
+ sed -e 's!@devdir@!/dev/etherd!g' -e 's!@npershelf@!16!g' aoe-mkshelf.in
+ sed -e 's!@devdir@!/dev/etherd!g' -e 's!@npershelf@!16!g' aoe-revalidate.in
mkdir -p /usr/sbin
mkdir -p /usr/share/man/man8
+ install -m 700 aoe-discover /usr/sbin/aoe-discover
+ install -m 664 aoe-discover.8 /usr/share/man/man8/aoe-discover.8
+ install -m 700 aoe-interfaces /usr/sbin/aoe-interfaces
+ install -m 664 aoe-interfaces.8 /usr/share/man/man8/aoe-interfaces.8
+ install -m 700 aoe-mkshelf /usr/sbin/aoe-mkshelf
+ install -m 664 aoe-mkshelf.8 /usr/share/man/man8/aoe-mkshelf.8
+ install -m 700 aoe-revalidate /usr/sbin/aoe-revalidate
+ install -m 664 aoe-revalidate.8 /usr/share/man/man8/aoe-revalidate.8
+ install -m 700 aoe-mkdevs /usr/sbin/aoe-mkdevs
+ install -m 664 aoe-mkdevs.8 /usr/share/man/man8/aoe-mkdevs.8
+ install -m 700 aoe-stat /usr/sbin/aoe-stat
+ install -m 664 aoe-stat.8 /usr/share/man/man8/aoe-stat.8
+ install -m 700 aoeping /usr/sbin/aoeping
+ install -m 664 aoeping.8 /usr/share/man/man8/aoeping.8
make[1]: Leaving directory `/root/backuppc/aoe6-29/aoetools-9'
n_partitions=16 \
n_shelves=10 aoetools-9/aoe-mkdevs /dev/etherd

Next, I started the driver using the modprobe command.

[root@backup aoe6-29]# modprobe aoe

Finally, I checked the appliance status using the aoe-stat command.

[root@backup aoe6-29]# aoe-stat e1.0 400.088GB eth1 up
e1.1 400.088GB eth0 up
e1.2 400.088GB eth0 up
e1.3 400.088GB eth1 up
[root@backup aoe6-29]#

As a precaution, I restarted the system.