Difference between revisions of "Server Dell PowerEdge T410"

From YobiWiki
Jump to navigation Jump to search
m
 
(37 intermediate revisions by 2 users not shown)
Line 3: Line 3:
   
 
==Install notes==
 
==Install notes==
===Basis===
+
===BIOS===
* In BIOS
 
 
** Activate Virtualization support
 
** Activate Virtualization support
 
** Power Management -> OS Control
 
** Power Management -> OS Control
 
** Report kbd errors: NO
 
** Report kbd errors: NO
  +
===Debian Squeeze===
* Installing squeeze (frozen but still testing) [http://cdimage.debian.org/cdimage/daily-builds/daily/arch-latest/amd64/iso-cd/debian-testing-amd64-netinst.iso from daily image] (17/08/2010)
 
  +
Still testing at time of writing but frozen so almost stable ;-)
  +
* Installing squeeze [http://cdimage.debian.org/cdimage/daily-builds/daily/arch-latest/amd64/iso-cd/debian-testing-amd64-netinst.iso from daily image] (17/08/2010)
 
** Complains about missing bnx2/bnx2-mips-09-5.0.0.j3.fw & bnx2/bnx2-rv2p-09-5.0.0.j3.fw
 
** Complains about missing bnx2/bnx2-mips-09-5.0.0.j3.fw & bnx2/bnx2-rv2p-09-5.0.0.j3.fw
 
*** Get it on another machine and put it on USB stick: aptitude install firmware-bnx2 ; cp /lib/firmware/bnx2/bnx2-*-09-5.0.0.j3.fw /media/XXXX
 
*** Get it on another machine and put it on USB stick: aptitude install firmware-bnx2 ; cp /lib/firmware/bnx2/bnx2-*-09-5.0.0.j3.fw /media/XXXX
 
*** Actually I had also an additional Intel network card so I could have skipped this step...
 
*** Actually I had also an additional Intel network card so I could have skipped this step...
** Partitionning: <br>there is a first primary partition for Dell Utilities (FAT16), I left it just in case...; <br>there is also a second primary partition: 2Gb of FAT32, empty, so I deleted it. <br>partition #2: primary 10Gb ext3 / label=ROOT<br>partition #3: primary 16Gb swap<br>partition #5: logical 2Tb physical volume for LVM<br>Configure LVM / ok to write table / Create VG with sda5, called DATA
+
** Partitionning: <br>there is a first primary partition for Dell Utilities (FAT16), I left it just in case...; <br>there is also a second primary partition: 2Gb of FAT32, empty, so I deleted it. <br>partition #2: primary 10Gb ext3 / label=ROOT<br>partition #3: primary 16Gb swap<br>partition #5: logical 2Tb physical volume for LVM<br>Configure LVM / ok to write table / Create VG with sda5, called vg0 (will be used by XEN)
 
** Tasksel: SSH & standard utilities
 
** Tasksel: SSH & standard utilities
 
** Reboot
 
** Reboot
 
* SSH: PermitRootLogin no / ssh-copy-id ...
 
* SSH: PermitRootLogin no / ssh-copy-id ...
* Install mc, sudo (adduser xxx sudo)
+
* Install mc, screen, sudo (adduser xxx sudo)
 
* Renaming interfaces (always easier to remember what's plugged where...)
 
* Renaming interfaces (always easier to remember what's plugged where...)
 
** à la ifrename
 
** à la ifrename
Line 28: Line 29:
 
*** actually we don't need ifrename because udev is now doing the same, see /etc/udev/rules.d/70-persistent-net.rules, you can simply change the NAME key
 
*** actually we don't need ifrename because udev is now doing the same, see /etc/udev/rules.d/70-persistent-net.rules, you can simply change the NAME key
 
** Be sure the old name is not used anywhere else in your config, typically in /etc/network/interfaces
 
** Be sure the old name is not used anywhere else in your config, typically in /etc/network/interfaces
===XEN===
+
==Xen==
  +
===Installation===
* see [http://wiki.debian.org/Xen notes on Debian wiki]
 
  +
See [[Xen]] Installation notes
* aptitude install linux-image-2.6.32-5-xen-amd64 xen-tools xen-utils
 
  +
* backup /etc/xen/xend-config.sxp
 
  +
Edit /etc/default/xendomains and change XENDOMAINS_SAVE=/var/lib/xen/save to:
* edit /etc/xen/xend-config.sxp, and uncomment line "(network-script network-bridge)" or for a non-default interface ethX: "(network-script 'network-bridge netdev=ethX')"
 
  +
XENDOMAINS_SAVE=""
* reboot
 
  +
===Sagemath guest===
* aptitude remove --purge linux-image-2.6.32-5-amd64 linux-image-2.6-amd64
 
  +
* xen-create-image --hostname=sagemath --memory=12G --swap=12G --vcpus=20
* /etc/default/grub => GRUB_DEFAULT=2
 
  +
* lvm> lvcreate -L 1000G -n sagemath-data vg0
* update-grub
 
  +
* /etc/xen/sagemath.cfg: add data volume:
* reboot
 
  +
root = '/dev/xvda2 ro'
* cat /proc/xen/capabilities #(to check xend is running)
 
  +
disk = [
* Edit the config file for creating images (/etc/xen-tools/xen-tools.conf) to your needs:
 
  +
'phy:/dev/vg0/sagemath-disk,xvda2,w',
<source lang=diff>
 
  +
'phy:/dev/vg0/sagemath-swap,xvda1,w',
--- xen-tools.conf.orig 2010-05-30 22:42:25.000000000 +0200
 
  +
+ 'phy:/dev/vg0/sagemath-data,xvda3,w',
+++ xen-tools.conf 2010-08-17 17:47:35.000000000 +0200
 
  +
]
@@ -52,7 +52,7 @@
 
  +
# LVM volume group here instead
 
  +
* mkdir -p /etc/xen/auto
#
 
  +
* ln -s /etc/xen/sagemath.cfg /etc/xen/auto
##
 
  +
* xm create -c /etc/xen/sagemath.cfg
-# lvm = vg0
 
  +
* Hook the data drive as /home
+lvm = vg0
 
  +
** mkfs.ext4 /dev/xvda3
 
  +
** In /etc/fstab: /dev/xvda3 /home ext4 noatime,nodiratime,errors=remount-ro 0 1
 
  +
** mount /home
#
 
  +
* Install sage
@@ -125,12 +125,12 @@
 
  +
** apt-get install aria2
# Disk and Sizing options.
 
  +
** cd /opt
##
 
  +
** aria2c http://www.sagemath.org/mirror/linux/64bit/meta/sage-4.5.2-linux-64bit-ubuntu_10.04_lts-x86_64-Linux.tar.lzma.metalink
#
 
  +
** tar x --lzma -f sage-4.5.2-linux-64bit-ubuntu_10.04_lts-x86_64-Linux.tar.lzma
-size = 4Gb # Disk image size.
 
  +
** cd sage-4.5.2-linux-64bit-ubuntu_10.04_lts-x86_64-Linux
+size = 8Gb # Disk image size.
 
  +
** Edit sage and set SAGE_ROOT="/opt/sage-4.5.2-linux-64bit-ubuntu_10.04_lts-x86_64-Linux"
memory = 128Mb # Memory size
 
  +
** ./sage
swap = 128Mb # Swap size
 
  +
** sage> notebook.setup()<br>Provide FQDN for TLS certificate generation
# noswap = 1 # Don't use swap at all for the new system.
 
  +
===Backuppc guest===
fs = ext3 # use the EXT3 filesystem for the disk image.
 
  +
* xen-create-image --hostname=backuppc --memory=1G --swap=1G --vcpus=20
-dist = `xt-guess-suite-and-mirror -s` # Default distribution to install.
 
  +
* lvm> lvcreate -L 200G -n backuppc-data vg0
+dist = squeeze # Default distribution to install.
 
  +
* /etc/xen/backuppc.cfg: fix MAC address if needed and add data volume:
image = sparse # Specify sparse vs. full disk images.
 
  +
root = '/dev/xvda2 ro'
 
  +
disk = [
#
 
  +
'phy:/dev/vg0/backuppc-disk,xvda2,w',
@@ -166,7 +166,7 @@
 
  +
'phy:/dev/vg0/backuppc-swap,xvda1,w',
#
 
  +
+ 'phy:/dev/vg0/backuppc-data,xvda3,w',
# Uncomment this if you wish the images to use DHCP
 
  +
]
#
 
  +
-# dhcp = 1
 
  +
* mkdir -p /etc/xen/auto
+dhcp = 1
 
  +
* ln -s /etc/xen/backuppc.cfg /etc/xen/auto
 
  +
* xm create -c /etc/xen/backuppc.cfg
 
  +
* Hook the data drive as /home
##
 
  +
** mkfs.ext4 /dev/xvda3
@@ -254,10 +254,10 @@
 
  +
** In /etc/fstab: /dev/xvda3 /home ext4 noatime,nodiratime,errors=remount-ro 0 1
#
 
  +
** mount /home
# You may specify the things to use here:
 
  +
* Install backuppc
#
 
  +
** apt-get install backuppc
-# serial_device = hvc0 #default
 
  +
See also [[BackupPc]] for installation notes
+serial_device = hvc0 #default
 
  +
* /etc/init.d/backuppc stop
# serial_device = tty1
 
  +
* mv /var/lib/backuppc /home
#
 
  +
* ln -s /home/backuppc /var/lib
-# disk_device = xvda #default
 
  +
+disk_device = xvda #default
 
  +
==Misc notes==
# disk_device = sda
 
  +
===Boot & DHCP===
#
 
  +
I've still sometimes some issues at boot time when the xenbr0 bridge doesn't catch its IP...
</source>
 
  +
<br>In those cases I find dhclient still hooked to the non-existing bnx1 IF (which was renamed pbnx1 by XEN). I've to kill it and start a similar dhclient on IF xenbr0.
# xen-create-image --hostname my-xen1 --dhcp --dir /home/s1-xen1/
 
  +
<br>Finally I renamed the default interface as eth0 and called the xen bridge script without parameters: (network-script network-bridge)
  +
  +
===Hyperthreading===
  +
I'm not sure if in the long run it'll help but given that there are already 12 CPUs, I've disabled the logical CPU support in the BIOS.
  +
===SSH===
  +
Connecting directly as root is useful e.g. to run X11 programs such as xenwatch, xenstore-gtk and a local root password is usually needed for local console access but I don't' want to leave ssh+root+pwd so, edit /etc/ssh/sshd_config:
  +
PermitRootLogin yes
  +
Match User root
  +
PasswordAuthentication no
  +
PubkeyAuthentication yes

Latest revision as of 11:13, 7 April 2011

Manuals

  • here, online version of the main manual here with chapter on LED status here

Install notes

BIOS

    • Activate Virtualization support
    • Power Management -> OS Control
    • Report kbd errors: NO

Debian Squeeze

Still testing at time of writing but frozen so almost stable ;-)

  • Installing squeeze from daily image (17/08/2010)
    • Complains about missing bnx2/bnx2-mips-09-5.0.0.j3.fw & bnx2/bnx2-rv2p-09-5.0.0.j3.fw
      • Get it on another machine and put it on USB stick: aptitude install firmware-bnx2 ; cp /lib/firmware/bnx2/bnx2-*-09-5.0.0.j3.fw /media/XXXX
      • Actually I had also an additional Intel network card so I could have skipped this step...
    • Partitionning:
      there is a first primary partition for Dell Utilities (FAT16), I left it just in case...;
      there is also a second primary partition: 2Gb of FAT32, empty, so I deleted it.
      partition #2: primary 10Gb ext3 / label=ROOT
      partition #3: primary 16Gb swap
      partition #5: logical 2Tb physical volume for LVM
      Configure LVM / ok to write table / Create VG with sda5, called vg0 (will be used by XEN)
    • Tasksel: SSH & standard utilities
    • Reboot
  • SSH: PermitRootLogin no / ssh-copy-id ...
  • Install mc, screen, sudo (adduser xxx sudo)
  • Renaming interfaces (always easier to remember what's plugged where...)
    • à la ifrename
      • aptitude install ifrename
      • Create /etc/iftab then reboot
intelG mac 00:1b:21:xx:xx:xx
intelD mac 00:1b:21:xx:xx:xx
bcm1   mac 84:2b:2b:xx:xx:xx
bcm2   mac 84:2b:2b:xx:xx:xx
    • à la udev
      • actually we don't need ifrename because udev is now doing the same, see /etc/udev/rules.d/70-persistent-net.rules, you can simply change the NAME key
    • Be sure the old name is not used anywhere else in your config, typically in /etc/network/interfaces

Xen

Installation

See Xen Installation notes

Edit /etc/default/xendomains and change XENDOMAINS_SAVE=/var/lib/xen/save to:

XENDOMAINS_SAVE=""

Sagemath guest

  • xen-create-image --hostname=sagemath --memory=12G --swap=12G --vcpus=20
  • lvm> lvcreate -L 1000G -n sagemath-data vg0
  • /etc/xen/sagemath.cfg: add data volume:
 root        = '/dev/xvda2 ro'
 disk        = [
                   'phy:/dev/vg0/sagemath-disk,xvda2,w',
                   'phy:/dev/vg0/sagemath-swap,xvda1,w',
+                  'phy:/dev/vg0/sagemath-data,xvda3,w',
               ]
  • mkdir -p /etc/xen/auto
  • ln -s /etc/xen/sagemath.cfg /etc/xen/auto
  • xm create -c /etc/xen/sagemath.cfg
  • Hook the data drive as /home
    • mkfs.ext4 /dev/xvda3
    • In /etc/fstab: /dev/xvda3 /home ext4 noatime,nodiratime,errors=remount-ro 0 1
    • mount /home
  • Install sage

Backuppc guest

  • xen-create-image --hostname=backuppc --memory=1G --swap=1G --vcpus=20
  • lvm> lvcreate -L 200G -n backuppc-data vg0
  • /etc/xen/backuppc.cfg: fix MAC address if needed and add data volume:
 root        = '/dev/xvda2 ro'
 disk        = [
                   'phy:/dev/vg0/backuppc-disk,xvda2,w',
                   'phy:/dev/vg0/backuppc-swap,xvda1,w',
+                  'phy:/dev/vg0/backuppc-data,xvda3,w',
               ]
  • mkdir -p /etc/xen/auto
  • ln -s /etc/xen/backuppc.cfg /etc/xen/auto
  • xm create -c /etc/xen/backuppc.cfg
  • Hook the data drive as /home
    • mkfs.ext4 /dev/xvda3
    • In /etc/fstab: /dev/xvda3 /home ext4 noatime,nodiratime,errors=remount-ro 0 1
    • mount /home
  • Install backuppc
    • apt-get install backuppc

See also BackupPc for installation notes

  • /etc/init.d/backuppc stop
  • mv /var/lib/backuppc /home
  • ln -s /home/backuppc /var/lib

Misc notes

Boot & DHCP

I've still sometimes some issues at boot time when the xenbr0 bridge doesn't catch its IP...
In those cases I find dhclient still hooked to the non-existing bnx1 IF (which was renamed pbnx1 by XEN). I've to kill it and start a similar dhclient on IF xenbr0.
Finally I renamed the default interface as eth0 and called the xen bridge script without parameters: (network-script network-bridge)

Hyperthreading

I'm not sure if in the long run it'll help but given that there are already 12 CPUs, I've disabled the logical CPU support in the BIOS.

SSH

Connecting directly as root is useful e.g. to run X11 programs such as xenwatch, xenstore-gtk and a local root password is usually needed for local console access but I don't' want to leave ssh+root+pwd so, edit /etc/ssh/sshd_config:

PermitRootLogin yes
Match User root
 PasswordAuthentication no
 PubkeyAuthentication yes