Todo - Spring 2013

The following list of items should ideally be accomplished during spring break. If you are interested in working on a task below, please add your name in the space provided. Items highlighted in red need downtime notification provided to users at least 24 hours in advance of maintenance.

General Notes

Downtime notifications for items highlighted in Red should be posted via Iodine at least 24 hours in advance (but ideally as soon as possible). They should include both a start time and estimated end time. Be generous when estimating end-times :).

In general, a good pattern to follow when updating systems is: Reboot, Update, Reboot again, Verify. This way you are sure that the system is in working order before beginning work. The Verify step is also very important to make sure that you leave systems in working order :).

You should also make sure you have a current backup (If the system is running Guardian, check /root/scripts/backup.log to make sure the last backup is current and successful).

For paired/redundant systems (eg: casey/smith or ns1/ns2), there should be at least 24 hours between the maintenance windows for the two servers to allow time for any subtle problems to surface.

Updates

VM Servers

Antipodes (Peter Foley)

• update system software
• update system kernel to 3.4.0 (from git)

Galapagos (David Rogers)

• update system software
• update system kernel to 3.4.0 (from git)

Vega

• update system software
• update system kernel to 3.4.0 (from git)

Waitaha (Peter Foley)

• update system software
• downgrade system kernel to 3.4.0 (from git, to match remaining VMs/Servers)
• configure nagios monitoring
• configure backups

Other Servers

Agni (James Forcier)

NOTE: After Scylla/Nebula

• update system to OpenBSD 5.2
• configure automatic encrypted backups

Betelgeuse

• Scrub nalgene and bubbles zpools

Dulles (David Rogers)

• scrub skillet zpool(s) (See also, Seatac)

Fiordland

• reinstall fiordland as a testing Gentoo Hardened/SELinux Server

Littleblue

• install as a KVM VM Server
• configure nagios monitoring
• configure backups

Nebula (Fox Wilson)

• reinstall to setup RAID / fix disk space issue (see below disk space layout) (Done on March 25 2013 by 2016fwilson)
• finish configuring as slave KDC (should be Done on March 25 2013 by 2016fwilson)
• configure nagios monitoring
• configure automatic encrypted backups

Partition Layout: a - 1GB / b - 1GB swap d - 2GB /tmp e - 4GB /var f - 5GB /usr g - 1GB /usr/X11R6 h - 4GB /usr/local i - 2GB /usr/src j - 2GB /usr/obj k - 8GB /home

Rockhopper (Peter Foley)

• update system software
• reinstall SPL/ZFS via portage (use latest Release Candidate)
• scrub guardian2 zpool

Royal

• scrub fryingpan and dutchoven zpools

Scylla (James Forcier)

• update system to OpenBSD 5.2
• configure automatic encrypted backups

Seatac

• scrub skillet zpool(s) (See also, Dulles)

Weather (Michael Smith)

• update system software

VMs

bugs (David Rogers)

• update system software
• update VM Kernel to enable memory ballooning
• update bugzilla software (via webapp)

casey

NOTE: casey should be removed from the mail.tjhsst.edu round-robin while being updated; Be sure to account for the TTL when doing so

• update system software
• update VM Kernel to enable memory ballooning

cups2 (Michael Smith)

• update system software
• update VM Kernel to enable memory ballooning

haimageserver (James Forcier)

• update system software
• update VM Kernel to enable memory ballooning

Iodine (David Rogers)

• update system software
• update VM Kernel to enable memory ballooning

iodine-ldap (Andrew Hamilton)

• update system software
• update VM Kernel to enable memory ballooning

license (Michael Smith)

• update system software
• update VM Kernel to enable memory ballooning
• update mathlm licensing manager for Mathematica 9.0.1

lists

• reinstall system with Gentoo Linux
• migrate mailing lists/configurations to new system

monitor (Michael Smith)

• update system software
• update VM Kernel to enable memory ballooning
• configure update monitoring

mysql1

• update system software
• update VM Kernel to enable memory ballooning

ns1 (James Forcier)

• update system software
• update VM Kernel to enable memory ballooning

ns2 (James Forcier)

• update system software
• update VM Kernel to enable memory ballooning

openldap1

NOTE: openldap2 should hold the ldap-sun service IP while openldap1 is being updated

• update system software
• update VM Kernel to enable memory ballooning

openldap2

NOTE: openldap1 should hold the ldap-sun service IP while openldap2 is being updated

• update system software
• update VM Kernel to enable memory ballooning

openvpn (David Rogers)

• update system software
• update VM Kernel to enable memory ballooning

smith (David Rogers)

NOTE: smith should be removed from the mail.tjhsst.edu round-robin while being updated; Be sure to account for the TTL when doing so

• update system software
• update VM Kernel to enable memory ballooning

stage64 (Michael Smith)

• update system software
• update VM Kernel to enable memory ballooning

www (James Forcier)

• update system software
• update VM Kernel to enable memory ballooning
• update Roundcube (via webapp)

Other

Workstations (James Forcier)

• update system software
• investigate ways to block user shutdowns

Nagios

• find/write a plugin to monitor physical server status (PSUs, HDDs, etc) via iLO/LOM
• Fix parent/child relationships
• Migrate legacy root diskspace checks to generic diskspace check
• remove retired/testing servers