Monthly Status Updates/June 2007

This page is in progress: wiki changes are up to date; remainder is current through 6/26.

June saw the release of Amanda 2.5.2p1 on June 6, a patch release which was thoroughly tested with the help of the Platform Experts and many users from the mailing lists and forums. This patch release has proven quite stable, and development has shifted to feature development for the next release.

Community Choice Award

SourceForge, the open source hosting service which supports Amanda, announced its 2007 Community Choice Awards. Please vote for Amanda in the Best Tool or Utility for SysAdmins" category.

Wiki Changes

• Marc Muehlfeld provided a link to a useful script for performing backups of MySQL databases.
• Harald Schioeberg provided Lto-barcode, a perl script to generate barcode labels for LTO Tapes. Chris Hoogendyk suggested barcodewriter, a PostScript-based barcode utility, as a more general solution.
• Erik W wrote a detailed How To:Install Amanda Server on AIX.
• Harald Schioeberg provided Chg-multiplex, a wrapper to use multiple Amanda configs in a single restore operation.
• Paul Bijnens contributed a multitude of minor edits all over the wiki, increasing readability and clarity.
• Dustin J. Mitchell refactored Stefan G. Weichinger's file driver into How To:Set Up Virtual Tapes, FAQ:Should I use a holdingdisk when the final destination of the backup is a virtual tape?, How To:Migrate Virtual Tapes to Real Tapes, and How To:Restore from Virtual Tapes.

Forums Discussions

• tamiral asked several interesting questions:
  • How can I verify that AMANDA has successfully backed-up files? -- Shailen Patel suggested using amrecover to test a full restore, which is more thorough than the tape verification performed by amverify.
  • I'm concerned that because my defined tape size is larger than the amount of diskspace I have... -- Shailen Patel and Dustin J. Mitchell responded that yes, this could cause a problem, and referencing wiki pages describing the optimal configuration.
  • Basically, I'd rather use 'dd' for those kind of jobs (even unmount the filesystem so it won't change), but I guess I can't with AMANDA. What is the recommended dumptype for this kind of backup...? -- Paddy Sreenivasan suggested a dumptype with always-full, compression off, and encryption off.
• George Reeke had a client machine which exceeded Amanda's connect timeout because its hard drives took too long to spin up. Paddy Sreenivasan suggested increasing ctimeout and etimeout.
• Andrew Rakowski asked whether Amanda's bandwidth configuration variables are in bits or bytes per second. Gregory Grant responded that they are, indeed, bytes per second.
• ddenton encountered a series of issues of issues setting up a new Amanda installation. Kevin Till and Dustin J. Mitchell offered advice and pointers to documentation, updating the documentation where it was unclear.

Mailing List Discussions

amanda-users

• Jon LaBadie tried running amtapetype on a vtape, and the results spawned an interesting discussion on what amtapetype should do in such a situation.
• Robert P. McGraw, Chris Hoogendyk, and Brian Cuttler discussed the relative merits of hardware and software compression, noting that Amanda has a difficult time calculating the number of dumps it can fit on a tape when hardware compression is enabled.
• Marc Muehlfeld wondered how Amanda can fill a tape to more than 100% capacity. Cyrille Bollu and Paul Bijnens answered, pointing out that tapes differ in actual capacity, and that Amanda only uses the tapelength for planning purposes, but will happily consume any extra space it finds.
• Paul Crittenden discovered an error in the file-locking support detection, which caused Solaris builds of Amanda to use no file locking at all. Chris Hoogendyk, Jon LaBadie, Jean-Louis Martineau, and Dustin J. Mitchell chased down a solution.
• Alan Jedlow discovered a bug in chg-zd-mtx, which was fixed by Dustin J. Mitchell.
• Jordan Desroches had errors backing up a subdirectory of an NFS mount. Paul Bijnens, Dustin J. Mitchell, Olivier Nicole, and Jean-Louis Martineau contributed advice, eventually determining that the amanda user did not have adequate permissions on the subdirectory.
• "fedora" saw "file changed as we read it" in his backup report for MySQL data files. This triggered a lengthy discussion:
  • Oliver Nicole pointed out that this is just a "STRANGE" warning, not an error, and that it is caused by tar being unable to back up a large file while that file is changing.
  • Marc Muehlfeld, Bruce Thompson and Linda Pahdoco offered pointers to scripts for backing up MySQL databases via mysqldump or mysqlhotcopy.
  • Dustin J. Mitchell pointed out that ZRM for MySQL is designed to back up MySQL databases without making textual dumps.
• Jean-Francois Malouin had trouble with estimates timing out after 6 hours. Jean-Louis Martineau provided a patch to reset this limit for each estimate.
• Sebastian Marten asked about the relationship of runtapes to tape_splitsize. Marc Muehlfeld replied to say that splitting dumps across tapes is impossible with only one tape (runtapes=1). Sebastian does not have a changer, but nightly backups are larger than his media (DVD-RAM), so Marc suggested using multiple DVD drives, spooling some dumps to holding and flushing between dumps, or using chg-manual to use two DVD-RAMs per dump.
• Charlie Reitsma asked if any work had been done on migrating dumps from vtapes to real tapes. Dustin Mitchell, Gene Heskett, and Jon LaBadie replied with some pointers, and Charlie started work on an implementation to suit his needs.
• Sebastian Marten asked about the relationship of tape_splitsize and runtapes. In ensuing discussion with Marc Muehlfeld showed that dump splitting is only effective with runtapes greater than one, and thus requires a changer.
• Harald Schioeberg had trouble with Amanda not finishing when /tmp was full. Dustin J. Mitchell pointed out that many of the external programs on which Amanda relies use /tmp, and that the failure most likely occurred there.
• Glenn Gillis had trouble with estimates failing on a partition with a very large, constantly changing file. Kevin Till and Oliver Nicole agreed that this was a result of a bad tar version returning an incorrect status.
• Philip Weber sparked an interesting conversation about Amanda automatically detecting disks that are not in Amanda's disklist and thus are not being backed up. While the problem is difficult to solve in the general case, a few specific solutions were suggested as wrappers around Amanda.
• Fedora had trouble getting client-server communication to work, and the eventual resolution was that host-based firewalls like netfilter and iptables can interfere with Amanda's communication.
• Rudy Setiawan asked for advice setting up a large disk-to-disk configuration, and prompted a lengthy discussion about calculating space requirements of a configuration, optimizing a system for fast disk-to-disk backups, and ensuring sufficient redundancy for backup data in such a configuration. Chris Hoogendyk hijacked the thread to consider ways of running incremental backups only over a weekend.

amanda-hackers

• Ladislav Michnovic alerted amanda-hackers to a regression in SUSE Linux, reported by Matthias Andree, relating to multihomed machines. The issue has stalled without any feedback from Matthias.

Code Development

• Jean-Louis Martineau
  • fixed a bug discovered by Marc Muehlfeld where hosts running in a mixed IPv4/IPv6 environment would encounter errors (r397)
  • fixed a bug discovered by Christopher McCrory where amfetchdump sent messages to stdout, corrupting the resulting tarfiles (r410)
• Dustin J. Mitchell
  • streamlined the handling of exit statuses from the programs Amanda invokes (r420)
  • fixed broken file-locking support on Solaris, as reported by Paul Crittenden (r422)
  • clarified the error message resulting from incorrect entries in .amandahosts (r423)
• Franz Fischer submitted a patch to make amtapetype close the tape device after rewinding, to work around a hardware/OS bug on his system. The patch was modified and committed by Jean-Louis Martineau (r416)