Mysql-zrm-reporter: Difference between revisions

From wiki.zmanda.com
Jump to navigation Jump to search
No edit summary
No edit summary
 
(28 intermediate revisions by the same user not shown)
Line 1: Line 1:
==NAME==
==NAME==


mysql-zrm-reporter - MySQL backup reporting tool.
mysql-zrm-reporter - ZRM for MySQL backup reporting utility.


==SYNOPSIS==
==SYNOPSIS==
mysql-zrm-reporter [--fields <name1,name2,name3 ....>]
 
                    [--destination <dir> ]
  mysql-zrm-reporter [--fields name1, name2, name3, name4, name5 ....]
                    [--where  <fieldname=value>]
                      [--destination dir ]
                    [--type  html]
                      [--where  fieldname=value]
                    [--output <filename>]
                      [--type  html]
                    [--show   <backup-method-info | backup-status-info |
                      [--output filename]
                      backup-retention-info | backup-performance-info |
                      [--latest ]
                      restore-full-info | restore-incr-info | replication-info> ]
                      [--noheader ]
                    [--help]
                      [--show backup-method-info |
                                backup-status-info |
                                backup-retention-info |
                                backup-performance-info |
                                restore-full-info |
                                restore-incr-info |
                                replication-info |
                                backup-app-performance-info ]
                      [--help]


==DESCRIPTION==
==DESCRIPTION==


This tool is  part  of Zmanda Recovery Manager for MySQL (MySQL ZRM). This tool can be used to provide reports about  various MySQL database backup run parameters.
mysql-zrm-reporter  utility  provides pre-defined  and user-defined reports about various MySQL database backup runs. The reports can be in text or HTML format. Backup report can be sent as a RSS feed.


===BACKUP INFORMATION===
Backup        reports        can        be      configured      using ''/etc/mysql-zrm/mysql-zrm-reporter.conf''  file  parameters.  For  supported formats, see [[mysql-zrm-reporter.conf]](5).


The list of information available for each backup run:
ZRM  for MySQL configuration file, [[mysql-zrm.conf]](5) file contains HTML configuration  and  RSS    feed    configuration    parameters    for mysql-zrm-reporter      utility.      The     list     of mysql-zrm-reporter parameters are:


; backup-date : Date and time stamp of backup run.
;html-report-directory : Set the directory where  text/HTML  reports  are written. This parameter        is        optional.      Example: /var/www/html/mysql-zrm-reports/


; mysql-version : MySQL server version.
; html-reports : List of pre-defined report(s) to be  generated  after  a  backup run. Example: backup-status-info


; backup-directory : The location of backup directory.
; webserver-url : RSS  feeds  URL  of directory under document root of the web server. If this  value  is  not  specified  in  the [[mysql-zrm.conf]](5) configuration  file,  RSS  feeds will not be generated. Example: <nowiki>http://backupserver.company.com/reports/ </nowiki>


; backup-level : Lists the backup-level of this backup. It will be 0 for a full backup and 1 for an incremental backup.
; rss-header-location : The location of RSS feed properties file  contain ing  RSS  feed channel  and  item properties. This parameter must be provided if webserver-url is  specified. Example:  /etc/mysql-zrm/RSS.header


; raw-databases : List of databases backed up using mysqlhotcopy. If ''raw-tables'' parameter is present, this will have only one database listed.
===BACKUP INFORMATION===


; raw-tables : List of tables backed up using mysqlhotcopy. Refer to the ''raw-databases'' to find the name of the database these tables belongs to. This parameter will have valid values only if ''--tables'' parameter was specified for the backup run.
Each backup run generates the following information about the backup:
 
; raw-databases-snapshot : List of databases backed up using lvm snapshots.
 
; raw-tables-snapshot : List of tables backed up using mysqlhotcopy.  Refer to the ''raw-databases-snapshot'' to find the name of the database these tables belongs to.
 
; backup-time : Time taken for the complete backup run.  Format is HH:MM:SS
 
; read-locks-time : Time during which the read lock is held for each backup run. Format is HH:MM:SS
 
; flush-logs-time : Time for flushing database pages to the disk.  Format is HH:MM:SS
 
; backup-size : The size of data (in megabytes) backed up in the backup run.
 
; backup-status : Gives  the status  of the backup run. It can have 3 values. The values  can be "Backup Failed" which indicates that there  was  a fatal  error,  "Backup  done  with  errors"  which indicates that there was some error during backup.  Some  of  the databases and tables were probably backed up and "Backup succeeded" which indicates that the backup run was completed successfully.
 
; logical-databases : List of databases backed up using mysqldump(1).
 
; logical-tables : List of  tables  belonging  to  ''logical-databases'' backed up  using mysqldump(1.     
 
; replication : List of names  of  the replication files backed up namely master.info and relay-log.info


; backup-date : Date and time stamp of backup run.
; mysql-version : MySQL server version.
; backup-directory : The location of backup directory.
; backup-level : Lists the backup-level - 0 for a  full  and  1  for incremental backup.
; raw-databases : List  of  databases  backed up using mysqlhotcopy.  If raw-tables parameter is  present,  this  will  have  only  one database listed.
; raw-tables : List  of  tables backed up using mysqlhotcopy.  The name  of  the database these tables  belong  to  is  found  under raw-databases.
; raw-databases-snapshot : List  of  databases  backed up using snapshots.  When raw-tables parameter is specified, this  will  list  only  one database.
; raw-tables-snapshot : List  of  tables backed up using mysqlhotcopy.  The name  of  the database these tables  belong  to  is  found  under raw-databases.
; backup-time : Time  taken  for the complete backup run. Format is HH:MM:SS
; read-locks-time : Time  read  lock  was  held  during  the  backup run. Format is HH:MM:SS
; flush-logs-time : Time  for flushing database pages to the disk. Format is HH:MM:SS
; backup-size : The size, in megabytes, of data backed up.
; backup-status : Status  has three  values.  "Backup  Failed"  value means that there was  a fatal error. "Backup done with errors" means that  though there was some error during backup but some of  the databases and tables were probably backed up. "Backup  succeeded" means  that the backup run was completed successfully.
; logical-databases : List  of  databases  backed  up using mysqldump(1).  When -tables parameter  is  specified,  this  will  only  one database.
; logical-tables : List  of  tables  belonging  to  logical-databases backed  up  using mysqldump(1). The name of the database these tables belong to is found under -databases.
; replication : List of  replication  files  backed  up  namely master.info  and relay-log.info
; slave-load-files : Names of SQL_LOAD* files that were backed up.
; slave-load-files : Names of SQL_LOAD* files that were backed up.
; incremental : Names of the binary log files backed up.
; incremental : Names of the binary log files backed up.
; backup-set :  Name of the backup set this backup belongs to.
; comment : Comment  about  the  backup  added  by  the administrator in the [[mysql-zrm.conf]](5) file.
; retention-policy : Backup image will be retained for the  time  specified as  parameter  in  Days/Weeks/Months/Years.  For  example: if the value is "10D" means the backup image will  be  retained  10 days  from  the backup-date.  This  policy  assumes  365 days in a year and 30 days in a month.
; compress : Specifies that the backup was  compressed.  Default compression method  is  gzip  program.  The  program used for compression is value for this parameter.
; encrypt : Program used for encryption if the backups are  encrypted.
; host : Hostname of the MySQL server that was backed up.
; compress-encrypt-time : Time  taken  by  compression  and/or  encryption.  This  time  is included in the backup time
; innodb-data : List of InnoDB shared data files backed up.
; innodb-logs : List of InnoDB logs backed up.


; backup-set : Lists the backup-set this backup belongs to.
==OPTIONS==


; comment : Comment about the backup  added  by  the administrator in the [[mysql-zrm.conf]](5) file.
      --show    backup-method-info  |  backup-status-info    | backup-retention-info |
                backup-performance-info    |    restore-info    | selective-restore-info |
                replication-info


; retention-policy : Backup data retention policy. Backup image will be retained for the  time specified as parameter. Time value can be in Days/Weeks/Months/Years.   For example: if  the value is "10D" means the backup  image  will  be  retained 10 days from the backup-date. 365 days  in  a  year and 30 days in a month are assumed.
To display predefined reports set this optionThe predefined reports, and what they contain, are listed below:


==OPTIONS==
; backup-status-info  :  backup-set,  backup-date, backup-level, backup-status,  backup  comment
; backup-method-info : backup-set, raw-databases, raw-databases, logical-databases
; backup-retention-info  :  backup-set,  backup-date, backup-level, backup-size, retention-policy
; backup-performance-info : backup-set,  backup-date, backup-level, backup-size, backup-size-compressed,    backup-time,  compress-encrypt-time
; backup-app-performance-info  :  backup-set, backup-date, backup-level,              backup-size,backup-time, read-locks-time, flush-logs-time
; restore-info    :    backup-set,    backup-date, backup-level, backup-directory, backup-status, comment
; selective-restore-info :  backup-set,  backup-date, incremental
; replication-info  :    backup-set,    backup-date, replication, slave-load-files


; --destination <dir> : Specify the backup root directory. This   parameter is  optional and default value is ''/var/lib/mysql-zrm''
; --destination dir : Set  the backup root directory. This parameter is  optional.  Default value is /var/lib/mysql-zrm


; --fields <name1,name2,name3...> : Specify list of  backup parameters to display.  List of valid               field names are described in [[#BACKUP  INFORMATION|BACKUP INFORMATION]] section.  This               field   is   optional. If  specific fields are not specified in the command line, ''backup-set'', ''backup-date'', ''backup-directory'', ''backup-level'', ''backup-status'' are displayed by default.
; --fields name1,name2,name3... : Set  the  list of  backup parameters to display.  List of valid field names are described in BACKUP INFORMATION section.  This field           is           optional. By default ''backup-set,backup-date,backup-level,backup-status,comment'' are displayed.  Spaces  are  not  allowed with  in  the parameter name list.  If  spaces  must  be  used, list must within quotes.


; --where <fieldname=value> : The tool will display the  MySQL backup parameters where the               ''field name'' matches ''value''. This field is optional.
; --where fieldname=value : The utility will display the MySQL backup parameters where the field name matches value. This field is optional.


; --type html : Output format of the report will be HTML.
; --type html : Report will be in HTML format.


; --output <filename> : Tool output will be written to ''filename''.
; --output filename : HTML  report  will  be  written to filename under "html" directory and text reports will be written to filename  under "text" direc- tory.    By  default, these directories are created under the current working directory.  The utility  allows  users to  specify explicit  directory  location  for  reports  in [[mysql-zrm.conf]](5) using "html-report-directory" parameter.  If  this parameter  is set,  then the utility will create "html-report-directory" directory (if it does  not  exist)  and  output   report with  name  file name  will be written to "html" and/or "text" sub-directory under "html-report-directory" path.


; --show <backup-method-info | backup-status-info |  backup-retention-info | backup-performance-info  | restore-full-info  | restore-incr-info | replication-info > : This option displays predefined  reports  based  on the option. The list of reports that are available are:
; --latest : Report about the most recent backup run.


backup-status-info : backup-set,backup-date,backup-level,backup-status, backup comment
; --noheader : Generate TEXT reports with no page header, This option will be ignored for HTML reports.
backup-method-info : backup-set,raw-databases,raw-databases,logical-databases 
backup-retention-info : backup-set,  backup-date, backup-level,backup-size,retention-policy
backup-performance-info : backup-set, backup-date, backup-level, backup-size, backup-time, read-locks-time, flush-logs-time
restore-full-info : backup-set, backup-date, backup-level,backup-directory
restore-incr-info : backup-setbackup-date, incremental 
replication-info  : backup-set, backup-date, replication,slave-load-files


; --help : Display help message and exit.
; --help : Displays help message and exits.


==EXAMPLES==
==EXAMPLES==
     
Following command displays backup date, location of  backups, backup set name: 
mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup \
                    --fields backup-date,backup-directory,backup-set


Following command displays size  of  backup, backup set name, and date of backup:
* To  display backup date, location of backups, and backup set name use:
mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup \
  mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup  --fields backup-date,backup-directory,backup-set
                    --fields backup-date,backup-set,backup-size
 
* To  display  backup  date,  backup  set  name,  and size of backup use:
  mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup  --fields backup-date,backup-set,backup-size
 
* To  display  size  of  backup, backup set name, and date of backup for"config1"    backup    set    use:
  mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup       --fields     backup-date, backup-set, backup-size --where backup-set=config1


Following command displays size of backup, backup set name, and date of backup for "config1" backup  set:
* To display backup  status  report for "config1" backup  set   use:
mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup \
  mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup   --show backup-status-info --where backup-set=config1
                    --fields backup-date,backup-set,backup-size \
                    --where backup-set=config1


Following command displays backup status report for "config1" backup set:          
* To display backup status report for "config1" backup set in HTML format and    write    a    file    use:
mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup \
                    --show backup-status-info \
                    --where backup-set=config1


Following command displays backup status report for "config1" backup set in HTML format and write the output to a file:
  mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup --show backup-status-info     --where backup-set=config1 --type html --output myreport.html
mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup \
                    --show backup-status-info --where backup-set=config1 \
                    --type html --output myreport.html




==FILES==
==FILES==
; /var/lib/mysql-zrm : Directory under which all backup data is stored.
; /var/lib/mysql-zrm : Directory under which all backup data is stored.


; /etc/mysql-zrm/mysql-zrm-reporter.conf : Configuration file read by mysql-zrm-reporter tool.
; /etc/mysql-zrm/mysql-zrm-reporter.conf : Configuration file read by mysql-zrm-reporter utility.


==RETURN VALUES==
==RETURN VALUES==
On success, zero is returned. On error,non-zero value is returned.
 
On success, zero is returned. On error, non-zero value is returned.  Output  messages  are written to STDOUT and error messages are to STDERR.


==SEE ALSO==
==SEE ALSO==
 
[[mysql-zrm]](1), [[mysql-zrm-backup]](1), [[mysql-zrm-manage-backup]](1), [[mysql-zrm-restore]](1), [[mysql-zrm-check]](1), [[mysql-zrm-list]](1), [[mysql-zrm-getconf]](1), [[mysql-zrm-setconf]](1), [[mysql-zrm-parse-binlogs]](1), [[mysql-zrm-purge]](1), [[mysql-zrm-extract-backup]](1), [[mysql-zrm-verify-backup]](1), [[mysql-zrm-abort-backup]](1), [[mysql-zrm-scheduler]](1), [[mysql-zrm-reporter.conf]](5)
[[mysql-zrm]](1), [[mysql-zrm-scheduler]](1), mysql(1), [[Zmanda_Recovery_Manager_for_MySQL|Zmanda Recovery Manager for MySQL]]


==AUTHOR==
==AUTHOR==
Zmanda Inc. (http://www.zmanda.com)
Zmanda Inc. (http://www.zmanda.com)

Latest revision as of 18:35, 28 June 2010

NAME

mysql-zrm-reporter - ZRM for MySQL backup reporting utility.

SYNOPSIS

  mysql-zrm-reporter  [--fields  name1, name2, name3, name4, name5 ....]
                      [--destination dir ]
                      [--where  fieldname=value]
                      [--type  html]
                      [--output filename]
                      [--latest ]
                      [--noheader ]
                      [--show  backup-method-info |
                               backup-status-info |
                               backup-retention-info |
                               backup-performance-info |
                               restore-full-info |
                               restore-incr-info |
                               replication-info |
                               backup-app-performance-info ]
                      [--help]

DESCRIPTION

mysql-zrm-reporter utility provides pre-defined and user-defined reports about various MySQL database backup runs. The reports can be in text or HTML format. Backup report can be sent as a RSS feed.

Backup reports can be configured using /etc/mysql-zrm/mysql-zrm-reporter.conf file parameters. For supported formats, see mysql-zrm-reporter.conf(5).

ZRM for MySQL configuration file, mysql-zrm.conf(5) file contains HTML configuration and RSS feed configuration parameters for mysql-zrm-reporter utility. The list of mysql-zrm-reporter parameters are:

html-report-directory
Set the directory where text/HTML reports are written. This parameter is optional. Example: /var/www/html/mysql-zrm-reports/
html-reports
List of pre-defined report(s) to be generated after a backup run. Example: backup-status-info
webserver-url
RSS feeds URL of a directory under document root of the web server. If this value is not specified in the mysql-zrm.conf(5) configuration file, RSS feeds will not be generated. Example: http://backupserver.company.com/reports/
rss-header-location
The location of RSS feed properties file contain ing RSS feed channel and item properties. This parameter must be provided if webserver-url is specified. Example: /etc/mysql-zrm/RSS.header

BACKUP INFORMATION

Each backup run generates the following information about the backup:

backup-date
Date and time stamp of backup run.
mysql-version
MySQL server version.
backup-directory
The location of backup directory.
backup-level
Lists the backup-level - 0 for a full and 1 for incremental backup.
raw-databases
List of databases backed up using mysqlhotcopy. If raw-tables parameter is present, this will have only one database listed.
raw-tables
List of tables backed up using mysqlhotcopy. The name of the database these tables belong to is found under raw-databases.
raw-databases-snapshot
List of databases backed up using snapshots. When raw-tables parameter is specified, this will list only one database.
raw-tables-snapshot
List of tables backed up using mysqlhotcopy. The name of the database these tables belong to is found under raw-databases.
backup-time
Time taken for the complete backup run. Format is HH:MM:SS
read-locks-time
Time read lock was held during the backup run. Format is HH:MM:SS
flush-logs-time
Time for flushing database pages to the disk. Format is HH:MM:SS
backup-size
The size, in megabytes, of data backed up.
backup-status
Status has three values. "Backup Failed" value means that there was a fatal error. "Backup done with errors" means that though there was some error during backup but some of the databases and tables were probably backed up. "Backup succeeded" means that the backup run was completed successfully.
logical-databases
List of databases backed up using mysqldump(1). When -tables parameter is specified, this will only one database.
logical-tables
List of tables belonging to logical-databases backed up using mysqldump(1). The name of the database these tables belong to is found under -databases.
replication
List of replication files backed up namely master.info and relay-log.info
slave-load-files
Names of SQL_LOAD* files that were backed up.
incremental
Names of the binary log files backed up.
backup-set
Name of the backup set this backup belongs to.
comment
Comment about the backup added by the administrator in the mysql-zrm.conf(5) file.
retention-policy
Backup image will be retained for the time specified as parameter in Days/Weeks/Months/Years. For example: if the value is "10D" means the backup image will be retained 10 days from the backup-date. This policy assumes 365 days in a year and 30 days in a month.
compress
Specifies that the backup was compressed. Default compression method is gzip program. The program used for compression is value for this parameter.
encrypt
Program used for encryption if the backups are encrypted.
host
Hostname of the MySQL server that was backed up.
compress-encrypt-time
Time taken by compression and/or encryption. This time is included in the backup time
innodb-data
List of InnoDB shared data files backed up.
innodb-logs
List of InnoDB logs backed up.

OPTIONS

      --show    backup-method-info   |   backup-status-info    | backup-retention-info |
                backup-performance-info     |     restore-info     | selective-restore-info  |
                replication-info

To display predefined reports set this option. The predefined reports, and what they contain, are listed below:

backup-status-info
backup-set, backup-date, backup-level, backup-status, backup comment
backup-method-info
backup-set, raw-databases, raw-databases, logical-databases
backup-retention-info
backup-set, backup-date, backup-level, backup-size, retention-policy
backup-performance-info
backup-set, backup-date, backup-level, backup-size, backup-size-compressed, backup-time, compress-encrypt-time
backup-app-performance-info
backup-set, backup-date, backup-level, backup-size,backup-time, read-locks-time, flush-logs-time
restore-info
backup-set, backup-date, backup-level, backup-directory, backup-status, comment
selective-restore-info
backup-set, backup-date, incremental
replication-info
backup-set, backup-date, replication, slave-load-files
--destination dir
Set the backup root directory. This parameter is optional. Default value is /var/lib/mysql-zrm
--fields name1,name2,name3...
Set the list of backup parameters to display. List of valid field names are described in BACKUP INFORMATION section. This field is optional. By default backup-set,backup-date,backup-level,backup-status,comment are displayed. Spaces are not allowed with in the parameter name list. If spaces must be used, list must within quotes.
--where fieldname=value
The utility will display the MySQL backup parameters where the field name matches value. This field is optional.
--type html
Report will be in HTML format.
--output filename
HTML report will be written to filename under "html" directory and text reports will be written to filename under "text" direc- tory. By default, these directories are created under the current working directory. The utility allows users to specify explicit directory location for reports in mysql-zrm.conf(5) using "html-report-directory" parameter. If this parameter is set, then the utility will create "html-report-directory" directory (if it does not exist) and output report with name file name will be written to "html" and/or "text" sub-directory under "html-report-directory" path.
--latest
Report about the most recent backup run.
--noheader
Generate TEXT reports with no page header, This option will be ignored for HTML reports.
--help
Displays help message and exits.

EXAMPLES

  • To display backup date, location of backups, and backup set name use:
 mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup   --fields backup-date,backup-directory,backup-set
  • To display backup date, backup set name, and size of backup use:
 mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup   --fields backup-date,backup-set,backup-size
  • To display size of backup, backup set name, and date of backup for"config1" backup set use:
 mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup       --fields      backup-date, backup-set, backup-size --where backup-set=config1
  • To display backup status report for "config1" backup set use:
 mysql-zrm-reporter  --destination /var/lib/mysql-zrm/backup   --show backup-status-info --where backup-set=config1
  • To display backup status report for "config1" backup set in HTML format and write a file use:
 mysql-zrm-reporter --destination /var/lib/mysql-zrm/backup --show backup-status-info     --where backup-set=config1 --type html --output myreport.html


FILES

/var/lib/mysql-zrm
Directory under which all backup data is stored.
/etc/mysql-zrm/mysql-zrm-reporter.conf
Configuration file read by mysql-zrm-reporter utility.

RETURN VALUES

On success, zero is returned. On error, non-zero value is returned. Output messages are written to STDOUT and error messages are to STDERR.

SEE ALSO

mysql-zrm(1), mysql-zrm-backup(1), mysql-zrm-manage-backup(1), mysql-zrm-restore(1), mysql-zrm-check(1), mysql-zrm-list(1), mysql-zrm-getconf(1), mysql-zrm-setconf(1), mysql-zrm-parse-binlogs(1), mysql-zrm-purge(1), mysql-zrm-extract-backup(1), mysql-zrm-verify-backup(1), mysql-zrm-abort-backup(1), mysql-zrm-scheduler(1), mysql-zrm-reporter.conf(5)

AUTHOR

Zmanda Inc. (http://www.zmanda.com)