SQWareProduction:postgres:bin:sqwpg DumpAllDatabases.ksh

From Wiki_dbSQWare
Jump to: navigation, search

Presentation

Script $gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh :


Run of sqwpg_DumpDatabase.ksh in parallel mode
You can choose:

  • The parallel degree
  • Aggressiveness of run (number of seconds between two runs)
  • Aggressiveness of check end (number of seconds between two checks of end)


Filters to generate database list (you can mix all off them):

  • Include list of database
  • Exclude list of database
  • Include like clause
  • Exclude like clause
  • Where clause



Online help

The online help is available for most scripts with the -h option.
Ex: $gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -h
Content of this assistance :

Sourcing sqwpg_Global.lib v2024.01 SQWareProduction for PostgreSQL (dbSQWare) ... 

Usage: sqwpg_DumpAllDatabases.ksh [-h] -I instance [+ options]

DESCRIPTION
   sqwpg_DumpAllDatabases.ksh Dump databases in parallel
SUPPORT
   PostgreSQL supported versions: 9.0 <= v <= 16

PARAMETERS
     -I  instance       : Target instance to pg_dump.
OPTIONS
     -h  help           : Display the full usage.
     -s                 : Display samples of usage.
     -P  Nb threads     : Number of threads in parallel (by default 2).
     -F  format         : Format of pg_dump (p,t,c).
     -S                 : Sort databases list by size: 'pg_database_size(oid) desc'.
     -RD directory      : Directory to write dump file (default /pgbackup/$PG_SID).
     -ID listdb         : List of databases to be dumped (by default all).
     -ED listdb         : List of databases to exclude from dump.
     -IL likeclause     : Like clause to generate databases list (example: 'db%').
     -EL likeclause     : Like clause to exclude databases (example: 'nodb%').
     -HI Nb_Generations : Number of generations to keep (by default 2).
     -WCD  whereclause  : Where clause to generate databases list.
     -AGR  Nb sec       : Nb of seconds between two runs (by default 1s).
     -AGE  Nb sec       : Nb of seconds between two checks of end (by default 1s).
     -ZIP extension     : Compressor extension gz,bz2,Z,none (default: gz).
     -FRT  return_code  : Force return code value on error.
     -AddMail email     : Email address to add at 'pmexpdba@gmail.com'.
     -SendReport        : Send execution log report.
     -Dist              : For distant connection to database (change $gvsqw_ConnectString to $gvsqw_DistConnectString ).
     -ForceDump         : Force the DUMP even if the cluster is in recovery mode (par defaut, 'Disable').
     -NoForceDump       : Don't exec DUMP if the cluster is in recovery mode (par defaut, 'Disable').
     -NoMail            : Deactivate sendmail on error pmexpdba@gmail.com (by default, send on error).
     -Locale   locale   : Force Locale for help display (fr,en).
     -Exec              : Execute commands (default, display generated commands).

Nuvola apps information.png
Note:
To be sure the aid is accurate, refer directly to the online help script -h option.


Error management

Errors passing arguments

This type of message is generated:

Lack 'PG_SID' parameter, Usage: sqwpg_DumpAllDatabases.ksh [-h]  -I instance [+ options]
For full help : sqwpg_DumpAllDatabases.ksh -h

If you are connecting through a terminal, no mail will be sent and you will have more this kind of message:

Not sending mail because you are in connected mode !!!
Lack 'PG_SID' parameter

If you are not connected to a terminal, the error message appears and is sent by mail to the address contained in the variable $gvsqw_GlobalMail (See help customize this variable). The subject line will always start by "$gvsqw_MailMsg_postgres : " (See help customize this variable).

Nuvola apps information.png
Note:
Sending mail can be disabled by the option -NoMail for one execution.


Execution errors

Whether you are or not connected to a terminal, the error message appears and an email containing a summary of treatment errors is sent to the address contained in the variable $gvsqw_Mail_postgres (See help customize this variable). The subject line will always start by "$gvsqw_MailMsg_postgres : " (See help customize this variable).

Nuvola apps information.png
Note:
Sending mail can be disabled by the option -NoMail for one execution.


Usage examples

Sourcing sqwpg_Global.lib v2024.01 SQWareProduction for PostgreSQL (dbSQWare) ... 

#Standard help for script sqwpg_DumpAllDatabases.ksh:


# XXXXX : -RD

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -h
#Display online help for this script

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -Locale en -h
#Display online help for this script with forcing of the 'en' locale (default locale managed by the variable gvsqw_Locale)

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -s
#Display usage examples for this script

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -AddMail 'mymail1@mydomaine.com,mymail2@mydomaine.com'
#Add the mail list to the default address managed by the variable gvsqw_GlobalMail

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -SendReport
#Send the log by email at the end of the treatment even if there is no error

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -AGR 20
#Set the waiting time in seconds between two command run, 20s here

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -AGE 30
#Set the waiting time in seconds between two end checks, 30s here

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -I $PG_SID -NoMail
#Deactivate sendmail on error to $gvsqw_GlobalMail (by default, send on error)

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -I $PG_SID -ZIP <ZipExtension> -F <Format> -Exec
#Execute generated commands et les compresse (gz,bz2,Z,none) avec le format tar ou rsyncec

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -I $PG_SID -S
#Generate commands but don't execute them and sort it !

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -I $PG_SID -HI <NumberOfGenerations> -Exec
#Change number of Generation to keep

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -I $PG_SID -FRT <NumericValue> -Exec
#Force return code to '<NumericValue>' on error (if no error, exit 0!)
#You can also force return code of this script on all your
#environnement if you set the variable: $gvsqw_ForcedReturnCodeScript_sqwpg_DumpAllDatabases=<NumericValue>
#in configuration file $gvsqw_PgBin/../etc_cust/sqwpg_GlobalVar.cfg

#############################
#Run off sqwpg_DumpDatabase.ksh in parallel mode for all databases
#Options to generate databases list with filters (you can mix all off them):
$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -I $PG_SID -ID <listdb>
#Generate database list with 'in list':
#=> and name in ('$ListInclude')
$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -I $PG_SID -ED <listdb> -Dist 
#Generate database list with 'not in list':
#=> and name not in ('$ListExclude')
$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -I $PG_SID -IL <likeclause>
#Generate database list with 'like':
#=> and name like 'LikeClause'
$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -I $PG_SID -EL <likeclause>
#Generate database list with 'not like':
#=> and name not like 'NotLikeClause'
$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -I $PG_SID -W <whereclause>
#Generate database list with 'where clause':
#=> and 'WhereClause'

$gvsqw_PgBin/sqwpg_DumpAllDatabases.ksh -I $PG_SID -P <NumericValue> -Exec
#Run sqwpg_DumpDatabase.ksh script with a parallel degree of '<NumericValue>'
#Use by default the variable gvsqw_NbThreadXXX in $gvsqw_PgBin/../etc/sqwpg_GlobalVar.cfg
#You can change this default on all your environnement if you set this variable
#in configuration file $gvsqw_PgBin/../etc_cust/sqwpg_GlobalVar.cfg

Nuvola apps information.png
Note:
To be sure the examples are accurate, refer directly to the online help script -s option.