Difference between revisions of "dbSQWare:general"

From Wiki_dbSQWare
Jump to: navigation, search
(Tool structure)
 
(18 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
== Introduction ==
 
== Introduction ==
'''dbSQWare™''' est destiné aux DBAs afin de faciliter l'exploitation au quotidien de l’ensemble des bases de données dont ils ont la charge :
+
'''dbSQWare™''' is designed for DBAs to facilitate the daily operation of all databases to which they are responsible for:
*'''dbSQWare™''' propose un socle commun unifié pour un certain nombre de SGBDs du marché : Oracle, Sybase, SQL Server et MySQL. Ce socle peut rapidement accueillir d’autres types de bases de données de par la souplesse qu’offre sa conception.
+
* '''dbSQWare™''' provides a common unified socle for a number of RDBMS of the market: Oracle, Sybase, SQL Server, MySQL, DB2-LUW, PostgreSQL and Ingres. This base can quickly accommodate other types of databases with the flexibility of its design.
*Le produit propose également une vision des inventaires et capacity planning pour des personnes moins expertes, grâce à une interface web.
+
* The product also offers a vision of inventory and capacity planning for those less expert, through a web interface.
 
<br>
 
<br>
'''dbSQWare™''' représente à ce jour plusieurs mois de conception, développement et tests. La version v1.2 sortie en cette fin d’année 2010 est mature et stable en production. Le produit est destiné (pour sa partie scripts) à des environnements Unix/Linux uniquement car il est essentiellement écrit en shell ksh et sql. La partie web, pour sa part, est écrite en PHP, Ajax et Open-Flash.<br>
+
'''dbSQWare™''' currently represents several months of design, development and testing. Version v3.1 was released in september 2011 that is mature and stable in production. The product is intended (for his party scripts) to Unix / Linux only because it is essentially written in shell ksh and sql. The web part, for its part, is written in PHP, Ajax and Flash Open.<br>
[[Downloads|Téléchargement des dernières versions stables]]<br>
+
[[Downloads | Download the latest stable versions]]<br>
 +
[[Installation | Installation guide]]<br>
  
== Fonctionnalités globales ==
+
== Overall functionality ==
 +
Management repositories of DBMS park (CMDB) in a database. <br>
 +
Current and advanced operations on DBMSs Oracle, Sybase, MSSQL, MySql, DB2-LUW, PostgreSQL and Ingres:
 +
* Backup
 +
* Restorations
 +
* Reorganizations
 +
* Statistics
 +
* ...
 +
Collection of indicators and capacity planning with recovery in a database. Check these indicators (collection, volumes, backups, ...) and send alert mails.<br>
 +
Central management of instances (access, scripts execution and automatic controls, ...).<br>
 +
GUI website for restitution of the indicators in tables and graphs.<br>
  
Gestion des référentiels des SGBDs du parc (CMDB) dans une base de données.<br>
+
== Homogeneity ==
Exploitation courante et avancée des SGBDs Oracle, Sybase, MsSql et MySql :
+
In use:
*Sauvegardes
+
* Use consistent, regardless of the DBMS
*Restaurations
+
* Easy adaptation by configuration files
*Réorganisations
+
* Only one version of the tool across the park
*Statistiques
+
* The scripts adapt to the version of the DBMS managed
*...
+
<br>
Collecte d’indicateurs et capacity planning avec remontée dans une base de données. Check de ces indicateurs (collecte, volumétries, backups, ...) avec envoi de mails d’alerte.<br>
+
In the development and evolution:
Gestion centrale des instances (accès, exécution de scripts et de commandes automatique, ...).<br>
+
* Design consistent for all DBMSs
Interface graphique web de restitution des indicateurs sous forme de tableaux et graphiques.<br>
+
* Normalization of code (names, functions, structures, parsing of arguments, ...)
 +
* Behavior modification by overloading bookstores
 +
* Set of standard libraries can be integrated into custom scripts <br>
 +
<br>
  
+
== Tool structure ==
== Homogénéité ==
 
  
Dans l’utilisation :
+
'''dbSQWare™''' is composed of four interconnected modules:<br>
*Utilisation homogène, quel que soit le SGBD
+
*[[SQWareProduction:general|SQWareProduction™]]
*Adaptation aisée par fichiers de configuration
+
*[[SQWareRepository:general|SQWareRepository™]]
*Une seule version de l’outil sur l’ensemble du parc
+
*[[SQWareCentral:general|SQWareCentral™]]
*Les scripts s’adaptent à la version du SGBD traité
+
*[[SQWareWeb:general|SQWareWeb™]]
 +
<br>
 +
'''[[SQWareProduction:general|SQWareProduction™]]''', is the operating module in local. It allows to manage the operation at large for RDBMS:
 +
* Backup
 +
* Restorations
 +
* Statistics
 +
* Ascents alerts
 +
* Encapsulation execution jobs
 +
* Execution of unix commands in parallel
 +
* ...
 +
This module also collects a number of indicators that are inserted on the repository database SQWareRepository™. This module consists of one part per DBMS managed. There is no "core" part, each type of DBMS is independent but the scripts are all written by the same standard of development (argument parsing, online help, send mail on error, recovery indicators in SQWareRepository ™, ...).<br>
 +
<br>
  
Dans le développement et les évolutions :
+
'''[[SQWareRepository:general|SQWareRepository™]]''', is the management module of the repository and indicators database. It allows to manage the repository and the indicators stored in databases (the database depending of the type of DBMS managed). This module consists of one part per DBMS managed. There is no "core" part, each type of DBMS is independent but all plugins have the same type of MCD. <br>
*Conception homogène pour l’ensemble des SGBDs
 
*Normalisation du code (noms, fonctions, structures, parsing d’arguments, …)
 
*Modification du comportement par surcharge des librairies
 
*Ensemble de librairies standards pouvant être intégrées dans des scripts customs<br>
 
 
<br>
 
<br>
  
== Structure de l’outil ==
+
'''[[SQWareCentral:general|SQWareCentral™]]''', is the central module of the tool. It can manage the whole park from this point:
 +
* Centralized collection of indicators
 +
* Deployment of SQWareProduction™ modules by rsync
 +
* Management of "full-text search" in the repositories
 +
* Easy connection via ssh to different instances of the park ...
 +
* ...
 +
This module is based inter alia on the repository database, SQWareRepository™. It is composed of a "core" part common to all managed RDBMSs and a specific plugin for each DBMS (Oracle, Sybase, SQL Server, MySQL and Ingres).<br>
 +
<br>
  
'''dbSQWare™''' est composé de quatre modules qui s’interconnectent :<br>
+
'''[[SQWareWeb:general|SQWareWeb™]]''', is the web module for graphic indicators. It works with Apache 2 and is written in PHP 5.2, AJAX and Open-Flash. It allows for the presentation of indicators and capacity planning as:
*[[expdbTools:modules#SQWareProduction|SQWareProduction™]]®
+
* Graphics (flash)
*[[expdbTools:modules#SQWareRepository|SQWareRepository™]]®
+
* Tables (with sorting and formatting locally on the browser)
*[[expdbTools:modules#SQWareCentral|SQWareCentral™]]®
+
* Exports Excel
*[[expdbTools:modules#SQWareWeb|SQWareWeb™]]®
 
<br>
 
'''[[expdbTools:modules#SQWareProduction|SQWareProduction™]]''', c’est le module d'exploitation en local des SGBDs. Il permet de gérer l'exploitation au sens large des SGBDs :
 
*Sauvegardes
 
*Restaurations
 
*Statistiques
 
*Remontée d’alertes
 
*Encapsulation de lancement de jobs
 
*Lancement de commandes unix en parallèle
 
 
*...
 
*...
Ce module collecte également un certain nombre d'indicateurs qui sont remontés sur le référentiel de base de données SQWareRepository™. Ce module est composé d'une partie par SGBD géré. Il n'y a pas de partie « core », chaque type de SGBD étant indépendant mais les scripts sont tous écrits selon la même norme de développement (parsing d’arguments, aide en ligne, envoi de mail sur erreur, remontée d’indicateurs dans SQWareRepository™, …).<br><br>
+
It is based entirely on data contained in the repository database SQWareRepository ™. Refunds are made in much the same way regardless of the DBMS (the specific near it), which makes it more enjoyable and easier navigation. This module is composed of a "core" part common to all managed RDBMSs (template engine, display graphs, tables, ...) and a specific plugin for each DBMS (Oracle, Sybase, SQL Server, MySQL, DB2-LUW, PostgreSQL and Ingres). <br>
 
 
'''[[expdbTools:modules#SQWareRepository|SQWareRepository™]]''', c’est le module de gestion du référentiel et des indicateurs en base de données. Il permet de gérer le référentiel ainsi que les indicateurs stockés en bases de données (il s'agit en fait d'un schéma ou d’une database selon le type de SGBD traité). Ce module est composé d'une partie par SGBD géré. Il n'y a pas de partie « core », chaque type de SGBD est indépendant mais tous les plugins ont le même type de MCD.<br><br>
 
 
 
'''[[expdbTools:modules#SQWareCentral|SQWareCentral™]]''', c’est le module central de l’outil. Il permet de gérer l'ensemble du parc depuis ce point central :
 
*collectes centralisées d’indicateurs
 
*déploiement des modules de SQWareProduction™ par rsync
 
*gestion de recherche « full text » dans les référentiels
 
*connexion simplifiée par ssh aux différentes instances du parc…
 
 
 
Ce module se base entre autres sur le référentiel de base de données, SQWareRepository™. Il est composé d’une partie « core », commune à tous les SGBDs gérés et d’un plugin spécifique pour chaque SGBD (Oracle, Sybase, SQL Server et MySQL).<br><br>
 
 
 
'''[[expdbTools:modules#SQWareWeb|SQWareWeb™]]''', c’est le module de restitution graphique web des indicateurs. Il fonctionne avec apache 2 et est écrit en PHP 5.2, ajax et Open-Flash. Il permet de faire la présentation des indicateurs et capacity planning sous forme :
 
*Graphiques (flash)
 
*Tableaux (avec tri et formatage en local sur le navigateur)
 
*Exports Excel
 
*...
 
  
Il se base entièrement sur les données contenues dans le référentiel de base de données SQWareRepository™. Les restitutions sont présentées sensiblement de la même façon quel que soit le SGBD (aux spécificités près de celui-ci), ce qui rend plus agréable et plus aisée la navigation. Ce module est composé d’une partie « core », commune à tous les SGBDs gérés, (moteur de templates, affichage graphiques, tableaux, ...) et d’un plugin spécifique pour chaque SGBD (Oracle, Sybase, SQL Server et MySQL).<br>
+
== General architecture diagram dbSQWare™ (when the SQWareProduction™ module is locally installed) ==
 +
[[Image:General_dbSQWare.jpg]]

Latest revision as of 21:07, 18 January 2013

Introduction

dbSQWare™ is designed for DBAs to facilitate the daily operation of all databases to which they are responsible for:

  • dbSQWare™ provides a common unified socle for a number of RDBMS of the market: Oracle, Sybase, SQL Server, MySQL, DB2-LUW, PostgreSQL and Ingres. This base can quickly accommodate other types of databases with the flexibility of its design.
  • The product also offers a vision of inventory and capacity planning for those less expert, through a web interface.


dbSQWare™ currently represents several months of design, development and testing. Version v3.1 was released in september 2011 that is mature and stable in production. The product is intended (for his party scripts) to Unix / Linux only because it is essentially written in shell ksh and sql. The web part, for its part, is written in PHP, Ajax and Flash Open.
Download the latest stable versions
Installation guide

Overall functionality

Management repositories of DBMS park (CMDB) in a database.
Current and advanced operations on DBMSs Oracle, Sybase, MSSQL, MySql, DB2-LUW, PostgreSQL and Ingres:

  • Backup
  • Restorations
  • Reorganizations
  • Statistics
  • ...

Collection of indicators and capacity planning with recovery in a database. Check these indicators (collection, volumes, backups, ...) and send alert mails.
Central management of instances (access, scripts execution and automatic controls, ...).
GUI website for restitution of the indicators in tables and graphs.

Homogeneity

In use:

  • Use consistent, regardless of the DBMS
  • Easy adaptation by configuration files
  • Only one version of the tool across the park
  • The scripts adapt to the version of the DBMS managed


In the development and evolution:

  • Design consistent for all DBMSs
  • Normalization of code (names, functions, structures, parsing of arguments, ...)
  • Behavior modification by overloading bookstores
  • Set of standard libraries can be integrated into custom scripts


Tool structure

dbSQWare™ is composed of four interconnected modules:


SQWareProduction™, is the operating module in local. It allows to manage the operation at large for RDBMS:

  • Backup
  • Restorations
  • Statistics
  • Ascents alerts
  • Encapsulation execution jobs
  • Execution of unix commands in parallel
  • ...

This module also collects a number of indicators that are inserted on the repository database SQWareRepository™. This module consists of one part per DBMS managed. There is no "core" part, each type of DBMS is independent but the scripts are all written by the same standard of development (argument parsing, online help, send mail on error, recovery indicators in SQWareRepository ™, ...).

SQWareRepository™, is the management module of the repository and indicators database. It allows to manage the repository and the indicators stored in databases (the database depending of the type of DBMS managed). This module consists of one part per DBMS managed. There is no "core" part, each type of DBMS is independent but all plugins have the same type of MCD.

SQWareCentral™, is the central module of the tool. It can manage the whole park from this point:

  • Centralized collection of indicators
  • Deployment of SQWareProduction™ modules by rsync
  • Management of "full-text search" in the repositories
  • Easy connection via ssh to different instances of the park ...
  • ...

This module is based inter alia on the repository database, SQWareRepository™. It is composed of a "core" part common to all managed RDBMSs and a specific plugin for each DBMS (Oracle, Sybase, SQL Server, MySQL and Ingres).

SQWareWeb™, is the web module for graphic indicators. It works with Apache 2 and is written in PHP 5.2, AJAX and Open-Flash. It allows for the presentation of indicators and capacity planning as:

  • Graphics (flash)
  • Tables (with sorting and formatting locally on the browser)
  • Exports Excel
  • ...

It is based entirely on data contained in the repository database SQWareRepository ™. Refunds are made in much the same way regardless of the DBMS (the specific near it), which makes it more enjoyable and easier navigation. This module is composed of a "core" part common to all managed RDBMSs (template engine, display graphs, tables, ...) and a specific plugin for each DBMS (Oracle, Sybase, SQL Server, MySQL, DB2-LUW, PostgreSQL and Ingres).

General architecture diagram dbSQWare™ (when the SQWareProduction™ module is locally installed)

General dbSQWare.jpg