0001034: Improving Project Deployment Processes to DEV or LIVE servers

1034

[In-Portal CMS] Install / Upgrages

task

always

2011-04-10 21:21

2011-09-19 16:08

Reporter:

alex

Platform:

Assigned To:

alex

OS:

Priority:

normal

OS Version:

Status:

closed

Product Version:

Product Build:

Resolution:

fixed

ETA:

none

Fixed in Version:

5.1.3-B2

Reference:

https://groups.google.com/d/topic/in-portal-dev/Xnc-SFIK1Bk/discussion

Change Log Message:

Automated project deployment process

Estimate Points:

0

Summary:

0001034: Improving Project Deployment Processes to DEV or LIVE servers

Description:

The current process of deployment custom project Database Queries which are stored in install_schema.sql/install_data.sql file under custom/install folder is very cumbersome and unfriendly. This is the case since developers have to remember which of the SQLs weren't executed on their database yet. Additionally, it's kind of painful to constantly Import language pack file.

To summarize all this we are looking to have a special OnDeploy event which will perform all of the above tasks and more.

Here is a summary and description of the process:

1. Task(s) "roll-out" to DEV or UAT server process which will happen using special Project Update script

2. As part of this process there is a need to run DB updates, this will be done by triggering DB deployment script which will execute all new SQL statements (described below).

3. All custom (project specific) SQL statements will be stored in custom/install/upgrades.sql file (instead of custom/install/install_data.sql / ...schema.sql) along with the special Comments.

4. Comments will have the following format:

#REV_123(121,123): Adding new section to sub-menu (13324)

where:

- REV_123 - shows DB revision ID (123 is INT set by developer)
- (121,123) - list of other DB revisions that current DB revision is depended on; basically if 121 and 123 revisions are NOT applied and we try applying 123 then some SQL in that revision will fail.
- Adding new section to sub-menu (13324) - a task from In-Business with it's corresponding number so developers know what this DB revision does.

5. 1 Comment will represent 1 DB revision and 1 task in In-Business and can have 1 or more related SQL statements

6. Each DB revision must be UNIQUE across current custom/install/upgrades.sql file. This means that developers ALWAYS must perform an Update on their Working Copy to check if new DB revisions came in and then increase their DB revision numbers accordingly before committing to Repository!

7. There will be a new AppliedDBRevisions field added to the Modules table to store the list of already applied DB revisions. This will make sure the deployment process will NOT run the same SQLs more then once in case if Development Manager need to roll out some particular Tasks and not the entire trunk (latest version of the project)

8. Create special script to deploy language "english.lang" which is part of custom module.

ADDITIONS related to above functionality

9. Currently there is NO way to synchronize what Developer has in AppliedDBRevisions field once he executed he's custom SQLs using phpMyAdmin. In this case Developer would be required to manually do and update that field which is NOT convenient at all. We suggest to add a new section under Admin->Tools->System tools where you can do this by simple pressing Validate DB Revisions button (or similar).

As a result script will Validate current "project_upgrades.sql" script and outline any errors or inconsistencies, and auto-populate all missing DB Revisions from the file into AppliedDBRevisions.

NOTE: Developers should run this before we do Repository Update ONLY.

10. Additionally it would be nice to have the ability to trigger OnDeploy event here too (will update DB structure, reset caches and import Language pack). I would call it something like Deploy DB Update.

I believe we should create a new section on the right side above Templates one and call it Project Deployment and add there these 2 options.

Steps To Reproduce:

Additional Information:

Relationships

parent of	0001208	closed (5.2.0)	alex	Improvements to automatic deployment script
related to	0001278	closed (5.2.0)	alex	HTML not escaped in Deployment script output

Attached Files:

deployment_script_core.patch (1,654) 2011-04-10 21:21
http://tracker.in-portal.org/file_download.php?file_id=983&type=bug

deployment_script_modules.patch (13,361) 2011-04-10 21:22
http://tracker.in-portal.org/file_download.php?file_id=984&type=bug

deployment_script_core_v2.patch (9,223) 2011-04-14 09:46
http://tracker.in-portal.org/file_download.php?file_id=985&type=bug

deployment_script_modules_v2.patch (6,154) 2011-04-14 09:46
http://tracker.in-portal.org/file_download.php?file_id=986&type=bug

ImprovingProjectDeploymentTrans.txt (1,075) 2011-06-26 21:13
http://tracker.in-portal.org/file_download.php?file_id=1043&type=bug

deployment_script_core_v3.patch (28,457) 2011-06-28 10:14
http://tracker.in-portal.org/file_download.php?file_id=1048&type=bug

deployment_script_modules_v3.patch (5,971) 2011-06-28 10:18
http://tracker.in-portal.org/file_download.php?file_id=1049&type=bug

2012-05-16 08:32