Example:  In below case upgrade was failing due to invalid configuration on CPE1 device.  


Administrator@vd2> request system upgrade package versa-director-20180809-094907-53eca57-16.1R2S3.bin

Will restart versa director (all processes). Are you sure? [no,yes] yes

status  Installing..

[ok][2018-08-18 06:25:25]

Administrator@vd2> Starting upgrade..

Stopping vnms service..

admin@vd2:~$ Taking postgres DB backup..

Taking vnms backup..

Removing existing vnms package..

Installing vnms package..

Run migration scripts..

From 16.1R2 to 16.1R2..

Starting NCS in phase0..

Running phase0 scripts..

Starting NCS in phase12..

service vnms start-ncsp12 failed

migrate scripts failed

Traceback (most recent call last):

  File "/opt/versa/vnms/upgrade/scripts/migrate.py", line 180, in perform_migrate

    start_ncsp12()

  File "/opt/versa/vnms/upgrade/scripts/migrate.py", line 113, in start_ncsp12

    raise Exception

Exception

Failed to run migrate scripts

Traceback (most recent call last):

  File "/opt/versa/vnms/upgrade/scripts/migrate.py", line 260, in main

    perform_migrate(from_version, to_version)

  File "/opt/versa/vnms/upgrade/scripts/migrate.py", line 230, in perform_migrate

    common.run_command(cmd)

  File "/opt/versa/vnms/upgrade/scripts/common.py", line 94, in run_command

    raise Exception

Exception

Failed to start upgrade:

Starting vnms service..



Troubleshooting steps:  

Check the upgrade log file at /var/log/vnms/upgrade.log and find the problematic logs.


admin@vd2:/var/log/vnms$ pwd

/var/log/vnms

admin@vd2:/var/log/vnms$ less upgrade.log | grep "Upgrade failed"

CDB: Upgrade failed: Upgrade transaction failed to validate: /ncs:devices/device{CPE1}/config/orgs/org-services{Provider-1-sub-org-1}/class-of-service/drop-profiles/drop-profile{drop-profile-1}/minimum is not configured

CDB: Upgrade failed: Upgrade transaction failed to validate: /ncs:devices/device{CPE1}/config/orgs/org-services{Provider-1-sub-org-1}/class-of-service/drop-profiles/drop-profile{drop-profile-1}/minimum is not configured

admin@vd2:/var/log/vnms$



Solution:

From CPE1 CLI we can see drop-profile parameters are configured to 256 however in Director GUI only range is 1-255. So after fixing these parameters on CPE upgrade was successful.



[edit]

admin@CPE1-cli(config)% set orgs org-services Provider-1-sub-org-1 class-of-service drop-profiles drop-profile-1 minimum ? 

Description: Drop profile WRED minium value

Possible completions:

  <unsignedInt, 1 .. 256>[256]

admin@CPE1-cli(config)% show orgs org-services Provider-1-sub-org-1 class-of-service drop-profiles drop-profile-1

minimum 256;

maximum 256;

[ok][2018-08-24 03:36:12]