Please find the article on how to fix the following issue on vsh status output on Analytics nodes, and when you run into the connection problem as highlighted.
Problem Description:
[versa@Analytics: \~\] $ vsh status
versa-confd is Running \[*\] process 1195
versa-lced is Running \[*\] process 1726
versa-spackmgr is Running \[-\] process 1202
versa-analytics-monitor is Running \[*\] process 1205
versa-analytics-driver is Running \[*\] process 3338
versa-analytics-app is Running \[*\] process 1758
versa-monit is Running \[*\] process 1289
versa-analytics-dataops is Running \[*\] process 1197
versa-analytics-redis is Running \[-\] process 1303
-------------------------------------------------------------
VANDB upgrade failed, please manually upgrade the DB using:
sudo /usr/bin/python3 /opt/versa/scripts/van-scripts/vandb-upgrade.py
-------------------------------------------------------------
\[versa@Analytics: \~\] $ sudo /usr/bin/python3 /opt/versa/scripts/van-scripts/vandb-upgrade.py
Starting Versa Analytics database upgrades
Checking for cluster status...
ZooKeeper JMX enabled by default
Using config: /opt/versa\_van/apps/zk/bin/../conf/zoo.cfg
Connecting...
Upgrading database schema from 5.0.3 to 5.0.4...
Database schema is up to date (5.0.4)
Keyspace van\_search does not exist
Data Configuration Migration already performed
Data Configurations updated
Data Configurations validated
- Migrating report configs...
0 processed
- Migrating completed reports...
0 processed
- Migrating schedules...
0 processed
- Migrating report configs...
0 processed
- Migrating completed reports...
0 processed
- Migrating schedules...
0 processed
Migrating ALS config if any...
Migrating Email configuration if any ...
No prior email configuration...
Migrating System Monitor configuration if any...
Connection error: ('Unable to connect to any servers', {'127.0.0.1:9042': AuthenticationFailed('Remote end requires authentication')})
Analytics Schema is different
Completed Versa Analytics database upgrades
\[versa@Analytics: \~\] $
Fix/Resolution:
Make sure, open is open and you can login to the Cassandra DB.
admin@Analytic-1:~$ nc -vz localhost 9042
admin@Analytic-1:~$ cqlsh -u cassandra -p <cassandra-password> <<--- Cassandra password can be obtained through "vsh print-auth"
Please also make sure that, same password is present in the application.properties as vsh print-auth
admin@Analytic-1:~$ sudo cat /opt/versa/var/van-app/properties/application.properties
# Database authentication credentials
db.analytics.username=cassandra
db.analytics.password=<cassandra-password>
db.analytics.ssl.enable=false
If all is good on the above two commands, then check the following file where auth_enabled is set to true. If not then change it to 1 and re-run the sudo /usr/bin/python3 /opt/versa/scripts/van-scripts/vandb-upgrade.py,
admin@Analytic-1:~$ cat /opt/versa/scripts/van-install/cluster_config.properties
cassandra_enabled=1
solr_enabled=0
zookeeper_enabled=1
# Comma delimited hosts and port: <host1>:2181,<host2>:2181
# Required if Solr is enabled
zookeeper_hosts=172.16.25.3:2181,172.16.25.4:2181
auth_enabled=0 <<<<<<<<If it is set to 0 (false), then set it to 1 (true)
solr_host=
solr_port=8983
solr_shards=1
solr_replication_factor=1
We have raised a PR to take care of the issue, if the auth is not enabled, then read the password from application.properties.
Bug: 133845
Description: VANDB upgrade failing for AuthenticationFailed('Remote end requires authentication')})
Fix: Fix is available from Oct Hotfix 22.1.4 Image and Onwards
If you are still noticing a problem, contact support@versa-networks.com