cQube_Workflow Installation:

Steps to install cQube_Workflow

• Open Terminal

• Navigate to the directory where cQube_Workflow has been downloaded or cloned

cd cQube_Workflow/work_deploy/
git checkout main
git pull

Configuration of infrastructure attributes and udise data indices, metrics:

• Based on the number of infrastructure attributes required by the state, configure the infrastructure report by filling the required fields in the file infrastructure_master.csv:

• cd /development/datasource/infra/postgres/infrastructure_master.csv

• To edit below mentioned infrastructure details

• nano infrastructure_master.csv

• Save and Close the file

• Based on the number of udise attributes required by the state, configure the udise_config.csv file by filling the required fields in the file udise_config.csv:

• cd /development/datasource/udise/postgres/udise_config.csv

• To edit below mentioned UDISE details nano udise_config.csv

• Save and Close the file

• For more information to configure the weights & columns for udise/infrastucture, please refer operational document.

• Update the diksha parameters(api_url,token,encryption key,dataset name channel_id,org_id) in the file diksha_parameters.txt file by filling the required fields in the file diksha_parameters.txt:

• cd /development/datasource/diksha/nifi/diksha_parameters.txt

• If you are opting for education_usecase. usecase_name as education_usecase Copy the config.yml.template to config.yml

• cp config.yml.template to config.yml

• Edit using nano config.yml

• Fill the configuration details for the below mentioned list in config.yml (* all the values are mandatory)

• cQube_Workflow installation process configuring the components in a sequence as mentioned below:

  • Configures Ansible
  • Configures Openjdk
  • Configures Python, pip and flask
  • Configures Postgresql
  • Configures NodeJS
  • Configures Angular and Chart JS
  • Configures Apache Nifi
  • Configures Keycloak
  • Configures Grafana
  • Configures Prometheus and node exporter

• Give the following permission to the install.sh file

chmod u+x install.sh

• Install cQube using the non-root user with sudo privilege

• Configuration filled in config.yml will be validated first. If there is any error during validation, you will be prompted with the appropriate error message and the installation will be aborted. Refer the error message and solve the errors appropriately, then re-run the installation script sudo ./install.sh

• Start the installation by running install.sh shell script file as mentioned below:

sudo ./install.sh

• Once installation is completed without any errors, you will be prompted the following message.
• CQube installed successfully!!

Steps Post Installation:

Steps to import Grafana dashboard

• Connect the VPN from local machine Open https://<domain_name> from the browser and login with admin credentials
• Click on Admin Console
• Click on Monitoring details icon
• New tab will be loaded with grafana login page on http://<private_ip_of_cqube_server>:9000
• Default username is admin and password is admin
• Once your logged in change the password as per the need
• After logged in. Click on Settings icon from the left side menu.
• Click Data Sources
• Click on Add data source and select Prometheus
• In URL field, fill http://<private_ip_of_cqube_server>:9090 Optionally configure the other settings.
• Click on Save
• On home page, click on '+' symbol and select Import
• Click on Upload JSON file and select the json file which is located in git repository cQube/development/grafana/cQube_Monitoring_Dashboard.json and click Import
• Dashboard is succesfully imported to grafana with the name of cQube_Monitoring_Dashboard

Uploading data to S3 Emission bucket:

• Create cqube_emission directory and place the data files as shown in file structure below inside the cqube_emission folder. Master Files:

cqube_emission
|
├── block_master
│   └── block_mst.zip
│       └── block_mst.csv
│       └── manifest_datasource_block_mst.csv
├── cluster_master
│   └── cluster_mst.zip
│       └── cluster_mst.csv
│       └── manifest_datasource_cluster_mst.csv
├── district_master
│   └── district_mst.zip
│       └── district_mst.csv
│       └── manifest_datasource_district_mst.csv
├── school_master
│   └── school_mst.zip
│       └── school_mst.csv
│       └── manifest_datasource_school_mst.csv

Transactional Files:

cqube_emission
|
├── semester
│   └── semester.zip
│       └── semester.csv
│       └── manifest_datasource_semester.csv
├── student_attendance
│   └── student_attendance.zip
│       └── student_attendance.csv
│       └── manifest_datasource_student_attendance.csv
├── user_location_master
│   └── user_location_master.zip
│       └── user_location_master.csv
│       └── manifest_datasource_user_location_master.csv
├── inspection_master
│   └── inspection_master.zip
│       └── inspection_master.csv
│       └── manifest_datasource_inspection_master.csv
├── infra_trans
│   └── infra_trans.zip
│       └── infra_trans.csv
│       └── manifest_datasource_infra_trans.csv

• After creating the emission user, Update the emission user details mentioned below in cQube/development/python/client/config.py.

  • emission username
  • emission password
  • location of the cqube_emission directory where the files are placed as below. Example: /home/ubuntu/cqube_emission/
  • emission_url ( https://<domain_name>/data Note: URL depends upon the server configured in firewall which includes SSL and reverse proxy location)

• After completing the configuration. Save and close the file.

• Execute the client.py file located in cQube/development/python/client/ directory, as mentioned below to emit the data files to s3_emission bucket.

python3 client.py

• Finally see the output in https://<domain_name>

cQube_Workflow Upgradation:

• Open Terminal
• Navigate to the directory where cQube has been downloaded or cloned

cd cQube_Workflow/work_deploy/
git checkout main
git pull

• If you are opting for education_usecase. usecase_name as education_usecase - Copy the config.yml.template to config.yml

• cp config.yml.template to config.yml

• Edit using nano config.yml

• This script will update the below cQube components:

  • Creates & Updates table,sequence,index in postgresql database
  • Updates NodeJS server side code
  • Updates Angular and Chart JS client side code
  • Updates & configure Apache Nifi template
  • Updates & configure Keycloak

• Fill the configuration details in config.yml (* all the values are mandatory, make sure to fill the same configuration details which were used during installation)

• Save and Close the file

• Give the following permission to the upgrade.sh file

chmod u+x upgrade.sh

• Run the script to update cQube using the non-root user with sudo privilege Start the upgradation by running upgrade.sh shell script file as mentioned below: sudo ./upgrade.sh

Configuration filled in config.yml will be validated first. If there is any error during validation, you will be prompted with the appropriate error message and the upgradation will be aborted. Refer the error message and solve the errors appropriately. Restart the upgradation process sudo ./upgrade.sh

Once upgradation is completed without any errors, you will be prompted the following message. CQube upgraded successfully!!