Clone
 

jason rogena <jasonrogena@gmail.com> in openlmis-deployment

Update the Instance Type for the Reporting UAT EC2

Upgrade the instance type for the UAT reporting EC2 instance to

m5a.large as NiFi was running out of memory in the t2.medium instance.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

OLMIS-5231: Update Terraform Vars Holding AWS Keys (#10)

* OLMIS-5231: Update Terraform Vars Holding AWS Keys

Update the Terraform variables holding AWS keys from using hyphens to

using underscores to allow the variables to be passed as environment

variables (using the 'TF_VAR' prefix).

Environment variables cannot have hyphens.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* OLMIS-5231, update readme with instructions for openlmis environments

    • -2
    • +2
    /provision/terraform/uat/benin-demo/main.tf
    • -2
    • +2
    /provision/terraform/uat/uat3/variables.tf
    • -2
    • +2
    /provision/terraform/uat/uat4/variables.tf
OLMIS-5231: Update Terraform Vars Holding AWS Keys

Update the Terraform variables holding AWS keys from using hyphens to

using underscores to allow the variables to be passed as environment

variables (using the 'TF_VAR' prefix).

Environment variables cannot have hyphens.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -2
    • +2
    /provision/terraform/uat/benin-demo/main.tf
    • -2
    • +2
    /provision/terraform/uat/uat3/variables.tf
    • -2
    • +2
    /provision/terraform/uat/uat4/variables.tf
OLMIS-5332: NiFi & Superset Behind HTTPS

Deploy the shared NiFi and Superset instances behind HTTPS.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

OLMIS-5332: NiFi & Superset Behind HTTPS

Deploy the shared NiFi and Superset instances behind HTTPS.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

OLMIS-5332: NiFi & Superset Behind HTTPS

Deploy the shared NiFi and Superset instances behind HTTPS.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

OLMIS-5332: NiFi & Superset Behind HTTPS

Deploy the shared NiFi and Superset instances behind HTTPS.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

OLMIS-5332: NiFi & Superset Behind HTTPS

Deploy the shared NiFi and Superset instances behind HTTPS.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

OLMIS-5332: NiFi & Superset Behind HTTPS

Deploy the shared NiFi and Superset instances behind HTTPS.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

Add NiFi Registry Deployment (#7)

* OLMIS-5086: Add NiFi Registry Deployment

Since OpenLMIS needs a shared NiFi Registry instance, add deployment

scripts for it (to be used with Jenkins).

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* OLMIS-5086: Add Terraform Def For NiFi Reg Deploy

Since the shared NiFi Registry instance will be deployed on an AWS

instance, add the definitions for that setup in Terraform files.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* OLMIS-5086: Add Docker Install Auto Scripts

Since the NiFi Registry host will have to have the Docker Daemon

running, create Ansible scripts for installing Docker and Docker Compose

on that host.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* OLMIS-5231: Use Ansible Tasks For TLS Gen Process

Since Ansible is unable to generate enough entropy when running the

shell script for generating the TLS files in the Docker role, switch to

generating the TLS files using Ansible tasks.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* OLMIS-5231: Add Ansible pip Dependencies

Since a bunch of people will be using the defined Ansible playbooks, add

a file with the required pip dependencies. Also add documentation on how

to install the pip and Ansible Galaxy dependencies.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* Fix formatting for NiFi Registry Terraform

Do this by running:

terraform fmt provision/terraform/modules/nifi-registry

terraform fmt provision/terraform/reporting/nifi-registry

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* OLMIS-5231: Setup Docker from within uat Terraform

Run the Ansible playbook for setting up Docker and Docker Compose from

within the uat Terraform definitions.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* Fix formatting for uat Terraform

Do this by running:

terraform fmt provision/terraform/modules/uat

terraform fmt provision/terraform/uat

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* Rename Terraform Var docker-https-port

Rename the Terraform variable docker-https-port to something more

appropriate (docker-tls-port).

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* OLMIS-5231: Add DeployGroup EC2 Tag to uat Build

Since the Docker dynamic inventory will only run on hosts that have the

EC2 tag DeployGroup with a value of docker-hosts, add it to the uat

deployments.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* OLMIS-5289, add benin-demo env

* OLMIS-5289, start README for how to use Terraform and Ansible for new env

* OLMIS-5086: Use openlmis-reporting SSH Key

Use the openlmis-reporting SSH key (whose private key is backed up in

the aws-instance-keys S3 bucket) in the NiFi Registry deployment.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* OLMIS-5231: Standardise Terraform AWS Cred Vars

Use the same variable names for the Terraform variables to hold the AWS

key ID and AWS secret key across the UAT and NiFi Registry setups. This

allows for users to get the values from the same Terraform environment

variable.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

* OLMIS-5231: Add Terraform Setup Instructions

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +11
    /deployment/reporting_env/nifi-registry/.env
    • -0
    • +6
    /deployment/reporting_env/nifi-registry/config/Dockerfile
    • -0
    • +42
    /deployment/reporting_env/nifi-registry/docker-compose.yml
    • -0
    • +3
    /provision/ansible/.gitignore
    • -0
    • +16
    /provision/ansible/README.md
    • -0
    • +4
    /provision/ansible/ansible.cfg
    • -0
    • +9
    /provision/ansible/docker.yml
    • -0
    • +219
    /provision/ansible/inventory/ec2.ini
    • -0
    • +1708
    /provision/ansible/inventory/ec2.py
    • -0
    • +4
    /provision/ansible/inventory/hosts
  1. … 41 more files in changeset.
OLMIS-5283: Add Deployment Script for Reporting

Add a script for deploying the reporting stack from the Jenkins hosts.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

OLMIS-5283: Add Deployment Script for Reporting

Add a script for deploying the reporting stack from the Jenkins hosts.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +16
    /deployment/reporting_env/services/deploy_services.sh
OLMIS-5283: Add Deployment Script for Reporting

Add a script for deploying the reporting stack from the Jenkins hosts.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

OLMIS-5231: Add Terraform Setup Instructions

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

OLMIS-5231: Standardise Terraform AWS Cred Vars

Use the same variable names for the Terraform variables to hold the AWS

key ID and AWS secret key across the UAT and NiFi Registry setups. This

allows for users to get the values from the same Terraform environment

variable.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -2
    • +2
    /provision/terraform/uat/benin-demo/main.tf
    • -2
    • +2
    /provision/terraform/uat/uat3/variables.tf
    • -2
    • +2
    /provision/terraform/uat/uat4/variables.tf
OLMIS-5086: Use openlmis-reporting SSH Key

Use the openlmis-reporting SSH key (whose private key is backed up in

the aws-instance-keys S3 bucket) in the NiFi Registry deployment.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

OLMIS-5231: Add DeployGroup EC2 Tag to uat Build

Since the Docker dynamic inventory will only run on hosts that have the

EC2 tag DeployGroup with a value of docker-hosts, add it to the uat

deployments.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +5
    /provision/terraform/uat/uat3/variables.tf
    • -0
    • +5
    /provision/terraform/uat/uat4/variables.tf
Rename Terraform Var docker-https-port

Rename the Terraform variable docker-https-port to something more

appropriate (docker-tls-port).

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -1
    • +1
    /provision/terraform/uat/uat3/variables.tf
    • -1
    • +1
    /provision/terraform/uat/uat4/variables.tf
Fix formatting for uat Terraform

Do this by running:

terraform fmt provision/terraform/modules/uat

terraform fmt provision/terraform/uat

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -10
    • +15
    /provision/terraform/modules/openlmis/compute.tf
    • -23
    • +23
    /provision/terraform/modules/openlmis/network.tf
    • -12
    • +12
    /provision/terraform/modules/openlmis/storage.tf
    • -8
    • +14
    /provision/terraform/uat/uat3/variables.tf
    • -8
    • +14
    /provision/terraform/uat/uat4/variables.tf
OLMIS-5231: Setup Docker from within uat Terraform

Run the Ansible playbook for setting up Docker and Docker Compose from

within the uat Terraform definitions.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +24
    /provision/terraform/modules/openlmis/compute.tf
    • -0
    • +24
    /provision/terraform/uat/uat3/variables.tf
    • -0
    • +24
    /provision/terraform/uat/uat4/variables.tf
Fix formatting for NiFi Registry Terraform

Do this by running:

terraform fmt provision/terraform/modules/nifi-registry

terraform fmt provision/terraform/reporting/nifi-registry

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

OLMIS-5231: Add Ansible pip Dependencies

Since a bunch of people will be using the defined Ansible playbooks, add

a file with the required pip dependencies. Also add documentation on how

to install the pip and Ansible Galaxy dependencies.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +16
    /provision/ansible/README.md
    • -0
    • +17
    /provision/ansible/requirements/ansible.pip
OLMIS-5231: Use Ansible Tasks For TLS Gen Process

Since Ansible is unable to generate enough entropy when running the

shell script for generating the TLS files in the Docker role, switch to

generating the TLS files using Ansible tasks.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +8
    /provision/ansible/roles/docker/tasks/install-debian.yml
    • -0
    • +3
    /provision/ansible/roles/docker/tasks/install.yml
OLMIS-5086: Add Docker Install Auto Scripts

Since the NiFi Registry host will have to have the Docker Daemon

running, create Ansible scripts for installing Docker and Docker Compose

on that host.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +219
    /provision/ansible/inventory/ec2.ini
    • -0
    • +1708
    /provision/ansible/inventory/ec2.py
    • -0
    • +16
    /provision/ansible/roles/docker/meta/main.yml
  1. … 11 more files in changeset.
OLMIS-5086: Add Docker Install Auto Scripts

Since the NiFi Registry host will have to have the Docker Daemon

running, create Ansible scripts for installing Docker and Docker Compose

on that host.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +219
    /provision/ansible/inventory/ec2.ini
    • -0
    • +1708
    /provision/ansible/inventory/ec2.py
    • -0
    • +16
    /provision/ansible/roles/docker/meta/main.yml
  1. … 11 more files in changeset.
OLMIS-5086: Add Docker Install Auto Scripts

Since the NiFi Registry host will have to have the Docker Daemon

running, create Ansible scripts for installing Docker and Docker Compose

on that host.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +3
    /provision/ansible/.gitignore
    • -0
    • +4
    /provision/ansible/ansible.cfg
    • -0
    • +9
    /provision/ansible/docker.yml
    • -0
    • +219
    /provision/ansible/inventory/ec2.ini
    • -0
    • +1708
    /provision/ansible/inventory/ec2.py
    • -0
    • +4
    /provision/ansible/inventory/hosts
    • -0
    • +2
    /provision/ansible/requirements/galaxy.yml
    • -0
    • +28
    /provision/ansible/roles/docker/defaults/main.yml
    • -0
    • +7
    /provision/ansible/roles/docker/handlers/main.yml
    • -0
    • +16
    /provision/ansible/roles/docker/meta/main.yml
    • -0
    • +32
    /provision/ansible/roles/docker/tasks/configure.yml
    • -0
    • +20
    /provision/ansible/roles/docker/tasks/gen-tls-files.yml
    • -0
    • +7
    /provision/ansible/roles/docker/tasks/main.yml
    • -0
    • +5
    /provision/ansible/roles/docker/tasks/setup-debian.yml
  1. … 10 more files in changeset.
OLMIS-5086: Add Docker Install Auto Scripts

Since the NiFi Registry host will have to have the Docker Daemon

running, create Ansible scripts for installing Docker and Docker Compose

on that host.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +219
    /provision/ansible/inventory/ec2.ini
    • -0
    • +1708
    /provision/ansible/inventory/ec2.py
    • -0
    • +16
    /provision/ansible/roles/docker/meta/main.yml
  1. … 12 more files in changeset.
OLMIS-5086: Add Docker Install Auto Scripts

Since the NiFi Registry host will have to have the Docker Daemon

running, create Ansible scripts for installing Docker and Docker Compose

on that host.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +219
    /provision/ansible/inventory/ec2.ini
    • -0
    • +1708
    /provision/ansible/inventory/ec2.py
    • -0
    • +16
    /provision/ansible/roles/docker/meta/main.yml
  1. … 11 more files in changeset.
OLMIS-5086: Add Docker Install Auto Scripts

Since the NiFi Registry host will have to have the Docker Daemon

running, create Ansible scripts for installing Docker and Docker Compose

on that host.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +219
    /provision/ansible/inventory/ec2.ini
    • -0
    • +1708
    /provision/ansible/inventory/ec2.py
    • -0
    • +16
    /provision/ansible/roles/docker/meta/main.yml
  1. … 12 more files in changeset.
OLMIS-5086: Add Docker Install Auto Scripts

Since the NiFi Registry host will have to have the Docker Daemon

running, create Ansible scripts for installing Docker and Docker Compose

on that host.

Signed-off-by: Jason Rogena <jasonrogena@gmail.com>

    • -0
    • +219
    /provision/ansible/inventory/ec2.ini
    • -0
    • +1708
    /provision/ansible/inventory/ec2.py
    • -0
    • +16
    /provision/ansible/roles/docker/meta/main.yml
  1. … 12 more files in changeset.