docker-compose.yml

Clone Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
OLMIS-6858 Reporting stack to data-pump strategy
OLMIS-6858 Reporting stack to data-pump strategy
Feel free to notify anyone else who should look at this review.

Feel free to notify anyone else who should look at this review.

There are two main connectors for each service (referencedata and requisition), one source (e.g. source-requisition) and one sink (e.g. sink-requisition). The additional sink connectors are for tab...

There are two main connectors for each service (referencedata and requisition), one source (e.g. source-requisition) and one sink (e.g. sink-requisition). The additional sink connectors are for tables that do not have a single id field defined as the primary key.

This is just to match the schema changes in the db.

This is just to match the schema changes in the db.

Script for starting up the stack locally. Not sure if it works in Linux and older versions of macOS.

Script for starting up the stack locally. Not sure if it works in Linux and older versions of macOS.

New settings to define access to the source db and the sink db (for the connectors).

New settings to define access to the source db and the sink db (for the connectors).

This is just for local dev, removing scalyr and logging to syslog, so the logs can be viewed through docker logs.

This is just for local dev, removing scalyr and logging to syslog, so the logs can be viewed through docker logs.

I don't expect we would start up with different versions for Kafka and Zookeeper, so there is just one Confluent version.

I don't expect we would start up with different versions for Kafka and Zookeeper, so there is just one Confluent version.

This is basically the schema in reference data and requisition, minus the foreign keys. Additionally, there is an additional table to define timeliness for each country, and then the materialized v...

This is basically the schema in reference data and requisition, minus the foreign keys. Additionally, there is an additional table to define timeliness for each country, and then the materialized views at the end.

These are here so that the folders exist when mounting the volume to the container.

These are here so that the folders exist when mounting the volume to the container.

OLMIS-6858 Clean up unused Nifi flows

Also, consolidate logging to syslog.

  1. … 5 more files in changeset.
OLMIS-6858 Add cron container to reporting stack

To be able to refresh materialized views with a cronjob. Configured for every 15 minutes.

  1. … 7 more files in changeset.
OLMIS-6858 Update sample settings and remove local network

Local network settings should only be on the local docker-compose. Add new settings in the sample.

  1. … 1 more file in changeset.
OLMIS-6858 Enable streaming architecture for reporting stack

This is to start the data pump feature for the reporting stack. The components of the streaming architecture are added (Kafka, Connect, etc.) and the first set of connectors (for reference data) are registered. There is one source connector for all reference data tables and one sink connector for most reference data tables. The additional sink connectors are for tables that are not identified by an id field, but rather by a combination of ids.

  1. … 6 more files in changeset.
OLMIS-6478: Removed debug flag

OLMIS-6478: Move debug flag to container definition

  1. … 1 more file in changeset.
OLMIS-6478: Moved hard-coded reporting stack settings to file

  1. … 15 more files in changeset.
OLMIS-6478: Moved hard-coded reporting stack settings to file

  1. … 15 more files in changeset.
Make Casper pipeline more robust

* Fix demo data to match new eLMIS demo data.

* Give Nifi access to OpenLMIS db, so that it can check a requisition exists before inserting line items. Also, redis is renamed to not conflict with redis running on Ref Distro.

* Transform process groups are added to Nifi registry, so add properties to autoload them into Nifi on startup.

* Modify the preload script to add controller services for Redis

* Add updated transform templates

  1. … 12 more files in changeset.
Initial files for Project Casper

  1. … 13 more files in changeset.
Remove unnecessary dbdata volume

Remove unnecessary dbdata volume

Set JVM Memory initial and maximum heap size

  1. … 1 more file in changeset.
update nifi from 1.7.0 to 1.9.2

  1. … 7 more files in changeset.
uncomment docker-compose

Initial commit

  1. … 4 more files in changeset.
Define variables in env file and import it during preloading

  1. … 3 more files in changeset.
Define variables in env file and import it during preloading

  1. … 3 more files in changeset.
add db image

add db image