Clone Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
COV-118: Removed usage of the NiFi Registry

    • -3
    • +0
    ./process-groups/OpenLMIS/generate-measure-report.properties
    • -3
    • +0
    ./process-groups/OpenLMIS/generate-measure.properties
  1. … 5 more files in changeset.
OLMIS-6858 Reporting stack to data-pump strategy
OLMIS-6858 Reporting stack to data-pump strategy
Feel free to notify anyone else who should look at this review.

Feel free to notify anyone else who should look at this review.

There are two main connectors for each service (referencedata and requisition), one source (e.g. source-requisition) and one sink (e.g. sink-requisition). The additional sink connectors are for tab...

There are two main connectors for each service (referencedata and requisition), one source (e.g. source-requisition) and one sink (e.g. sink-requisition). The additional sink connectors are for tables that do not have a single id field defined as the primary key.

This is just to match the schema changes in the db.

This is just to match the schema changes in the db.

Script for starting up the stack locally. Not sure if it works in Linux and older versions of macOS.

Script for starting up the stack locally. Not sure if it works in Linux and older versions of macOS.

New settings to define access to the source db and the sink db (for the connectors).

New settings to define access to the source db and the sink db (for the connectors).

This is just for local dev, removing scalyr and logging to syslog, so the logs can be viewed through docker logs.

This is just for local dev, removing scalyr and logging to syslog, so the logs can be viewed through docker logs.

I don't expect we would start up with different versions for Kafka and Zookeeper, so there is just one Confluent version.

I don't expect we would start up with different versions for Kafka and Zookeeper, so there is just one Confluent version.

This is basically the schema in reference data and requisition, minus the foreign keys. Additionally, there is an additional table to define timeliness for each country, and then the materialized v...

This is basically the schema in reference data and requisition, minus the foreign keys. Additionally, there is an additional table to define timeliness for each country, and then the materialized views at the end.

These are here so that the folders exist when mounting the volume to the container.

These are here so that the folders exist when mounting the volume to the container.

OLMIS-6858 Clean up unused Nifi flows

Also, consolidate logging to syslog.

    • -3
    • +0
    ./process-groups/OpenLMIS/get-openlmis-v3-reference-geo-data.properties
    • -3
    • +0
    ./process-groups/OpenLMIS/materialized-views.properties
    • -3
    • +0
    ./process-groups/OpenLMIS/requisitions-connector.properties
    • -3
    • +0
    ./process-groups/OpenLMIS/superset-permissions.properties
  1. … 2 more files in changeset.
OLMIS-6816: Added missing requisition statuses in reporting database

    • -1
    • +1
    ./process-groups/OpenLMIS/requisitions-connector.properties
  1. … 1 more file in changeset.
OLMIS-6458: Update flow versions

    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure-report.properties
    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure.properties
    • -1
    • +1
    ./process-groups/OpenLMIS/get-openlmis-v3-reference-geo-data.properties
    • -1
    • +1
    ./process-groups/OpenLMIS/requisitions-connector.properties
Add stock adjustments to transform pipeline

* Add stock adjustments to connectors

* Add XML template

* Add properties file to autoload from Nifi registry

* Add schema mapping file

* Add adjustment reason mapping file

    • -0
    • +3
    ./process-groups/OpenLMIS/transform-req-line-item-loss-adj-v2-v3.properties
  1. … 5 more files in changeset.
Add requisition comments/status messages to transform pipeline

* Add comments/status message tables to connectors

* Add XML template

* Add properties file to autoload from Nifi registry

* Add schema mapping file

    • -0
    • +3
    ./process-groups/OpenLMIS/transform-req-status-message-v2-v3.properties
  1. … 4 more files in changeset.
Add requisition status changes to transform pipeline

* Add status changes tables to connectors

* Add XML template

* Add properties file to autoload from Nifi registry

* Add schema mapping file

* Technically RELEASED_NO_ORDER is not in the schema, but in the payload, but it is easier to include in the schema mapping file.

    • -0
    • +4
    ./process-groups/OpenLMIS/transform-req-status-change-v2-v3.properties
  1. … 4 more files in changeset.
Add step in transform requisitions for regen perms

Regenerate requisition permission strings when new requisition is inserted.

    • -1
    • +1
    ./process-groups/OpenLMIS/transform-req-v2-v3.properties
Make Casper pipeline more robust

* Fix demo data to match new eLMIS demo data.

* Give Nifi access to OpenLMIS db, so that it can check a requisition exists before inserting line items. Also, redis is renamed to not conflict with redis running on Ref Distro.

* Transform process groups are added to Nifi registry, so add properties to autoload them into Nifi on startup.

* Modify the preload script to add controller services for Redis

* Add updated transform templates

    • -0
    • +3
    ./process-groups/OpenLMIS/transform-req-line-item-v2-v3.properties
    • -0
    • +3
    ./process-groups/OpenLMIS/transform-req-v2-v3.properties
  1. … 11 more files in changeset.
Updating flow version to 8

This was due to a change in the failure to load the client secrets and I changed the name from Check for Measures to Get Measures so we are able to use the autoload script.

    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure.properties
Update generate measures version

    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure-report.properties
Update preload script to insert client secret to generate measure reports process group

    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure-report.properties
  1. … 1 more file in changeset.
Update preload script to insert client secret to generate measure reports process group

    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure-report.properties
  1. … 1 more file in changeset.
Updating flow version to 11

This allows us to fix a bug that was found in the merge content processors adding support for requisitions with skipped line items

    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure-report.properties
change flow version

    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure-report.properties
Update reference data connector to use replace function instead of escapeJson function

    • -1
    • +1
    ./process-groups/OpenLMIS/get-openlmis-v3-reference-geo-data.properties
update nifi from 1.7.0 to 1.9.2

    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure-report.properties
    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure.properties
    • -5
    • +1
    ./process-groups/OpenLMIS/get-openlmis-v3-reference-geo-data.properties
    • -5
    • +1
    ./process-groups/OpenLMIS/materialized-views.properties
    • -1
    • +1
    ./process-groups/OpenLMIS/requisitions-connector.properties
    • -1
    • +1
    ./process-groups/OpenLMIS/superset-permissions.properties
  1. … 2 more files in changeset.
Updating the flow version to include fixes

- Fix locations from geographic zones to facilities

- Update the measureReport to include an openlmis RequisitionId

- Removed the process group that restricted measureReports if there were any in the system

- Added a check to see if a measureReport already existed for a requisitionId

    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure-report.properties
update flow version

    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure-report.properties
Change flow version

    • -1
    • +1
    ./process-groups/OpenLMIS/generate-measure-report.properties