Clone Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
OLMIS-6478: Removed unused env variables

OLMIS-6478: Removed unused properties in superset init script

OLMIS-6478: Restored missing env variable

OLMIS-6478: Added info about why SUPERSET_ADMIN_XXX variables are ignored

OLMIS-6478: Removed empty line

OLMIS-6478: Removed unnecessary steps in superset dockerfile

OLMIS-6478: Use official version of superset-patchup repository

OLMIS-6478: Update README

OLMIS-6478: Fixed typo

OLMIS-6458: Update flow versions

OLMIS-6478: Moved hard-coded reporting stack settings to file

    • -0
    • +14
    ./config/services/nginx/init.sh
    • -0
    • +170
    ./config/services/nifi/conf/logback.xml
    • -7
    • +15
    ./config/services/nifi/scripts/preload.sh
    • -1
    • +2
    ./config/services/nifi/scripts/start.sh
    • -0
    • +20
    ./config/services/superset/init.sh
    • -2
    • +2
    ./nifi-flows/OpenLMIS_v3_reference_data.xml
    • -1
    • +1
    ./nifi-flows/Requisitions_Connector.xml
    • -0
    • +85
    ./settings-sample.env
Update Casper documentation

The pipeline has been streamlined.

Add stock adjustments to transform pipeline

* Add stock adjustments to connectors

* Add XML template

* Add properties file to autoload from Nifi registry

* Add schema mapping file

* Add adjustment reason mapping file

    • -0
    • +4573
    ./TransformReqLineItemLossAdjV2ToV3.xml
    • -0
    • +9
    ./config/services/nifi/casper/adjustment_reasons.txt
Minor changes to transform XML templates

Include requisition status mapping

Release no order should be mapped to release without order.

Add requisition comments/status messages to transform pipeline

* Add comments/status message tables to connectors

* Add XML template

* Add properties file to autoload from Nifi registry

* Add schema mapping file

    • -0
    • +6054
    ./TransformReqStatusMessagesV2ToV3.xml
    • -0
    • +6
    ./config/services/nifi/casper/schema.requisition.requisition_status_messages.txt
Add requisition status changes to transform pipeline

* Add status changes tables to connectors

* Add XML template

* Add properties file to autoload from Nifi registry

* Add schema mapping file

* Technically RELEASED_NO_ORDER is not in the schema, but in the payload, but it is easier to include in the schema mapping file.

    • -0
    • +4311
    ./TransformReqStatusChangesV2ToV3.xml
    • -0
    • +4
    ./config/services/nifi/casper/schema.requisition.requisition_status_changes.txt
Add step in transform requisitions for regen perms

Regenerate requisition permission strings when new requisition is inserted.

Make Casper pipeline more robust

* Fix demo data to match new eLMIS demo data.

* Give Nifi access to OpenLMIS db, so that it can check a requisition exists before inserting line items. Also, redis is renamed to not conflict with redis running on Ref Distro.

* Transform process groups are added to Nifi registry, so add properties to autoload them into Nifi on startup.

* Modify the preload script to add controller services for Redis

* Add updated transform templates

    • -1104
    • +2547
    ./TransformReqLineItemsV2ToV3.xml
    • -2087
    • +1994
    ./TransformRequisitionsV2ToV3.xml
    • -1
    • +2
    ./config/services/nifi/casper/facilities.txt
    • -14
    • +5
    ./config/services/nifi/casper/orderables.txt
    • -1
    • +1
    ./config/services/nifi/casper/programs.txt
    • -2
    • +5
    ./config/services/nifi/scripts/preload.sh
Create Nifi transform for requisition line items

This requires some additional logic in the requisition transform. Requisitions are saved in a cache with the V3 UUID mapping, in order to ensure coordination (requisitions saved before line items to avoid foreign key violations). This is saved after publishing to Kafka, in order for requisitions to go through the pipeline before line items. Each line item checks for existence of its parent requisition in the cache before continuing through the pipeline. Line items are also saved in the cache for their children (losses and adjustments).

Redis with persistence and a mapping volume has been added to docker compose for this cache.

    • -0
    • +3350
    ./TransformReqLineItemsV2ToV3.xml
    • -2818
    • +4260
    ./TransformRequisitionsV2ToV3.xml
    • -0
    • +7
    ./casper-delete-topic.sh
    • -0
    • +14
    ./config/services/nifi/casper/orderables.txt
    • -0
    • +16
    ./config/services/nifi/casper/schema.requisition.requisition_line_items.txt
Get OpenLMIS Debezium Connect from DockerHub

Instead of building it each time at startup.

Initial files for Project Casper

    • -0
    • +3422
    ./TransformRequisitionsV2ToV3.xml
    • -0
    • +22
    ./casper-register-v2-source.json
    • -0
    • +3
    ./casper-register-v2-source.sh
    • -0
    • +15
    ./casper-register-v3-sink.json
    • -0
    • +3
    ./casper-register-v3-sink.sh
    • -0
    • +1
    ./config/services/nifi/casper/facilities.txt
    • -0
    • +6
    ./config/services/nifi/casper/processing_periods.txt
    • -0
    • +1
    ./config/services/nifi/casper/programs.txt
    • -0
    • +1
    ./config/services/nifi/casper/supervisory_nodes.txt
    • -0
    • +45
    ./docker-compose.casper.yml
Add OpenLMIS Debezium Kafka Connect Docker image

For project Casper. This is so we do not have to keep building the image on starting up the Casper stack.

    • -0
    • +9
    ./debezium-connect/Dockerfile
    • -0
    • +4
    ./debezium-connect/README.md
Check if all process groups have been loaded

Check if all expected containers are started

    • -0
    • +14
    ./Tests/nifi-test.sh
Updating flow version to 8

This was due to a change in the failure to load the client secrets and I changed the name from Check for Measures to Get Measures so we are able to use the autoload script.

OLMIS-6324 Changing stock filter time range to be Last 3 years

instead of the last 10 days. No results are showing up in the demo data set because the filter is for the last 10 days and no activities have happened in the last 10 days.

Update generate measures version

Remove unnecessary dbdata volume

Remove unnecessary dbdata volume