Data Pipeline - configuring runtime

Configure processes.xml file

Data pipeline is a separate module that must be configured in your application-processes.xml file. Here is a sample configuration:

<processes>
    <process name="APPLICATION_DATAPIPELINE">
        <groupId>APPLICATION</groupId>
        <start>true</start>
        <options>-Xmx1024m</options>
        <module>genesis-pal-datapipeline</module>
        <package>global.genesis.datapipeline.pal</package>
        <script>trades-datapipeline.kts</script>
        <description>Optional description</description>
        <language>pal</language>
        <loggingLevel>TRACE,DATADUMP_ON</loggingLevel>
    </process>
</processes>

Configure

Ensure that you also update your application-service-definitions.xml file with your new pipeline.

<configuration>
    ...
    <service host="localhost" name="APPLICATION_DATAPIPELINE" port="11003"/>
    ...
</configuration>

note

It is vital to ensure that any system definition variables that are used by the configuration definition are properly defined in your application-system-definition.kts file.