- Add a folder where you can drop Zip files which will then be
extracted on the fly and ingsted.
- CsvReaderSettings now contain TagMatcher that are applied to the
first line and can be used to extract additional tags.
- Update to jdk 16 so that we can have records.
Not sure how this is supposed to work. To be able to support
Angular's development server and Spring as a standalone application
I had to hardcode the port Spring uses.
The problem is, that Angular runs on port 4200. Angular is compiled
to static files. So I cannot dynamically add the port that is
configured for Spring. But Angular has to be able to talk to the
Spring application.
I chose port 17333, because it does not collide with the standard
Tomcat port (8080).
The writerCache in DataStore did not use the partitionId
in its cache key. Therefore the cache could return the
wrong writer and events were written to the wrong
partition.
Fixed by changing the cache key.
To make it easier/possible to write stable unit test the CSV upload
can optionally wait until all entries have been flushed to disk.
This is necessary for tests that ingest data and then read the data.
We want to be able to use @SpringBootTest tests that fully initialize
the Spring application. This is much easier done with Junit than TestNG.
Gradle does not support (at least not easily) to run Junit and TestNG
tests. Therefore we switch to Junit with all tests.
The original reason for using TestNG was that Junit didn't support
data providers. But that finally changed in Junit5 with
ParameterizedTest.
Recommind is using a pseudo ISO date format for their
log files. It uses a comma instead of a dot for the
second to milli second separator and it does not
add a timezone. Dates without timezone are assumed to be UTC.
Refactoring to prepare the addition of CSV parsing rules. The parsing
rules will contain information about which columns to ingest or ignore.
This will be used to add the ability to upload files via HTTP post in
addition to the TcpIngestor.
