Commit Graph

257 Commits

Author SHA1 Message Date
7d3ae61656 rename put to putString to make it easier for ides to find references 2021-10-16 18:45:55 +02:00
bcba117742 do not use static string compressor in upload handlers 2021-09-18 19:41:40 +02:00
8595f989b8 use factory to create CsvToEntryTransformer 2021-08-14 12:44:40 +02:00
67c66ef89d add second parser that uses a standard CSV reader 2021-08-12 17:54:27 +02:00
825bac24b9 add file drop handler
You can define a folder and ingest files dropped into it.
2021-08-07 13:31:44 +02:00
85ed5f1ccb file drop support
- Add a folder where you can drop Zip files which will then be
  extracted on the fly and ingsted.
- CsvReaderSettings now contain TagMatcher that are applied to the
  first line and can be used to extract additional tags.
- Update to jdk 16 so that we can have records.
2021-08-01 09:31:40 +02:00
57927dfbc6 ignore rolled garbage collection logs 2021-07-03 08:43:48 +02:00
932689010f ignore garbage collection logs 2021-07-03 08:36:11 +02:00
ee79cb0022 cleanup after revert 2021-05-12 18:20:34 +02:00
7adfc7029f Revert "introduce indexes"
This reverts commit 36ccc57db6.
2021-05-12 18:18:57 +02:00
36ccc57db6 introduce indexes 2021-05-09 10:33:28 +02:00
d411de0816 Merge branch 'master' of https://bitbucket.com/andreashuber/performance 2021-04-05 14:38:09 +02:00
a1b4c7006d add percentile information if available 2021-04-02 18:29:18 +02:00
faddbfa014 strip prefix "Default" from class names 2021-03-29 15:47:29 +02:00
c6d7f97628 serialize the ingestion of logfiles
performance improvement of roughly 40%
2020-11-27 19:49:22 +01:00
08111e0d69 performance improvement: ingest data directly from tmp file 2020-11-24 10:04:21 +01:00
1e59271286 remove obsolete flag that was needed for the vue.js ui 2020-11-24 09:05:07 +01:00
de6ffe5097 make tests more robust
1. we are now using a random port for listening
2. TcpIngestor.start() waits until the socket is established.
2020-10-31 09:46:12 +01:00
45c1648773 POC for detailed gallery view 2020-10-18 19:25:53 +02:00
e15b16a65f fix development server proxy 2020-10-17 14:27:54 +02:00
d21ef48559 make tic labels optional for bar charts 2020-09-27 20:07:26 +02:00
f1980b1963 log more details about search performance 2020-09-20 19:52:08 +02:00
c4ae1c431b add test for a date pattern without the 'T' 2020-09-19 19:03:57 +02:00
0b87536d91 update libraries 2020-09-19 19:00:56 +02:00
668f86323e Merge branch 'master' of https://bitbucket.org/andreashuber/performance
# Conflicts:
#	build.gradle
#	gradle/wrapper/gradle-wrapper.properties
2020-08-11 17:32:43 +02:00
3e77c2a103 various fixes 2020-08-11 16:12:18 +02:00
8647931da8 create testing config 2020-05-08 14:49:04 +00:00
3239871a1b enable HTTP compression 2020-04-25 12:51:42 +02:00
8e1ca282f6 update production settings 2020-04-17 14:46:56 +00:00
50f555d23c add interval splitting for bar charts 2020-04-05 08:14:09 +02:00
ec4f445b8d use port 17333 by default
Not sure how this is supposed to work. To be able to support
Angular's development server and Spring as a standalone application
I had to hardcode the port Spring uses.
The problem is, that Angular runs on port 4200. Angular is compiled
to static files. So I cannot dynamically add the port that is
configured for Spring. But Angular has to be able to talk to the
Spring application.
I chose port 17333, because it does not collide with the standard
Tomcat port (8080).
2020-03-12 19:54:13 +01:00
57d016245c use y1/y2 axis definitions 2020-02-09 20:14:13 +01:00
859491e99e put y axis definition into its own object 2020-02-09 17:16:27 +01:00
ed7cc9bee5 put y axis definition into its own object 2020-02-08 15:39:41 +01:00
3f9423feea ignore application-test.properties 2020-02-08 08:17:19 +01:00
cf7e5ec968 add bar charts 2020-01-19 10:35:07 +01:00
19e6dd1102 add histogram plots 2019-12-27 12:25:25 +01:00
2268ab40b3 use the invaders game as 'loading screen' 2019-12-26 18:48:33 +01:00
ffc3832bfa fix: events are added to wrong partition
The writerCache in DataStore did not use the partitionId
in its cache key. Therefore the cache could return the
wrong writer and events were written to the wrong
partition.
Fixed by changing the cache key.
2019-12-23 18:42:54 +01:00
6b12a24c62 increase maximum file size for uploads 2019-12-15 18:23:53 +01:00
00ba4d2a69 add support for renaming and post processing of csv columns 2019-12-14 18:11:59 +01:00
1124dc8082 do not add the column name of ignored columns to the dictionary 2019-12-14 08:35:07 +01:00
7737d45887 define name of value column
The name of the column containing the value is now part of the
csv settings. This allows us to use different names than "duration".
2019-12-14 08:34:33 +01:00
204c258980 ignore comment lines in CSV files 2019-12-14 08:11:12 +01:00
4e554bfa85 specify additional tags for CSV upload
You can now specify additional tags to be added to all entries.
This makes it possible to remove columns that would be identical
for all entries.
2019-12-14 07:59:22 +01:00
5d8df6888d move Entry and Entries to data-store 2019-12-13 18:15:10 +01:00
550d7ba44e add flag to make CSV upload wait until entries are flushed
To make it easier/possible to write stable unit test the CSV upload
can optionally wait until all entries have been flushed to disk.
This is necessary for tests that ingest data and then read the data.
2019-12-13 18:05:20 +01:00
07ad62ddd9 use Junit5 instead of TestNG
We want to be able to use @SpringBootTest tests that fully initialize
the Spring application. This is much easier done with Junit than TestNG.
Gradle does not support (at least not easily) to run Junit and TestNG
tests. Therefore we switch to Junit with all tests.
The original reason for using TestNG was that Junit didn't support
data providers. But that finally changed in Junit5 with
ParameterizedTest.
2019-12-13 14:33:20 +01:00
394e16ad27 make time column configurable
Adding the header of the time column to the
CsvReaderSettings. This is necessary to parse
arbitrary CSV files.
2019-12-09 18:59:48 +01:00
d383134c42 add support for ISO-like date formats
Recommind is using a pseudo ISO date format for their
log files. It uses a comma instead of a dot for the
second to milli second separator and it does not
add a timezone. Dates without timezone are assumed to be UTC.
2019-12-09 18:40:14 +01:00