Commit Graph
100 Commits
Author SHA1 Message Date
andi 08328ec1e5 extract plot detail view into its own component 2020-11-01 19:13:15 +01:00
andi 50c9e56f2e reduce size of css 2020-10-31 09:58:49 +01:00
andi de6ffe5097 make tests more robust
1. we are now using a random port for listening
2. TcpIngestor.start() waits until the socket is established.
2020-10-31 09:46:12 +01:00
andi af4151bc81 update JS libs 2020-10-31 09:15:32 +01:00
andi 0fab0c2e5e update spring boot 2020-10-31 09:11:32 +01:00
andi 50658b22ee make URL of image host independent 2020-10-26 10:52:24 +01:00
andi 6536611b5d print only bar chart tics when they are greater than zero 2020-10-26 10:50:54 +01:00
andi 45c1648773 POC for detailed gallery view 2020-10-18 19:25:53 +02:00
andi e15b16a65f fix development server proxy 2020-10-17 14:27:54 +02:00
andi 2cdc9813da change background in active drop down options
Seems like the new material version came with weird coloring.
2020-10-17 10:49:14 +02:00
andi 833f800afa update javascript libraries 2020-10-17 10:19:56 +02:00
andi e8ce242a31 update gradle to 6.7 2020-10-17 10:16:23 +02:00
andi 46070a31b9 add block size to the header of a PersistentMap and optimize storage
usage for monotonically incrementing keys.
2020-10-17 10:13:46 +02:00
andi 277dba4c04 adding the blocksize to the metadata section 2020-10-10 17:03:55 +02:00
andi f9ed27f03b method to print some stats for a tree 2020-10-07 18:50:19 +02:00
andi 4749dca73a add reindex method to PersistentMap 2020-10-07 12:30:33 +02:00
andi 5cc16ad2f7 update angular to 10.1.3 2020-10-04 17:21:36 +02:00
andi a3e3c83ffc value cache didn't work when keys didn't implement hashcode/equals 2020-10-04 17:21:16 +02:00
andi fbd07e465b do not add/remove null values 2020-10-04 17:17:32 +02:00
andi ea7ba042df track the cache hit rate 2020-10-04 17:16:52 +02:00
andi d4d3d01405 cache location of root node
The location of the root node is not cached in the nodeCache. So it had
to be read for every read or write access. We are still using a lock
when accessing the map. That makes it easy to cache the location.
2020-10-04 16:42:25 +02:00
andi 91c78d4350 use transparent color for parallel request plots 2020-09-28 10:00:51 +00:00
andi d21ef48559 make tic labels optional for bar charts 2020-09-27 20:07:26 +02:00
andi e71ab07440 fix labels overlapping in bar chart x-axis 2020-09-27 20:02:56 +02:00
andi 2f4d1f701b add interval for seconds for bar charts 2020-09-27 17:15:02 +02:00
andi 10155f9cdb use special enum for DateBucket units
Preparation step for having custom intervals.
2020-09-27 17:06:27 +02:00
andi 78a0b7d70b use a longer y-axis interval by default
this helps to not miss interesting events
2020-09-27 12:50:32 +02:00
andi 550e4401e5 improve javadoc 2020-09-27 12:14:55 +02:00
andi 439bf0b05b reduce log level 2020-09-27 08:21:37 +02:00
andi b8f77dc9a6 replace custom timezones with UTC
we are only using UTC
2020-09-27 08:21:24 +02:00
andi 273c019df1 remove unused class RuntimeExcecutionException 2020-09-27 07:53:52 +02:00
andi f1980b1963 log more details about search performance 2020-09-20 19:52:08 +02:00
andi 6bb6cdaea7 count disk reads 2020-09-20 19:51:47 +02:00
andi 69f12aba98 prevent labels from overlapping 2020-09-20 09:14:04 +02:00
andi 70430eb1fd missing locale in String.format() 2020-09-20 09:13:42 +02:00
andi d26cd4138e add line break for labels of bar charts 2020-09-20 09:12:10 +02:00
andi e06f4175a3 illegal state exception when using interval 'year' 2020-09-20 09:11:45 +02:00
andi 6755411a5d update JS libraries 2020-09-19 19:09:56 +02:00
andi c4ae1c431b add test for a date pattern without the 'T' 2020-09-19 19:03:57 +02:00
andi 0b87536d91 update libraries 2020-09-19 19:00:56 +02:00
andi 8647931da8 create testing config 2020-05-08 14:49:04 +00:00
andi 51bd043bf7 update gradle and spring boot 2020-05-08 14:48:50 +00:00
andi 0228604980 use com.github.node-gradle.node instead of com.moowork.node
moowork is no longer maintained and does not work with gradle 6
2020-03-11 07:55:11 +00:00
andi 6b12a24c62 increase maximum file size for uploads 2019-12-15 18:23:53 +01:00
andi 00ba4d2a69 add support for renaming and post processing of csv columns 2019-12-14 18:11:59 +01:00
andi 1124dc8082 do not add the column name of ignored columns to the dictionary 2019-12-14 08:35:07 +01:00
andi 7737d45887 define name of value column
The name of the column containing the value is now part of the
csv settings. This allows us to use different names than "duration".
2019-12-14 08:34:33 +01:00
andi 204c258980 ignore comment lines in CSV files 2019-12-14 08:11:12 +01:00
andi 4e554bfa85 specify additional tags for CSV upload
You can now specify additional tags to be added to all entries.
This makes it possible to remove columns that would be identical
for all entries.
2019-12-14 07:59:22 +01:00
andi 5d8df6888d move Entry and Entries to data-store 2019-12-13 18:15:10 +01:00
andi 550d7ba44e add flag to make CSV upload wait until entries are flushed
To make it easier/possible to write stable unit test the CSV upload
can optionally wait until all entries have been flushed to disk.
This is necessary for tests that ingest data and then read the data.
2019-12-13 18:05:20 +01:00
andi 07ad62ddd9 use Junit5 instead of TestNG
We want to be able to use @SpringBootTest tests that fully initialize
the Spring application. This is much easier done with Junit than TestNG.
Gradle does not support (at least not easily) to run Junit and TestNG
tests. Therefore we switch to Junit with all tests.
The original reason for using TestNG was that Junit didn't support
data providers. But that finally changed in Junit5 with
ParameterizedTest.
2019-12-13 14:33:20 +01:00
andi 394e16ad27 make time column configurable
Adding the header of the time column to the
CsvReaderSettings. This is necessary to parse
arbitrary CSV files.
2019-12-09 18:59:48 +01:00
andi d383134c42 add support for ISO-like date formats
Recommind is using a pseudo ISO date format for their
log files. It uses a comma instead of a dot for the
second to milli second separator and it does not
add a timezone. Dates without timezone are assumed to be UTC.
2019-12-09 18:40:14 +01:00
andi 620f58d8e5 cleanup: remove definition for mustache dependency 2019-12-08 20:20:38 +01:00
andi 60f1a79816 add settings to file upload
This makes it possible to define properties for
the uploaded CSV files. Currently we can define the
separator and which columns are to be ignored.
2019-12-08 20:20:13 +01:00
andi e931856041 merge projects file-utils, byte-utils and pdb-utils
It turned out that most projects needed at least
two of the utils projects. file-utils and byte-utils
had only one class. Merging them made sense.
2019-12-08 18:47:54 +01:00
andi 85679ca0c8 send CSV file via REST 2019-12-08 18:39:43 +01:00
andi f1ef13c1de add inputs/outputs to npm_run_build
Fixes the up-to-date check for npm_run_build.
2019-12-07 08:34:36 +01:00
andi 52a3cdc42b remove dependency to SpringBoot Mustache
It is no longer needed since we switched to Angular.
2019-12-07 08:33:40 +01:00
andi 08cc27600e update SpringBoot to 2.2.2.RELEASE 2019-12-07 08:32:03 +01:00
andi 30504672bc extend CsvReaderSettings by list of columns that will not be indexed 2019-12-01 09:21:07 +01:00
andi ffe5ae8652 add CsvReaderSettings
Preparation to add more complex CSV parsing rules.
2019-11-30 18:32:34 +01:00
andi 08b1be5334 extract CSV reading code to new file
Refactoring to prepare the addition of CSV parsing rules. The parsing
rules will contain information about which columns to ingest or ignore.
This will be used to add the ability to upload files via HTTP post in
addition to the TcpIngestor.
2019-11-30 17:58:01 +01:00
andi 0cdf30e9a2 optimize SVG icons
The icons were made with Inkscape. This tool does not care
for file size. By rewriting the icons by hand I could reduce
the file size siginificantly. E.g. 6.1kb to 441 bytes for
cumulative-distribution-chart.svg.
2019-11-30 09:35:02 +01:00
andi 4e1b7a46d8 fix x-axis labels overlap when zooming out
The x-axis labels overlapped when zooming out too far.
Fixed by increasing the step size and reducint the labels to
year only.
2019-11-30 08:44:29 +01:00
andi 9451feb268 add link to other solutions for the Angular/SpringBoot issue 2019-11-29 20:09:03 +01:00
andi 2dd513c380 Fix build by adding dependency to commons-lang3.
Classpathes in Eclipse are different from classpathes in Gradle due to
Gradle's 'implementation' configuration which does not provide
dependency transitively in Gradle.
2019-11-29 20:07:03 +01:00
andi 8832d52ceb enable new Angular application
Remove the controller method that returned the VueJS index page.
Add resource handlers that redirect to the Angular application.
I added two implementations, but activated only one. At the moment I am
not sure which solution is the better. We keep both so that we can
easily switch if need arises.
2019-11-29 20:04:54 +01:00
andi 2d4104e6c1 remove old VueJS application 2019-11-29 20:00:58 +01:00
andi 51ba287ace progress bar and abort for gallery
Generating all images for a gallery view can take
long. It might not be obvious when the computation
is done, because there is no progress indicator.
Fixed by adding a progress bar.

You might want to abort the computation. E.g.
because you already found what you were looking
for or you want to change the parameters.
This can now be done by clicking 'Abort'.
Note, it does not abort the current computation.
2019-11-29 09:57:15 +01:00
andi 20b710547f use one multi-select drop down for plot type
All plot types we currently have can be combined
in one image. So there is no need to compute
combinable types.
2019-11-24 10:53:30 +01:00
andi 06b379494f apply new code formatter and save action 2019-11-24 10:20:43 +01:00
andi 5ea82c6a4c enforce specific code formatter settings 2019-11-24 10:18:11 +01:00
andi e2a33ac6e2 make the code that determines which axis to use explicit
In the previous changeset the code that determined
which axis the plots used was implemented as a
side effect of getting the Gnuplot definition of
an axis.
Changed that to an explit update call with simpler
logic.
2019-11-24 09:08:36 +01:00
andi 892d5a6d08 automatically determine which axis a plot needs 2019-11-24 08:18:52 +01:00
andi 3048f67e9a cleanup 2019-11-23 19:12:23 +01:00
andi 4879c6cdc7 use new icons for axcending/descending 2019-11-23 18:51:40 +01:00
andi 1cc39e3962 create y-axis settings in aggregate handlers 2019-11-23 18:40:31 +01:00
andi 8d55ef4e5f make sure labels for cumulative distribution don't overlap 2019-11-23 14:36:32 +01:00
andi 82a961dbaf move definition of x-axis to the aggregate handlers 2019-11-23 14:28:18 +01:00
andi 84e5f99c4f show big image in gallery view 2019-11-21 19:22:06 +01:00
andi 90331bd029 fix: card grid grid gets streched if vertical space is not used fully
Fixed by adding a container for the card grid.
That way the actual card grid has no height and
is therefore not streched vertically.
2019-11-17 19:57:05 +01:00
andi 5341b5e307 change color palette so that the first color is blue
The color scheme for the page is blue/grey, so it makes
sense to use blue as the main color for plots.
2019-11-17 19:36:48 +01:00
andi a296a2ca55 add mathematical icons 2019-11-17 18:59:34 +01:00
andi 771f61a597 add filters for gallery 2019-11-17 18:59:08 +01:00
andi 70fb84d634 add sorting for gallery 2019-11-17 09:36:37 +01:00
andi 73ea635ac1 render gallery items 2019-11-16 15:14:21 +01:00
andi 3022edb1e1 use snackbar to show error messages 2019-11-16 08:57:39 +01:00
andi 41d30cbc44 update NPM to 6.13.0 2019-11-14 18:54:24 +01:00
andi 57c5cca688 fetch possible values for gallery view 2019-11-14 18:45:32 +01:00
andi 10a7710940 fix CSV parser corrupts duration if duration is last element in line 2019-11-14 18:40:14 +01:00
andi d9b2327f35 make default for 'splitBy' configurable 2019-11-10 16:33:37 +01:00
andi 8d690ff0e7 make filter panel thinner 2019-11-10 16:32:30 +01:00
andi a917e771c6 use custom favicon 2019-11-10 16:08:13 +01:00
andi 0fb7a0aaf6 fix image creation for automatic y-range 2019-11-10 14:22:22 +01:00
andi 4367323fcd replace deprecated dependency configurations
Using api and implementation instead of the
deprecated compile configuration.

Update to Gradle 6.0.
2019-11-10 11:08:50 +01:00
andi ddd71ff14b update libraries 2019-11-10 09:50:56 +01:00
andi 198b51089d make defaults for groupBy configurable
We do not know which fields exist at compile time.
But it is a great help to have some pre-selected
fields in groupBy.
Solved by adding a configuration option.
2019-11-10 09:38:16 +01:00
andi c83d0a3e1e fix overlapping x axis ticks
Gnuplot does not handle long x-axis ticks very good.
It should know how wide the labels are and could adapt
the increment size accordingly, but it doesn't.
Fixed by explicitly defining the increment for x-axis
labels.
2019-11-01 19:13:11 +01:00