andi/perfdb
1
0
Fork 0
Code Issues 1 Pull Requests Packages Projects Releases Activity
663 Commits 2 Branches 0 Tags
cda7a43c891dbc118a5b5d7123c6083cd163d914
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
andi cda7a43c89 update js libs 2021-03-06 08:34:01 +01:00
andi 2bdbac328a update 3rd party libs 2021-03-06 08:33:00 +01:00
andi e6e869dc2f update JS libs 2021-02-19 19:37:07 +01:00
andi 519e9f34c3 update 3rd party libs 2021-02-19 19:25:02 +01:00
andi 6837fd67aa update node 2021-02-17 17:52:13 +01:00
andi c4a3ca4422 fix protractor security issue 2021-02-17 17:43:10 +01:00
andi e9e46d810f update node-gradle plugin 2021-02-17 17:41:29 +01:00
andi 0ffbae6ec3 update JS libs 2021-02-17 17:35:45 +01:00
andi 492efab78c update libs 2021-02-17 17:32:14 +01:00
andi 3763d09fa8 sort/filter by max average ratio 2020-12-01 17:10:40 +01:00
andi 5498be6a86 update antlr to 4.9 2020-11-27 19:54:17 +01:00
andi c6d7f97628 serialize the ingestion of logfiles 
performance improvement of roughly 40%
 2020-11-27 19:49:22 +01:00
andi 08111e0d69 performance improvement: ingest data directly from tmp file 2020-11-24 10:04:21 +01:00
andi 11beda5432 make logging of insertion speed a little nicer 2020-11-24 10:00:53 +01:00
andi 7ad1e95825 add plog downloader scripts 2020-11-24 10:00:24 +01:00
andi 1e59271286 remove obsolete flag that was needed for the vue.js ui 2020-11-24 09:05:07 +01:00
andi 405e5e9799 update typescript 
step 3 of update Angular 10-> 11
 2020-11-23 11:36:36 +01:00
andi 34b80a2864 update angular materials 
step 2 of update Angular 10 -> 11
 2020-11-23 11:32:58 +01:00
andi 398774dbd8 updating angular core and cli 
step 1 of update Angular 10 -> 11
 2020-11-23 11:31:45 +01:00
andi 96bf08431f update nodejs and npm 2020-11-23 11:25:40 +01:00
andi 0bf4270224 update JS libs 2020-11-15 19:16:37 +01:00
andi d3eb61bd62 update dependencies 2020-11-15 13:10:12 +01:00
andi 6dc0e3c250 performance improvement for queries with wildcards 
Computing the union of many LongLists was inefficient, because we were
using a trivial algorithm. I replaced the algorithm with a multi way
merge. The old algorithm had a runtime of O(n!*m) where n is the number
of lists and m the length or the longest list. The new algorithm has a
runtime of O(log(n) * n*m).
 2020-11-15 13:02:15 +01:00
andi 356810c355 use correct average value 2020-11-05 16:45:26 +01:00
andi 3bbf11a4ff use info icon for information buttons 2020-11-05 16:44:29 +01:00
andi 08328ec1e5 extract plot detail view into its own component 2020-11-01 19:13:15 +01:00
andi 50c9e56f2e reduce size of css 2020-10-31 09:58:49 +01:00
andi de6ffe5097 make tests more robust 
1. we are now using a random port for listening
2. TcpIngestor.start() waits until the socket is established.
 2020-10-31 09:46:12 +01:00
andi af4151bc81 update JS libs 2020-10-31 09:15:32 +01:00
andi 0fab0c2e5e update spring boot 2020-10-31 09:11:32 +01:00
andi 50658b22ee make URL of image host independent 2020-10-26 10:52:24 +01:00
andi 6536611b5d print only bar chart tics when they are greater than zero 2020-10-26 10:50:54 +01:00
andi 45c1648773 POC for detailed gallery view 2020-10-18 19:25:53 +02:00
andi e15b16a65f fix development server proxy 2020-10-17 14:27:54 +02:00
andi 2cdc9813da change background in active drop down options 
Seems like the new material version came with weird coloring.
 2020-10-17 10:49:14 +02:00
andi 833f800afa update javascript libraries 2020-10-17 10:19:56 +02:00
andi e8ce242a31 update gradle to 6.7 2020-10-17 10:16:23 +02:00
andi 46070a31b9 add block size to the header of a PersistentMap and optimize storage 
usage for monotonically incrementing keys.
 2020-10-17 10:13:46 +02:00
andi 277dba4c04 adding the blocksize to the metadata section 2020-10-10 17:03:55 +02:00
andi f9ed27f03b method to print some stats for a tree 2020-10-07 18:50:19 +02:00
andi 4749dca73a add reindex method to PersistentMap 2020-10-07 12:30:33 +02:00
andi 5cc16ad2f7 update angular to 10.1.3 2020-10-04 17:21:36 +02:00
andi a3e3c83ffc value cache didn't work when keys didn't implement hashcode/equals 2020-10-04 17:21:16 +02:00
andi fbd07e465b do not add/remove null values 2020-10-04 17:17:32 +02:00
andi ea7ba042df track the cache hit rate 2020-10-04 17:16:52 +02:00
andi d4d3d01405 cache location of root node 
The location of the root node is not cached in the nodeCache. So it had
to be read for every read or write access. We are still using a lock
when accessing the map. That makes it easy to cache the location.
 2020-10-04 16:42:25 +02:00
andi 91c78d4350 use transparent color for parallel request plots 2020-09-28 10:00:51 +00:00
andi d21ef48559 make tic labels optional for bar charts 2020-09-27 20:07:26 +02:00
andi e71ab07440 fix labels overlapping in bar chart x-axis 2020-09-27 20:02:56 +02:00
andi 2f4d1f701b add interval for seconds for bar charts 2020-09-27 17:15:02 +02:00
andi 10155f9cdb use special enum for DateBucket units 
Preparation step for having custom intervals.
 2020-09-27 17:06:27 +02:00
andi 78a0b7d70b use a longer y-axis interval by default 
this helps to not miss interesting events
 2020-09-27 12:50:32 +02:00
andi 550e4401e5 improve javadoc 2020-09-27 12:14:55 +02:00
andi 439bf0b05b reduce log level 2020-09-27 08:21:37 +02:00
andi b8f77dc9a6 replace custom timezones with UTC 
we are only using UTC
 2020-09-27 08:21:24 +02:00
andi 273c019df1 remove unused class RuntimeExcecutionException 2020-09-27 07:53:52 +02:00
andi f1980b1963 log more details about search performance 2020-09-20 19:52:08 +02:00
andi 6bb6cdaea7 count disk reads 2020-09-20 19:51:47 +02:00
andi 69f12aba98 prevent labels from overlapping 2020-09-20 09:14:04 +02:00
andi 70430eb1fd missing locale in String.format() 2020-09-20 09:13:42 +02:00
andi d26cd4138e add line break for labels of bar charts 2020-09-20 09:12:10 +02:00
andi e06f4175a3 illegal state exception when using interval 'year' 2020-09-20 09:11:45 +02:00
andi 6755411a5d update JS libraries 2020-09-19 19:09:56 +02:00
andi c4ae1c431b add test for a date pattern without the 'T' 2020-09-19 19:03:57 +02:00
andi 0b87536d91 update libraries 2020-09-19 19:00:56 +02:00
andi 8647931da8 create testing config 2020-05-08 14:49:04 +00:00
andi 51bd043bf7 update gradle and spring boot 2020-05-08 14:48:50 +00:00
andi 0228604980 use com.github.node-gradle.node instead of com.moowork.node 
moowork is no longer maintained and does not work with gradle 6
 2020-03-11 07:55:11 +00:00
andi 6b12a24c62 increase maximum file size for uploads 2019-12-15 18:23:53 +01:00
andi 00ba4d2a69 add support for renaming and post processing of csv columns 2019-12-14 18:11:59 +01:00
andi 1124dc8082 do not add the column name of ignored columns to the dictionary 2019-12-14 08:35:07 +01:00
andi 7737d45887 define name of value column 
The name of the column containing the value is now part of the
csv settings. This allows us to use different names than "duration".
 2019-12-14 08:34:33 +01:00
andi 204c258980 ignore comment lines in CSV files 2019-12-14 08:11:12 +01:00
andi 4e554bfa85 specify additional tags for CSV upload 
You can now specify additional tags to be added to all entries.
This makes it possible to remove columns that would be identical
for all entries.
 2019-12-14 07:59:22 +01:00
andi 5d8df6888d move Entry and Entries to data-store 2019-12-13 18:15:10 +01:00
andi 550d7ba44e add flag to make CSV upload wait until entries are flushed 
To make it easier/possible to write stable unit test the CSV upload
can optionally wait until all entries have been flushed to disk.
This is necessary for tests that ingest data and then read the data.
 2019-12-13 18:05:20 +01:00
andi 07ad62ddd9 use Junit5 instead of TestNG 
We want to be able to use @SpringBootTest tests that fully initialize
the Spring application. This is much easier done with Junit than TestNG.
Gradle does not support (at least not easily) to run Junit and TestNG
tests. Therefore we switch to Junit with all tests.
The original reason for using TestNG was that Junit didn't support
data providers. But that finally changed in Junit5 with
ParameterizedTest.
 2019-12-13 14:33:20 +01:00
andi 394e16ad27 make time column configurable 
Adding the header of the time column to the
CsvReaderSettings. This is necessary to parse
arbitrary CSV files.
 2019-12-09 18:59:48 +01:00
andi d383134c42 add support for ISO-like date formats 
Recommind is using a pseudo ISO date format for their
log files. It uses a comma instead of a dot for the
second to milli second separator and it does not
add a timezone. Dates without timezone are assumed to be UTC.
 2019-12-09 18:40:14 +01:00
andi 620f58d8e5 cleanup: remove definition for mustache dependency 2019-12-08 20:20:38 +01:00
andi 60f1a79816 add settings to file upload 
This makes it possible to define properties for
the uploaded CSV files. Currently we can define the
separator and which columns are to be ignored.
 2019-12-08 20:20:13 +01:00
andi e931856041 merge projects file-utils, byte-utils and pdb-utils 
It turned out that most projects needed at least
two of the utils projects. file-utils and byte-utils
had only one class. Merging them made sense.
 2019-12-08 18:47:54 +01:00
andi 85679ca0c8 send CSV file via REST 2019-12-08 18:39:43 +01:00
andi f1ef13c1de add inputs/outputs to npm_run_build 
Fixes the up-to-date check for npm_run_build.
 2019-12-07 08:34:36 +01:00
andi 52a3cdc42b remove dependency to SpringBoot Mustache 
It is no longer needed since we switched to Angular.
 2019-12-07 08:33:40 +01:00
andi 08cc27600e update SpringBoot to 2.2.2.RELEASE 2019-12-07 08:32:03 +01:00
andi 30504672bc extend CsvReaderSettings by list of columns that will not be indexed 2019-12-01 09:21:07 +01:00
andi ffe5ae8652 add CsvReaderSettings 
Preparation to add more complex CSV parsing rules.
 2019-11-30 18:32:34 +01:00
andi 08b1be5334 extract CSV reading code to new file 
Refactoring to prepare the addition of CSV parsing rules. The parsing
rules will contain information about which columns to ingest or ignore.
This will be used to add the ability to upload files via HTTP post in
addition to the TcpIngestor.
 2019-11-30 17:58:01 +01:00
andi 0cdf30e9a2 optimize SVG icons 
The icons were made with Inkscape. This tool does not care
for file size. By rewriting the icons by hand I could reduce
the file size siginificantly. E.g. 6.1kb to 441 bytes for
cumulative-distribution-chart.svg.
 2019-11-30 09:35:02 +01:00
andi 4e1b7a46d8 fix x-axis labels overlap when zooming out 
The x-axis labels overlapped when zooming out too far.
Fixed by increasing the step size and reducint the labels to
year only.
 2019-11-30 08:44:29 +01:00
andi 9451feb268 add link to other solutions for the Angular/SpringBoot issue 2019-11-29 20:09:03 +01:00
andi 2dd513c380 Fix build by adding dependency to commons-lang3. 
Classpathes in Eclipse are different from classpathes in Gradle due to
Gradle's 'implementation' configuration which does not provide
dependency transitively in Gradle.
 2019-11-29 20:07:03 +01:00
andi 8832d52ceb enable new Angular application 
Remove the controller method that returned the VueJS index page.
Add resource handlers that redirect to the Angular application.
I added two implementations, but activated only one. At the moment I am
not sure which solution is the better. We keep both so that we can
easily switch if need arises.
 2019-11-29 20:04:54 +01:00
andi 2d4104e6c1 remove old VueJS application 2019-11-29 20:00:58 +01:00
andi 51ba287ace progress bar and abort for gallery 
Generating all images for a gallery view can take
long. It might not be obvious when the computation
is done, because there is no progress indicator.
Fixed by adding a progress bar.

You might want to abort the computation. E.g.
because you already found what you were looking
for or you want to change the parameters.
This can now be done by clicking 'Abort'.
Note, it does not abort the current computation.
 2019-11-29 09:57:15 +01:00
andi 20b710547f use one multi-select drop down for plot type 
All plot types we currently have can be combined
in one image. So there is no need to compute
combinable types.
 2019-11-24 10:53:30 +01:00
andi 06b379494f apply new code formatter and save action 2019-11-24 10:20:43 +01:00
andi 5ea82c6a4c enforce specific code formatter settings 2019-11-24 10:18:11 +01:00
andi e2a33ac6e2 make the code that determines which axis to use explicit 
In the previous changeset the code that determined
which axis the plots used was implemented as a
side effect of getting the Gnuplot definition of
an axis.
Changed that to an explit update call with simpler
logic.
 2019-11-24 09:08:36 +01:00