Commit Graph

90 Commits

Author SHA1 Message Date
f22be73b42 switch the byte prefix of DATE_INCREMENT and MEASUREMENT
Date increments have usually higher values. 
I had hoped to reduce the file size by a lot. But in my example data
with 44 million entries (real life data) it only reduced the storage 
size by 1.5%.
Also fixed a bug in PdbReader that prevented other values for the 
CONTINUATION byte.
Also added a small testing tool that prints the content of a pdb file.
It is not (yet) made available as standalone tool, but during
debugging sessions it is very useful.
2017-04-13 20:19:29 +02:00
1163c1ca22 ignore 'test-output' directory
This is a TestNG output directory.
2017-04-13 20:12:55 +02:00
58f8606cd3 use special logger for insertion metrics
This allows us to enable/disable metric logging without having to log 
other stuff.
2017-04-13 20:12:00 +02:00
ce44c3d8d6 add logarithmic scaling for the y-axis
Often we have a few very high values and a lot
low values. With a linearly scaled y-axis the
plot is mostly useless.
2017-04-12 19:59:35 +02:00
8baf05962f group by multiple fields
Before we could only group by a single field. But it is acutally
very useful to group by multiple fields. For example to see the
graph for a small set of methods grouped by host and project.
2017-04-12 19:16:19 +02:00
6cc6e679a4 sort fields in 'group by' 2017-04-11 18:39:12 +02:00
ee15594070 remove TODOs
They don't make sense anymore.
E.g. the Tags class is used by classes outside of
org.lucares.performance.db.
2017-04-11 18:09:29 +02:00
cc7e461ebf replace PdbRepository with @Bean annotated method 2017-04-11 18:06:33 +02:00
b8b4a6d760 remove deprecated constructor and getter 2017-04-10 20:15:22 +02:00
ac8ad8d30f close open files when no new entries are received
If for 10 seconds no new entry is received, then all open 
files are flushed and closed.
We do this to make sure, that we do not loose data, when
we kill the process.
There is still a risk of data loss if we kill the process
while entries are received.
2017-04-10 20:13:10 +02:00
24259d7d72 replace log4j2.properties with log4j2.xml
The properties support for log4j2 is not well documented and
possibly buggy. I couldn't figure out how to change the log
level of a logger.
2017-04-10 19:50:49 +02:00
72436e9c8c extract utility method
a method to send json over tcp can be used by several tests
2017-04-08 08:21:50 +02:00
81b7cfa7bd add default size so that we don't have to specify it in tests 2017-04-08 08:20:59 +02:00
d72d6df0f4 update third-party libraries 2017-04-08 08:18:39 +02:00
ed17d84da4 remove obsolete and disabled test 2017-04-08 08:18:17 +02:00
7b92a306f3 remove warning by using the logger 2017-04-02 11:15:41 +02:00
2d78a70883 duration for inserts was wrong
The bug was, that we computed the difference between millis and nanos.
Also log duration for flushes.
2017-04-02 11:15:24 +02:00
cd6b71d35a use shorter folder names
reduces the risk of too long file names
2017-04-02 11:13:08 +02:00
8ddae957f5 make location of log4j config file configurable 2017-04-02 11:12:22 +02:00
4ec91a4d17 update console log layout pattern
Use pattern similar to spring boot's default.
2017-04-02 11:11:49 +02:00
5fb285a4b4 gnuplot needs forward slashes even on windows 2017-04-01 19:15:28 +02:00
46ce445010 return information about the plotted sequences
this information can be used for tests
2017-04-01 18:27:43 +02:00
2875237272 replace the dateTo with an interval
I hope an interval is easier to handle than having 
to change two date fields
2017-03-27 20:07:32 +02:00
726258020f make it possible to specify the time in the range 2017-03-27 19:38:02 +02:00
364997e611 show better error message, when no data points are found 2017-03-26 17:30:50 +02:00
ee00ecb4b5 remove obsolete class 2017-03-20 19:02:01 +01:00
7cf638400c ignore application properties for the 'dev' profile 2017-03-20 18:55:59 +01:00
c245a1f7d4 fix typo that broke the gnuplot integration 2017-03-20 18:52:48 +01:00
cc71a32d27 make location of gnuplot configurable 2017-03-19 20:04:07 +01:00
ea905c2315 replace sysout with logger 2017-03-19 09:20:00 +01:00
9ab5d76d93 better exception logging 2017-03-19 09:08:41 +01:00
aadc9cbd21 move TcpIngestor to pdb-ui
and start it in the web application.
Also use the spring way of handling property files.
2017-03-19 08:00:18 +01:00
16f9c92d13 add special logger for throughput metrics
so that we can enable/disable it individually
2017-03-18 10:20:14 +01:00
a01c8b3907 fix flaky test and improve error handling
just ignore invalid entries
2017-03-18 10:14:41 +01:00
a221259417 remove project pdb-keyword-db
it was only created to test how fast a keyword db implementation would
be that works with integer arrays
2017-03-17 16:26:00 +01:00
513c256352 update third party libraries 2017-03-17 16:23:21 +01:00
ade8463e46 update to jquery 3.2.0 2017-03-17 16:12:18 +01:00
182a907466 replace flex boxes with new grids 2017-03-17 13:13:12 +01:00
3456177291 add date range filter 2017-03-17 11:17:57 +01:00
8cc42916a4 scroll in autocomplete proposals 2017-02-12 19:43:35 +01:00
f178603bc1 add time to x-axis labels only if range is less than two weeks 2017-02-12 19:08:42 +01:00
5aee6f5e4d use label '<none>' to for values that have not value for groupBy field 2017-02-12 18:56:37 +01:00
e0a2c90cfe make active row in autocomplete proposals better visible 2017-02-12 18:23:52 +01:00
141e090129 ignore user properties 2017-02-12 18:20:50 +01:00
a0f67c383c remove user config 2017-02-12 18:20:38 +01:00
d137f7c9cb limit the number of plots 2017-02-12 18:17:36 +01:00
e47519e6d9 change button 'search' to 'plot'
add label to 'groupBy' option
2017-02-12 12:34:18 +01:00
becd04ed13 set terminal mode for gnuplot to noenhanced
otherwise labels are parsed as LaTeX
2017-02-12 11:15:37 +01:00
562dadb692 group plots by field 2017-02-12 09:59:14 +01:00
b238849d65 use text input for filtering, again 2017-02-12 09:32:46 +01:00