This panel shows information about data freshness. Looking at this panel we can check whether retrieval processes are working as expected. Basically, for each data source, you’ll find information about how many items we are currently storing in our system, dates of oldest and newest items, when we start indexing them in Elastic Search and when the most recent item was indexed.
To show this information, in this panel we’ll find a widget (also called visualization in Kibana) for each and every data source showing the following entries:
In case you need to work with this panel or any of its widgets, below you can find the correspondence between stored fields and widget texts:
Brief description of what used fields should contain:
metadata__updated_on: date of creation or last update of an item in its data source (git, gerrit, etc.)
metadata__timestamp: date in which a given item was indexed in Elastic Search.
An item that was created in git on 2014-10-21 and it is recovered and indexed today in our system will have 2014-10-21 stored in
metadata__updated_on and today’s date in
metadata__timestamp. Here we show simplified dates, as you can see in Data Status Panel we are storing dates with milliseconds precision.
Edit this doc