Elasticsearch Multiple Index Queries

Queries, aggregations, and joins across indexes

These great companies chose Knowi

Knowi goes beyond Kibana

There is a lot that you cannot traditionally do with Elasticsearch and Kibana. The most common pain points among these are doing joins and aggregations with multiple indexes. Now, Knowi solves that by placing our analytics layer on top of your existing ELK stack.  Unlike with Kibana, Knowi can visualize data from multiple indexes and of different data types in the same dashboard or visualization. Elasticsearch analytics made easy.

Dynamic Data

Join & Aggregate

With Knowi you can join and aggregate (sum, min, max, group by, etc) multiple indexes

Direct Access

Use With Other Databases

Knowi can pull in data from countless other databases and even REST APIs

Self Service

Visual Query Building

Build queries and aggregations easily with our drag-and-drop visual builder or write out your queries by hand

Ready to try Knowi with your Elasticsearch data?

Elasticsearch Multi-Index Analytics

Why Use Multiple Indexes with Elasticsearch?

There are many reasons users employ multiple indices in their Elasticsearch clusters. One common use-case is one of practicality: deleting many documents is laborious, whereas deleting an index is quick and has the same result.

Practices like this are particularly common in  IoT analytics where there is such a high throughput of data, data is frequently being added and removed. When dealing with such large volumes and velocities of hot data, the flexibility of multi-index queries and aggregations allows you to partition your data however works best for your application. You don't have to cram everything into one index. But unless you're using a solution like Knowi, you have to choose between flexible index architectures and analytics.

Read more about Elasticsearch analytics.

An Alternative to Kibana

But wait, isn't there a way to do queries across indexes in Elasticsearch?

Yes and no. Although Elasticsearch allows you to specify the "scope" of your search to include multiple indexes with a comma-delimited list, it can not be readily used for more complex operations, aggregations, or joins. And because you cannot do aggregations or joins, the query results cannot be used Kibana visualizations when it involves data from more than one index. 

With Knowi, however, you can easily run searches, queries, aggregations, and joins with multiple indexes and visualize that data in business intelligence dashboards.  You can even access and run operations and analytics on your data that is stored in non-elasticsearch data sources, structured or unstructured. You can even pull in data from REST APIs.

Read more about using Knowi as your Kibana alternative.

Nlp Data Visualizations.jpg

Frequently Asked Questions

Questions and answers about multi-index joins and aggregations on Elasticsearch and Kibana

Some of our customers do deploy Knowi and Kibana together and use one or the other depending on the application. But the more common case is to use Knowi as a Kibana alternative . This is because it can duplicate the things Kibana does well, but can also do analytics with multiple databases and REST APIs .

Yes, we've got an AWS version in the works. Contact us at support@knowi.com and we will get you set up as one of our AWS-deployment early adopters.

Yes. Although the Type field in Elasticsearch is being depreciated. So we would recommend another approach.

Not sure how to move on from the Type field? Send us an email to support@knowi.com. We would love to help you come up with a solution.

Many members of our team are active contributors to open source projects and we strongly believe in the open source model but Knowi is not an open source platform. We considered it and may reconsider in the future. But to be honest and kind of blunt, we are doing things that none of our competitors are, and we don’t want them to fork our code. We’re a small dynamic team and, at least for now, we’d like to hold on to that competitive edge.

That said, Knowi natively connects to nearly all open source databases and is super easy to integrate. So it will fit nicely in any open source stack.

Tired of being limited by Kibana?

Field Options
Date Options
 
Add Filter

Select Boolean operations for the filter:

 
Add Sorting
 
Value:   Value cannot be empty