Omnidex Grids are a feature of the Omnidex product line that allows indexes of very large databases (> 300 million rows) to be distributed across multiple processors or servers. This improves performance by allowing a query to be processed on the fewest nodes possible using multiple concurrent processors. This approach allows great scalability and provides convenient mechanisms for adding new data to the database.
An Omnidex Grid consists of one or more computers used in combination to satisfy Omnidex queries. Omnidex Grids can be implemented on one or more large, multi-processor computer or on an array of inexpensive, commodity, PCs. Both types of grids perform well, and each has distinct advantages.
Omnidex Grids provide the advantage of automatic SQL optimization across all nodes. When a database is partitioned manually, the application must perform the tasks of routing queries to the appropriate partitions and merging their results. With an Omnidex Grid, Omnidex will accept SELECT statements to the grid controller, automatically route them to the appropriate nodes and merge the results. This alleviates the work done at the application and allows Omnidex to fully optimize the query.
Many Omnidex Grids are created as an Omnidex Snapshot, meaning that the underlying data is distributed into flat files across multiple directories or servers. This becomes a very high-performing solution that can satisfy a wide variety of queries very quickly. Omnidex Grids can also be created directly against an underlying database.
As a guide Omnidex Grids are ideally suited to ‘Big Data’ requirements to optimise billion record databases.