Evaluating performances of a RDF store as a DBMS is painful. RDF don't need schema, SQL tables too.
StrixStore vs Sqlite3(Lua API)
This test try to compare a simple use of StrixStore against an sqlite use (because sqlite is an easy to deploy and very fast SQL embedded DBMS). We use a LuaSqlite3 module. We provide the Lua module lsqlite3.dll to encourage third-party tests.
The test is based on a simple synthesized social network (see bench_sqlite.lua). It generates a list of people (nbSample=1000) with a random name. Random relations (foaf:knows) are generated for each Person (knowsMin=5 knowsMax=15). These data are inserted in sqlite and in StrixStore.
Performances of SELECT are made on iterations (nbSelect=1000) of the request of all Person that a random selected Person knows.
Tests are made on an Apple IMAC (2008) under Windows XP (with BootCamp).
------------------ create RDF store ------------
------------------ create Sqlite database ------------
------------------ building datas ------------
------------------ start ------------
SQLITE INSERT = 0.531
RDF turtle INSERT = 0.594
SQL SELECT = 0.156
RDF SPARQL = 0.046999999999999
------------ SECOND SELECT TEST ----
SQL SELECT = 0.891
RDF SPARQL = 0.25
COMMENTS:
- SQLITE insertion is a little more faster.
- StrixStore SPARQL queries are 3 times faster.
- But using a third-party library for sqlite and a Lua API introduces a skew. The performance test.
Now, changing the size of data: more Persons (nbSelect=10000) and more possible relations (knowsMax=50).
------------------ create RDF store
------------
------------------ create Sqlite database ------------
------------------ building datas ------------
------------------ start ------------
SQLITE INSERT = 0.515
RDF turtle INSERT = 0.625
SQL SELECT = 0.156
RDF SPARQL = 0.047000000000001
------------ SECOND SELECT TEST ----
SQL SELECT = 0.907
RDF SPARQL = 0.234
Same conclusions....
StrixStore vs Sqlite3 (C++ API)
For this test we will use more serious data:
Wordnet 2 (Wordnet
3 conversion in RDF in only in alpha release see
http://semanticweb.cs.vu.nl/lod/wn30/).
TO PUBLISH....
StrixStore vs Jena
IT IS SO HARD TO USE JENA ...... Coming soon.