Results for the SP²Bench SPARQL Performance Benchmark (SP2)

The SP2 benchmark comprises a data-generator for arbitrarily large documents, which builds upon the well-known DBLP scenario, and thus comes close to a real-world application scenario. The benchmark’s queries make meaningful requests against this data while also testing typical SPARQL operator constellations and RDF access patterns. With this focus, the benchmark can help tune existing SPARQL engines and detect deficiencies in them.

AllegroGraph's SPARQL, one of the W3C's "interoperable implementations", includes a query optimizer, and has full support for named graphs. It can be used with the RDFS++ reasoning (i.e., query over real and inferred triples). SPARQL can be used with all the available AllegroGraph interfaces (Java, Python, Ruby, Perl, C#, Clojure, Lisp, etc).

SP2 - 25 Million Dataset Results (Query Time in seconds)

Query #
# Results
Query Time #1
Query Time #2
Query Time #3
1
1
0.066
0.004
0.001
2
1,876,999
25.592
24.483
24.387
3a
594,890
1.955
1.962
1.954
3b
4,075
0.284
0.280
0.279
3c
0
0.316
0.304
0.305
4
113,634,340
982.168
1,016.813
914.367
5a
696,681
42.366
31.138
30.979
5b
696,681
19.642
19.525
19.535
6
1,945,167
45.790
46.425
46.443
7
5,099
17.211
15.900
15.923
8
493
0.323
0.204
0.206
9
4
45.284
38.185
38.273
10
656
0.003
0.001
0.001
11
10
26.430
9.967
9.959
12a
Yes
0.122
0.097
0.097
12b
Yes
0.019
0.018
0.018
12c
No
0.001
0.001
0.001

SP2 - 1 Million Dataset Results (Query Time in seconds)

Query #
# Results
Query Time #1
Query Time #2
Query Time #3
Competitor
1
1
0.003
0.002
0.002
0.020
2
32,770
0.825
0.831
0.794
20.217
3a
52,676
0.197
0.195
0.185
4.371
3b
379
0.052
0.051
0.051
0.237
3c
0
0.040
0.038
0.039
0.171
4
2,586,733
26.406
22.616
22.876
NA
5a
35,241
1.305
1.304
1.354
NA
5b
35,241
0.931
0.937
0.961
7.737
6
62,795
1.445
1.440
1.509
18.237
7
292
0.943
0.784
0.823
NA
8
400
6.470
0.467
0.453
1.851
9
4
1.426
1.429
1.438
2.579
10
572
0.002
0.002
0.002
0.152
11
10
1.469
1.466
1.352
0.460
12a
Yes
1.208
1.204
1.183
NA
12b
Yes
0.464
0.465
0.458
NA
12c
No
0.006
0.005
0.005
NA

SP2 - 5 Million Dataset Results (Query Time in seconds)

Query #
# Results
Query Time #1
Query Time #2
Query Time #3
Competitor
1
1
0.002
0.002
0.005
0.018
2
248,738
5.189
5.233
5.090
152.622
3a
192,373
0.878
0.879
0.823
20.513
3b
1,317
0.082
0.082
0.084
0.727
3c
0
0.153
0.152
0.151
0.608
4
18,362,955
172.973
169.715
217.747
NA
5a
210,662
7.591
13.962
14.610
NA
5b
210,662
4.111
4.124
4.120
50.440
6
417,625
9.077
9.348
8.780
122.003
7
1,200
33.416
32.898
33.019
NA
8
493
1.316
1.069
1.279
10.446
9
4
7.955
7.968
7.697
14.080
10
656
0.003
0.002
0.001
0.525
11
10
8.483
8.485
8.462
2.133
12a
Yes
7.432
7.452
7.644
NA
12b
Yes
6.303
1.352
1.254
NA
12c
No
0.007
0.005
0.005
NA

The platform for the test was 2 - 4 core Intel E5520 Processors at 2.26 GHz, with 48 GB RAM, running Fedora 14.

Copyright © 2014 Franz Inc., All Rights Reserved | Privacy Statement
Delicious Google Buzz Twitter Google+