Updated Oxla results. #292
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
github seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account. You have signed the CLA already but the status is still pending? Let us recheck it. |
rschu1ze
reviewed
Jan 23, 2025
| @@ -421,7 +421,7 @@ | |||
| ,{"system":"MySQL","date":"2022-07-01","machine":"c6a.4xlarge, 500gb gp2","cluster_size":1,"comment":"","tags":["C++","row-oriented","MySQL compatible"],"load_time":9472,"data_size":171953585825,"result":[[339.77,339.88,339.77],[364.91,371.86,367.55],[366.2,368.91,389.66],[364.39,377.53,571.45],[377.69,390.02,384.86],[569.48,576.51,574.68],[367.4,368.23,370.41],[371.29,384.02,613.22],[478.85,683.22,495.68],[489.9,635.96,662.43],[386.07,396.49,640.15],[389.13,412.55,444.12],[447.97,455.54,448.06],[423.22,845.44,813.6],[452.48,460.07,453.98],[577.54,623.21,586.49],[852.07,856.36,862.66],[838.09,848.92,851.12],[1006.37,1011.16,1023.17],[369.76,375.61,415.28],[412.45,419.9,456.62],[411.65,432.88,482.2],[412.73,420.73,429.5],[551.16,577.62,545.45],[382.89,394.76,386.37],[380.9,391.4,385.05],[385.3,394.67,460.32],[388.95,394.7,387.21],[800.33,807.90,807.11],[706.03,745.27,718.9],[450.9,489.59,530.97],[625.5,651.93,647.32],[2721.13,2792.12,2819.26],[945.9,954.94,957.54],[945.42,953.78,965.16],[684.36,716.29,708.75],[10.01,3.79,3.77],[7.48,3.32,3.27],[5.09,0.98,0.96],[8.70,4.77,4.68],[4.82,0.76,0.74],[4.46,0.77,0.75],[7.04,1.17,1.13]],"source":"mysql/results/c6a.4xlarge.json"} | |||
| ,{"system":"OctoSQL","date":"2024-11-25","machine":"c6a.4xlarge, 500gb gp2","cluster_size":1,"comment":"","tags":["Go","stateless"],"load_time":0,"data_size":14737666736,"result":[[7.09,6.625,6.622],[41.354,40.93,40.846],[49.831,48.597,48.672],[null,null,null],[null,null,null],[null,null,null],[60.505,60.168,59.693],[41.979,40.98,40.871],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[61.997,59.664,60.335],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null],[null,null,null]],"source":"octosql/results/c6a.4xlarge.json"} | |||
| ,{"system":"Opteryx","date":"2025-01-12","machine":"c6a.4xlarge, 500gb gp2","cluster_size":1,"tags":["stateless","column-oriented","serverless","embedded"],"load_time":0,"data_size":14737666736,"result":[[1.251006235,0.080118607,0.079875281],[2.645037241,0.327796665,0.322614463],[6.387398368,1.504896835,1.499059588],[7.460576192,0.987895168,0.966523026],[4.401359451,0.912877849,0.893981607],[12.320326644,7.069771109,7.092357523],[3.935113921,1.243809051,1.243042595],[1.896092628,0.332665942,0.333926139],[5.798907738,1.688745059,1.660498791],[8.716103374,2.802368571,2.76843743],[4.906623416,0.858288399,0.864481993],[4.643145917,0.91338155,0.917756443],[8.638826312,5.027937472,5.024799922],[11.103621078,5.122953438,5.059397517],[9.971599601,5.994739178,6.056814905],[8.363821252,5.146455632,5.095904078],[17.399167033,11.560112941,11.425701327],[16.370925705,10.964158442,10.830549828],[47.285541349,37.693475389,37.785730663],[3.050276403,0.450876149,0.448603179],[88.568256935,75.190905253,75.117089773],[31.465927223,15.890914096,15.977203933],[57.700829953,29.783009247,29.692388078],[189.13288871,105.996291875,106.223819633],[8.940774668,2.822498171,2.811170418],[9.213474468,5.615692754,5.627027588],[10.768470076,4.447919066,4.454657129],[65.428467698,48.413063046,48.393783439],[null,null,null],[null,null,null],[10.685209962,4.279293566,4.232359597],[17.715912453,6.756813817,6.639794835],[41.617862558,32.592246341,32.431919028],[null,null,null],[null,null,null],[9.469920016,6.516282466,6.50819504],[2.398682936,0.799101635,0.795153701],[1.824587198,0.570538801,0.535241727],[2.176879841,0.575095047,0.555826225],[3.528212778,1.696285802,1.66057755],[1.711232974,0.347184312,0.347677032],[1.645870038,0.331091157,0.326748534],[4.054081036,2.734678917,2.710241577]],"source":"opteryx/results/c6a.4xlarge.json"} | |||
| ,{"system":"Oxla","date":"2024-04-09","machine":"c6a.4xlarge, 500gb gp2","cluster_size":1,"comment":"Ingests data only from non-compressed cvs.","tags":["C","analytical","somewhat PostgreSQL compatible"],"load_time":497.815,"data_size":17394972923,"result":[[3.112892,0.068225,0.049215],[1.476993,0.068502,0.01352],[1.532504,0.015794,0.01899],[1.541791,0.043208,0.090244],[1.424205,1.114138,1.079011],[1.546764,1.340306,1.339957],[0.202873,0.009787,0.008214],[1.017122,0.01247,0.010861],[1.790766,1.816432,1.681662],[2.06058,2.051205,2.05747],[0.166164,0.149605,0.147586],[0.33821,0.15334,0.15212],[0.968408,0.975795,0.932127],[1.641231,1.648973,1.691530],[1.039926,1.021776,1.015062],[1.059569,1.038191,1.016849],[2.930077,2.780725,2.786122],[2.7766,2.745188,2.827054],[5.474963,5.455883,5.462812],[0.069049,0.037876,0.030425],[5.294758,2.818725,2.803313],[null,null,null],[null,null,null],[21.034479,18.253271,6.146486],[0.17394,0.151798,0.146398],[0.180155,0.170271,0.177003],[0.22494,0.216158,0.216051],[0.978861,0.973059,0.964485],[null,null,null],[0.030928,0.02037,0.020366],[0.408601,0.412485,0.408602],[0.875709,0.743332,0.704842],[7.962516,7.867736,7.594272],[6.209667,5.892066,5.963681],[5.931634,5.947336,6.005506],[0.577314,0.583573,0.545736],[0.126127,0.090768,0.094307],[0.110712,0.04149,0.039939],[0.060824,0.043637,0.030213],[0.322545,0.204934,0.185178],[0.121207,0.011082,0.011699],[0.069138,0.012728,0.014108],[0.030538,0.028048,0.030625]],"source":"oxla/results/c6a.4xlarge.json"} | |||
| ,{"system":"Oxla","date":"2024-04-09","machine":"c6a.4xlarge, 500gb gp2","cluster_size":1,"comment":"Ingests data only from non-compressed cvs.","tags":["C","analytical","somewhat PostgreSQL compatible"],"load_time":497.815,"data_size":17394972923,"result":[[0.046851,0.02652,0.02648],[0.129717,0.010132,0.010436],[0.024405,0.017653,0.015578],[1.038988,0.026278,0.025259],[0.920077,0.867753,0.858069],[1.193297,1.094777,1.088436],[0.024024,0.015385,0.014366],[0.021601,0.015406,0.013076],[1.523167,1.323168,1.30051],[1.906564,1.755886,1.844895],[0.190242,0.1447,0.136949],[0.221494,0.159692,0.160614],[0.836624,0.8148,0.813433],[1.664004,1.635831,1.621079],[0.887504,0.885837,0.875387],[1.070728,0.938593,1.021919],[2.685652,2.644121,2.647854],[2.667017,2.658392,2.628829],[4.65067,4.626599,4.701596],[0.105851,0.080334,0.05596],[0.722496,0.705024,0.738724],[0.765263,0.767057,0.739108],[1.877141,1.390639,1.434695],[16.211858,3.861157,3.897472],[0.112136,0.099527,0.097523],[0.121357,0.111725,0.112716],[0.157924,0.150043,0.148599],[0.698874,0.674169,0.685363],[51.293703,51.584485,51.114784],[0.114097,0.099482,0.102921],[0.437985,0.415509,0.408477],[0.720325,0.674251,0.681977],[89.73327,81.154516,76.413726],[7.202697,6.053296,6.002008],[5.97555,5.824706,6.135259],[0.68644,0.655987,0.6812],[0.064488,0.06473,0.062154],[0.023134,0.029644,0.023701],[0.039028,0.05021,0.04079],[0.152121,0.144167,0.132704],[0.01652,0.012679,0.009873],[0.018828,0.030098,0.021353],[0.017781,0.017341,0.015782]],"source":"oxla/results/c6a.4xlarge.json"} | |||
There was a problem hiding this comment.
No need to update index.html manually, this is done by a GitHub bot automatically based on the files in folder result/.
| @@ -16,25 +16,25 @@ wget --no-verbose --continue 'https://datasets.clickhouse.com/hits_compatible/hi | |||
| echo "Unpack dataset." | |||
| gzip -d hits.csv.gz | |||
| chmod 777 ~ hits.csv | |||
| mkdir data | |||
| mkdir ~/data | |||
There was a problem hiding this comment.
Could you change this so that all artifacts are stored directly in oxla/ instead of ~/data/? (asking because it is convenient to run git reset --hard in the ClickBench repository for cleanup after a benchmark run)
Related to that, chmod-ing ~ with 777 seems undesirable.
EDIT: Ah, I see ... /data is mapped into the Docker image. Could you nevertheless try to create data/ as a subdirectory of ClickBench/oxla/?
There was a problem hiding this comment.
In l. 4-7, we can instead simply install docker via the operating system repository:
sudo apt install docker.io
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I am adding results for Oxla version 1.53 which has much improved results and is supporting queries in vanilla form without any rewriting unlike previously submitted version.