| Bhaskar Maddala | 10e26de | 2013-11-20 12:55:21 -0500 | [diff] [blame] | 1 | These are the result of tests conducted to determine efficacy of hashing |
| 2 | algorithms and avalache application in haproxy. All results below were |
| 3 | generated using version 1.5. See the document on hashing under internal docs |
| 4 | for a detailed description on the tests the methodology and interpretation |
| 5 | of the results. |
| 6 | |
| 7 | The following was the set up used |
| 8 | |
| 9 | (a) hash-type consistent/map-bases |
| 10 | (b) avalanche on/off |
| 11 | (c) balanche host(hdr) |
| 12 | (d) 3 criteria for inputs |
| 13 | - ~ 10K requests, including duplicates |
| 14 | - ~ 46K requests, unique requests from 1 MM requests were obtained |
| 15 | - ~ 250K requests, including duplicates |
| 16 | (e) 17 servers in backend, all servers were assigned the same weight |
| 17 | |
| 18 | The results can be interpreted across 3 dimensions corresponding to input |
| 19 | criteria (a)/(b) and (d) above |
| 20 | |
| 21 | == 10 K requests == |
| 22 | |
| 23 | === Consistent with avalanche === |
| 24 | |
| 25 | Servers SDBM DJB2 WT6 |
| 26 | ----------------------------- |
| 27 | 1 576 637 592 |
| 28 | 2 552 608 600 |
| 29 | 3 539 559 551 |
| 30 | 4 578 586 493 |
| 31 | 5 534 555 549 |
| 32 | 6 614 607 576 |
| 33 | 7 519 556 554 |
| 34 | 8 591 565 607 |
| 35 | 9 529 604 575 |
| 36 | 10 642 550 678 |
| 37 | 11 537 591 506 |
| 38 | 12 568 571 567 |
| 39 | 13 589 606 572 |
| 40 | 14 648 568 711 |
| 41 | 15 645 557 603 |
| 42 | 16 583 627 591 |
| 43 | 17 699 596 618 |
| 44 | ----------------------------- |
| 45 | Std Dev 48.95 26.29 51.75 |
| 46 | |
| 47 | === Consistent without avalanche === |
| 48 | |
| 49 | Servers SDBM DJB2 WT6 |
| 50 | ----------------------------- |
| 51 | 1 612 627 579 |
| 52 | 2 631 607 563 |
| 53 | 3 585 605 604 |
| 54 | 4 594 502 518 |
| 55 | 5 583 526 602 |
| 56 | 6 589 594 555 |
| 57 | 7 591 602 511 |
| 58 | 8 518 540 623 |
| 59 | 9 550 519 523 |
| 60 | 10 600 637 647 |
| 61 | 11 568 536 550 |
| 62 | 12 552 605 645 |
| 63 | 13 547 556 564 |
| 64 | 14 615 674 635 |
| 65 | 15 642 624 618 |
| 66 | 16 575 585 609 |
| 67 | 17 591 604 597 |
| 68 | ----------------------------- |
| 69 | Std Dev 30.71 45.97 42.52 |
| 70 | |
| 71 | === Map based without avalanche === |
| 72 | |
| 73 | Servers SDBM DJB2 WT6 |
| 74 | ----------------------------- |
| 75 | 1 602 560 598 |
| 76 | 2 576 583 583 |
| 77 | 3 579 624 593 |
| 78 | 4 608 587 551 |
| 79 | 5 579 549 588 |
| 80 | 6 582 560 590 |
| 81 | 7 553 616 562 |
| 82 | 8 568 600 551 |
| 83 | 9 594 607 620 |
| 84 | 10 574 611 635 |
| 85 | 11 578 607 603 |
| 86 | 12 563 581 547 |
| 87 | 13 604 531 572 |
| 88 | 14 621 606 618 |
| 89 | 15 600 561 602 |
| 90 | 16 555 570 585 |
| 91 | 17 607 590 545 |
| 92 | ----------------------------- |
| 93 | Std Dev 19.24 25.56 26.29 |
| 94 | |
| 95 | === Map based with avalanche === |
| 96 | |
| 97 | Servers SDBM DJB2 WT6 |
| 98 | ----------------------------- |
| 99 | Servers SDBM DJB2 WT6 |
| 100 | 1 548 641 597 |
| 101 | 2 612 563 655 |
| 102 | 3 596 536 595 |
| 103 | 4 609 574 537 |
| 104 | 5 586 610 570 |
| 105 | 6 600 568 562 |
| 106 | 7 589 573 578 |
| 107 | 8 584 549 573 |
| 108 | 9 561 636 603 |
| 109 | 10 607 553 603 |
| 110 | 11 554 602 616 |
| 111 | 12 560 577 568 |
| 112 | 13 597 534 570 |
| 113 | 14 597 647 570 |
| 114 | 15 563 581 647 |
| 115 | 16 575 647 565 |
| 116 | 17 605 552 534 |
| 117 | ----------------------------- |
| 118 | Std Dev 20.23 37.47 32.16 |
| 119 | |
| 120 | == Uniques in 1 MM == |
| 121 | |
| 122 | === Consistent with avalanche === |
| 123 | |
| 124 | Servers SDBM DJB2 WT6 |
| 125 | ----------------------------- |
| 126 | 1 2891 2963 2947 |
| 127 | 2 2802 2849 2771 |
| 128 | 3 2824 2854 2904 |
| 129 | 4 2704 2740 2763 |
| 130 | 5 2664 2699 2646 |
| 131 | 6 2902 2876 2935 |
| 132 | 7 2829 2745 2730 |
| 133 | 8 2648 2768 2800 |
| 134 | 9 2710 2741 2689 |
| 135 | 10 3070 3111 3106 |
| 136 | 11 2733 2638 2589 |
| 137 | 12 2828 2866 2885 |
| 138 | 13 2876 2961 2870 |
| 139 | 14 3090 2997 3044 |
| 140 | 15 2871 2879 2827 |
| 141 | 16 2881 2727 2921 |
| 142 | 17 2936 2845 2832 |
| 143 | ----------------------------- |
| 144 | Std Dev 121.66 118.59 131.61 |
| 145 | |
| 146 | === Consistent without avalanche === |
| 147 | |
| 148 | Servers SDBM DJB2 WT6 |
| 149 | ----------------------------- |
| 150 | 1 2879 2930 2863 |
| 151 | 2 2835 2856 2853 |
| 152 | 3 2875 2741 2899 |
| 153 | 4 2720 2718 2761 |
| 154 | 5 2703 2754 2689 |
| 155 | 6 2848 2901 2925 |
| 156 | 7 2829 2756 2838 |
| 157 | 8 2761 2779 2805 |
| 158 | 9 2719 2671 2746 |
| 159 | 10 3015 3176 3079 |
| 160 | 11 2620 2661 2656 |
| 161 | 12 2879 2773 2713 |
| 162 | 13 2829 2844 2925 |
| 163 | 14 3064 2951 3041 |
| 164 | 15 2898 2928 2877 |
| 165 | 16 2880 2867 2791 |
| 166 | 17 2905 2953 2798 |
| 167 | ----------------------------- |
| 168 | Std Dev 107.65 125.2 111.34 |
| 169 | |
| 170 | === Map based without avalanche === |
| 171 | |
| 172 | Servers SDBM DJB2 WT6 |
| 173 | ----------------------------- |
| 174 | 1 2863 2837 2923 |
| 175 | 2 2966 2829 2847 |
| 176 | 3 2865 2803 2808 |
| 177 | 4 2682 2816 2787 |
| 178 | 5 2847 2782 2815 |
| 179 | 6 2910 2862 2862 |
| 180 | 7 2821 2784 2793 |
| 181 | 8 2837 2834 2796 |
| 182 | 9 2857 2891 2859 |
| 183 | 10 2829 2906 2873 |
| 184 | 11 2742 2851 2841 |
| 185 | 12 2790 2837 2870 |
| 186 | 13 2765 2902 2794 |
| 187 | 14 2870 2732 2900 |
| 188 | 15 2898 2891 2759 |
| 189 | 16 2877 2860 2863 |
| 190 | 17 2840 2842 2869 |
| 191 | ----------------------------- |
| 192 | Std Dev 64.65 45.16 43.38 |
| 193 | |
| 194 | === Map based with avalanche === |
| 195 | |
| 196 | Servers SDBM DJB2 WT6 |
| 197 | ----------------------------- |
| 198 | 1 2816 2859 2895 |
| 199 | 2 2841 2739 2789 |
| 200 | 3 2846 2903 2888 |
| 201 | 4 2817 2878 2812 |
| 202 | 5 2750 2794 2852 |
| 203 | 6 2816 2917 2847 |
| 204 | 7 2792 2782 2786 |
| 205 | 8 2800 2814 2868 |
| 206 | 9 2854 2883 2842 |
| 207 | 10 2770 2854 2855 |
| 208 | 11 2851 2854 2837 |
| 209 | 12 2910 2846 2776 |
| 210 | 13 2904 2792 2882 |
| 211 | 14 2984 2767 2854 |
| 212 | 15 2766 2863 2823 |
| 213 | 16 2902 2797 2907 |
| 214 | 17 2840 2917 2746 |
| 215 | ----------------------------- |
| 216 | Std Dev 58.39 52.16 43.72 |
| 217 | |
| 218 | == 250K requests == |
| 219 | |
| 220 | === Consistent with avalanche === |
| 221 | |
| 222 | Servers SDBM DJB2 WT6 |
| 223 | ----------------------------- |
| 224 | 1 14182 12996 20924 |
| 225 | 2 14881 18376 8901 |
| 226 | 3 13537 17935 13639 |
| 227 | 4 11031 12582 19758 |
| 228 | 5 15429 10084 12112 |
| 229 | 6 18712 12574 14052 |
| 230 | 7 14271 11257 14538 |
| 231 | 8 12048 18582 16653 |
| 232 | 9 10570 10283 13949 |
| 233 | 10 11683 13081 23530 |
| 234 | 11 9288 14828 10818 |
| 235 | 12 10775 13607 19844 |
| 236 | 13 10036 19138 15413 |
| 237 | 14 31903 15222 11824 |
| 238 | 15 21276 11963 10405 |
| 239 | 16 17233 23116 11316 |
| 240 | 17 11437 12668 10616 |
| 241 | ----------------------------- |
| 242 | Std Dev 5355.95 3512.39 4096.65 |
| 243 | |
| 244 | === Consistent without avalanche === |
| 245 | |
| 246 | Servers SDBM DJB2 WT6 |
| 247 | ----------------------------- |
| 248 | 1 12411 17833 11831 |
| 249 | 2 14213 11165 14833 |
| 250 | 3 11431 10241 11671 |
| 251 | 4 14080 13913 20224 |
| 252 | 5 10886 12101 14272 |
| 253 | 6 15168 12470 14641 |
| 254 | 7 18802 12211 10164 |
| 255 | 8 18678 11852 12421 |
| 256 | 9 17468 10865 17655 |
| 257 | 10 19801 28493 13221 |
| 258 | 11 10885 20201 13507 |
| 259 | 12 20419 11660 14078 |
| 260 | 13 12591 18616 13906 |
| 261 | 14 12798 18200 24152 |
| 262 | 15 13338 10532 14111 |
| 263 | 16 11715 10478 14759 |
| 264 | 17 13608 17461 12846 |
| 265 | ----------------------------- |
| 266 | Std Dev 3113.33 4749.97 3256.04 |
| 267 | |
| 268 | === Map based without avalanche === |
| 269 | |
| 270 | Servers SDBM DJB2 WT6 |
| 271 | ----------------------------- |
| 272 | 1 14660 12483 11472 |
| 273 | 2 11118 11552 12146 |
| 274 | 3 15407 19952 11032 |
| 275 | 4 15444 12218 14572 |
| 276 | 5 22091 11434 13738 |
| 277 | 6 18273 17587 21337 |
| 278 | 7 10527 16784 15118 |
| 279 | 8 13013 12010 17195 |
| 280 | 9 15754 9886 14611 |
| 281 | 10 13758 11613 14844 |
| 282 | 11 19564 16453 17403 |
| 283 | 12 9692 17246 14469 |
| 284 | 13 13905 11885 20024 |
| 285 | 14 19401 15350 10611 |
| 286 | 15 11889 25485 11172 |
| 287 | 16 13846 13928 12109 |
| 288 | 17 9950 12426 16439 |
| 289 | ----------------------------- |
| 290 | Std Dev 3481.45 3847.74 3031.93 |
| 291 | |
| 292 | === Map based with avalanche === |
| 293 | |
| 294 | Servers SDBM DJB2 WT6 |
| 295 | ----------------------------- |
| 296 | 1 15546 11454 12871 |
| 297 | 2 15388 11464 17587 |
| 298 | 3 11767 15527 14785 |
| 299 | 4 15843 13214 11420 |
| 300 | 5 11129 12192 15083 |
| 301 | 6 15647 17875 11051 |
| 302 | 7 18723 13629 23006 |
| 303 | 8 10938 11295 11223 |
| 304 | 9 12653 17202 23347 |
| 305 | 10 10108 12867 14178 |
| 306 | 11 12116 11190 20523 |
| 307 | 12 14982 12341 11881 |
| 308 | 13 13221 13929 11828 |
| 309 | 14 17642 19621 15320 |
| 310 | 15 12410 26171 11721 |
| 311 | 16 25075 14764 13544 |
| 312 | 17 15104 13557 8924 |
| 313 | ----------------------------- |
| 314 | Std Dev 3521.83 3742.21 4101.2 |