Program Pre-analysis Metrics 2cs M-2cs 2type M-2type 3type M-3type M-2obj 3obj M-3obj analysis time(sec.) 2790.7373.6 63.6 45.5 459.3 61.0 116.2 36.7 8302.069.9 ci:44.1s speedup 7.5X 14X 7.5X 3.2X 1188X FPG:1.3s #may-fail casts 888 888 648 649 599 600 524 524 463 463 MAIJONG:1.3s #poly call sites 1862 1862 1682 1685 1651 1654 1630 1633 1623 1626 #call graph edges 55153 55153 51427 51435 51168 51176 51062 51070 51035 51043 analysis time (sec.】 15103 4305 66.1 46.6 526.9 67.8 73.8 36.7 86470 70.0 ci:34.7s speedup 3.5X 1.4X 7.8X 2.0X 123.5X fop FPG:0.7s #may-fail casts 682 682 527 517 479 469 428 428 375 375 MAHJONG:1.1s poly call sites 1068 1068 872 875 841 844 821 824 814 817 #call graph edges 38154 38154 34580 34588 34321 34329 34211 34219 34184 34192 analysis time(sec.) 1480.2 301.9 45.4 30.1 526.4 42.8 72.9 28.0 10651.9 63.1 ci:26.2s speedup 4.9X 15X 12.3X 2.6X 168.8X luindex FPG:0.8s #may-fail casts 701 701 522 513 473 464 413 413 358 358 MAHJONG:1.1s #poly call sites 1157 1157 981 984 946 949 q)7 925 915 918 #call graph edges 37445 37445 33760 33769 33496 33505 33383 33392 33356 33365 analysis time (sec.) 2099.4 547.6 92.2 62.2 906.1 82.9 145.1 82.3 14469.3 127.7 c:44.8s speedup 3.8X 1.5X 10.9X 1.8X 113.3X pmd FPG:1.4s #may-fail casts 1319 1319 1082 1072 1014 1004 930 930 871 871 MAHJONG:1.5s #poly call sites 1424 1424 1210 1213 1175 1179 1137 1140 1130 1133 #call graph edges 49731 49734 44768 44779 44419 44433 44070 44081 44004 44016 analysis time(sec.) 7769.3 5350.9 87.2 67.3 533.6 124.5 36119 35015 >5h >5h ci:37.7s 15X 1.3X 4.3X 1.03X bloat FPG:2.4s #may-fail casts 1840 1840 1614 1608 1521 1515 1302 1302 MAHJONG:1.9s #poly call sites 2005 2005 1811 1814 1673 1676 1567 1571 #call graph edges 64102 64102 57619 57625 57136 57142 56364 56374 analysis time(sec.) 5476.21665.9 174.0 86.8 2967.8518.5 997.9 279.8 >5h>5h ci:89.6s speedup 33X 2.0X 5.7X 3.6X chart FPG:2.3s #may-fail casts 2093 2093 1708 1699 1621 1612 1349 1349 MAHJONG:4.0s #poly call sites 2475 2475 2093 2096 2036 2039 2017 2020 #call graph edges 81224 81238 72968 72974 72321 72327 72297 72317 analysis time(sec.) 7644.83186.7 187.8 92.3 5120.6 379.8 1946.6 277.1 >5h 3103.7 ci:66.6s 2.4X 2.0X 13.5X 7.0X checkstyle FPG:3.0s #may-fail casts 1506 t601 1345 1334 1243 1231 1135 1140 0 MAHJONG:3.1s #poly call sites 2558 2558 2307 2311 2239 2243 2211 215 168 #call graph edges 75802 75822 67390 67419 66550 66572 66718 66751 65943 analysis time(sec.】 1996.1 464.4 99.0 577 1122.5 101.8 1816.8 247.3 >5h1274.9 ci:38.7s speedup 43X 1.7X 11.0X 7.3X FPG:1.2s #may-fail casts 982 982 794 784 740 730 589 589 535 MAHJONG:1.7s #poly call sites 1879 1879 1651 1654 1620 1623 1505 1598 1591 #call graph edges 50825 50825 46399 46407 46139 46147 45974 45982 45950 analysis time (sec.) 1444.7 309.4 46.4 29.6 780.9 44.5 110.2 27.8 >5h 65.0 c1:414s speedup 47X 16X 17.5X 4.0X lusearch FPG:0.8s #may-fail casts 779 779 561 552 514 505 424 424 372 MAHJONG:1.0s oe 1361 1361 1178 1181 1147 1150 1120 1123 1116 40724 40724 36631 36640 36372 36381 36255 36264 36237 analysis time (sec.) 3464.1 1155.1 147.1 90.6 1509.8 340.5 477.2 306.0 >5h 5056.8 ci:58.9s speedup 3.0X 4.4X 1.6X JPC FPG:2.1s #may-fail casts 1828 1828 1595 1579 1507 1490 1381 1381 1226 MAHJONG:4.5s #poly call sites 4749 4749 4379 4382 4321 4324 4275 4279 4139 #call graph edges 90111 90111 81723 81729 81251 81251 81031 81045 79370 analysis time(sec.) 14923.8 5646.6 1229.3 107.4 >5h 171.7 >5h 174.2 >5h 524.1 ci:90.6 2.6X 11.4X findbugs FPG:4.6s nay-fail casts 2923 2928 2469 2458 2143 2074 1671 MAHJONG:3.2s #poly call sites 4136 4136 3753 3756 3574 3565 3534 #call graph edges 100046 100063 89036 89054 87581 87929 86985 analysis time(sec.) >5h >5h 2453.0 863.1 >5h 11316.5 >5h 15738.0 >5h >5h c士：174.1s speedup 2.8X FPG:15.5s #may-fail casts 4236 4223 3994 3662 MAHJONG:21.4s #poly call sites 9906 9910 9740 9724 #call graph edges 163760 163768 161448 162137 Table 2.Efficiency and precision metrics for all programs and analyses with and without MAHJONG.In all cases (except speedup),lower is better.Symbol oo is used in speedup when a baseline analysis is not scalable but MAHJONG is scalable. 288Program Pre-analysis Metrics 2cs M-2cs 2type M-2type 3type M-3type 2obj M-2obj 3obj M-3obj antlr analysis time (sec.) 2790.7 373.6 63.6 45.5 459.3 61.0 116.2 36.7 8302.0 69.9 ci: 44.1s speedup 7.5X 1.4X 7.5X 3.2X 118.8X FPG: 1.3s #may-fail casts 888 888 648 649 599 600 524 524 463 463 MAHJONG: 1.3s #poly call sites 1862 1862 1682 1685 1651 1654 1630 1633 1623 1626 #call graph edges 55153 55153 51427 51435 51168 51176 51062 51070 51035 51043 fop analysis time (sec.) 1510.3 430.5 66.1 46.6 526.9 67.8 73.8 36.7 8647.0 70.0 ci: 34.7s speedup 3.5X 1.4X 7.8X 2.0X 123.5X FPG: 0.7s #may-fail casts 682 682 527 517 479 469 428 428 375 375 MAHJONG: 1.1s #poly call sites 1068 1068 872 875 841 844 821 824 814 817 #call graph edges 38154 38154 34580 34588 34321 34329 34211 34219 34184 34192 luindex analysis time (sec.) 1480.2 301.9 45.4 30.1 526.4 42.8 72.9 28.0 10651.9 63.1 ci: 26.2s speedup 4.9X 1.5X 12.3X 2.6X 168.8X FPG: 0.8s #may-fail casts 701 701 522 513 473 464 413 413 358 358 MAHJONG: 1.1s #poly call sites 1157 1157 981 984 946 949 922 925 915 918 #call graph edges 37445 37445 33760 33769 33496 33505 33383 33392 33356 33365 pmd analysis time (sec.) 2099.4 547.6 92.2 62.2 906.1 82.9 145.1 82.3 14469.3 127.7 ci: 44.8s speedup 3.8X 1.5X 10.9X 1.8X 113.3X FPG: 1.4s #may-fail casts 1319 1319 1082 1072 1014 1004 930 930 871 871 MAHJONG: 1.5s #poly call sites 1424 1424 1210 1213 1175 1179 1137 1140 1130 1133 #call graph edges 49731 49734 44768 44779 44419 44433 44070 44081 44004 44016 bloat analysis time (sec.) 7769.3 5350.9 87.2 67.3 533.6 124.5 3611.9 3501.5 >5h >5h ci: 37.7s speedup 1.5X 1.3X 4.3X 1.03X – FPG: 2.4s #may-fail casts 1840 1840 1614 1608 1521 1515 1302 1302 – – MAHJONG: 1.9s #poly call sites 2005 2005 1811 1814 1673 1676 1567 1571 – – #call graph edges 64102 64102 57619 57625 57136 57142 56364 56374 – – chart analysis time (sec.) 5476.2 1665.9 174.0 86.8 2967.8 518.5 997.9 279.8 >5h >5h ci: 89.6s speedup 3.3X 2.0X 5.7X 3.6X – FPG: 2.3s #may-fail casts 2093 2093 1708 1699 1621 1612 1349 1349 – – MAHJONG: 4.0s #poly call sites 2475 2475 2093 2096 2036 2039 2017 2020 – – #call graph edges 81224 81238 72968 72974 72321 72327 72297 72317 – – checkstyle analysis time (sec.) 7644.8 3186.7 187.8 92.3 5120.6 379.8 1946.6 277.1 >5h 3103.7 ci: 66.6s speedup 2.4X 2.0X 13.5X 7.0X ∞ FPG: 3.0s #may-fail casts 1596 1601 1345 1334 1243 1231 1135 1140 – 1022 MAHJONG: 3.1s #poly call sites 2558 2558 2307 2311 2239 2243 2211 2215 – 2168 #call graph edges 75802 75822 67390 67419 66550 66572 66718 66751 – 65943 xalan analysis time (sec.) 1996.1 464.4 99.0 57.7 1122.5 101.8 1816.8 247.3 >5h 1274.9 ci: 38.7s speedup 4.3X 1.7X 11.0X 7.3X ∞ FPG: 1.2s #may-fail casts 982 982 794 784 740 730 589 589 – 535 MAHJONG: 1.7s #poly call sites 1879 1879 1651 1654 1620 1623 1595 1598 – 1591 #call graph edges 50825 50825 46399 46407 46139 46147 45974 45982 – 45950 lusearch analysis time (sec.) 1444.7 309.4 46.4 29.6 780.9 44.5 110.2 27.8 >5h 65.0 ci: 41.4s speedup 4.7X 1.6X 17.5X 4.0X ∞ FPG: 0.8s #may-fail casts 779 779 561 552 514 505 424 424 – 372 MAHJONG: 1.0s #poly call sites 1361 1361 1178 1181 1147 1150 1120 1123 – 1116 #call graph edges 40724 40724 36631 36640 36372 36381 36255 36264 – 36237 JPC analysis time (sec.) 3464.1 1155.1 147.1 90.6 1509.8 340.5 477.2 306.0 >5h 5056.8 ci: 58.9s speedup 3.0X 1.6X 4.4X 1.6X ∞ FPG: 2.1s #may-fail casts 1828 1828 1595 1579 1507 1490 1381 1381 – 1226 MAHJONG: 4.5s #poly call sites 4749 4749 4379 4382 4321 4324 4275 4279 – 4139 #call graph edges 90111 90111 81723 81729 81251 81251 81031 81045 – 79370 findbugs analysis time (sec.) 14923.8 5646.6 1229.3 107.4 >5h 171.7 >5h 174.2 >5h 524.1 ci: 90.6s speedup 2.6X 11.4X ∞ ∞ ∞ FPG: 4.6s #may-fail casts 2923 2928 2469 2458 – 2143 – 2074 – 1671 MAHJONG: 3.2s #poly call sites 4136 4136 3753 3756 – 3574 – 3565 – 3534 #call graph edges 100046 100063 89036 89054 – 87581 – 87929 – 86985 eclipse analysis time (sec.) >5h >5h 2453.0 863.1 >5h 11316.5 >5h 15738.0 >5h >5h ci: 174.1s speedup – 2.8X ∞ ∞ – FPG: 15.5s #may-fail casts – – 4236 4223 – 3994 – 3662 – – MAHJONG: 21.4s #poly call sites – – 9906 9910 – 9740 – 9724 – – #call graph edges – – 163760 163768 – 161448 – 162137 – – Table 2. Efficiency and precision metrics for all programs and analyses with and without MAHJONG. In all cases (except speedup), lower is better. Symbol ∞ is used in speedup when a baseline analysis is not scalable but MAHJONG is scalable. 288