from: https://people.engr.tamu.edu/guofei/sec_conf_stat.htm
Computer Security Conference Ranking and Statistic
Guofei Gu
Ranking
Note:
- How to judge how good a conference is? In my opinion, here are several criteria:
- Acceptance ratio: definitely an important metric (maybe the easiest metric that can be quantified), but not the only metric
- Paper quality and impact: how many classic papers are from this conference? how much impact do papers from this conference have on the community? are they well cited and studied?
- Committee member quality: what's the quality of TPC members? are they noted researchers in this area? This is an important factor because they will affect the quality of submission (good papers will prefer to submit to the conference with noted researchers in the committee), and control the quality of accepted papers.
- Attendee/Paper number ratio: another quantified metric. This somehow reflects the influence of this conference on the community
- Location: a beautiful place has some attraction. In addition, many researchers (but not all) are not very willing to travel to other countries due to limited funding or time (or VISA problem...), so they just submit papers to local conferences. Thus, normally the conferences located in USA are better than in Europe, which is also better than in Asia.
- History: a conference with a long history may have a good tradition and reputation
- Industry connection: this somehow reflects the impact on the industry. Normally, conferences on more applied techniques will attract more industry partners (so have more money to improve the quality of conference)
- Combining the first few criteria mentioned above, Dr. Jianying Zhou proposed a more quantitative metric (Conference Impact Factor, CIF). Please check out his page here.
- This ranking list is only in my opinion. It is not official, nor accurate, only for reference. Some good workshops are also included.
- I'm probably biased because I'm mainly a network/system security researcher. Notify me if you have different views, or you find significant conferences missing/bias. I'm more than happy to hear from you.
- Some conferences are arguably better belonging to tier 1.5 or 2.5. At this time, I'm not going to differentiate these. Let me know if you have some strong comments.
- Currently, I mainly focus on academic conferences and scientific publications. Thus, do not be surprised if you find other great conferences like Defcon/BlackHat/RSA are not included here.
- Long time ago, I maintained a general computer science conference ranking (a mirror of my previous Georgia Tech page).
- Other interesting/relevant resources: System security circus (top authors), Influential security papers
| Tier 1 | S&P (Oakland) | IEEE Symposium on Security and Privacy |
| CCS | ACM Conference on Computer and Communications Security | |
| Security | USENIX Security Symposium | |
| NDSS | ISOC Network and Distributed System Security Symposium | |
| -- Crypto conferences below -- | ||
| Crypto | International Cryptology Conference | |
| Eurocrypt | European Cryptology Conference | |
| Tier 2 | ESORICS | European Symposium on Research in Computer Security |
| RAID | International Symposium on Recent Advances in Intrusion Detection | |
| ACSAC | Annual Computer Security Applications Conference | |
| DSN | The International Conference on Dependable Systems and Networks | |
| IMC | Internet Measurement Conference | |
| ASIACCS | ACM Symposium on Information, Computer and Communications Security | |
| PETS | Privacy Enhancing Technologies Symposium | |
| EuroS&P | IEEE European Symposium on Security and Privacy | |
| CSF (CSFW) | IEEE Computer Security Foundations Symposium. Supersedes CSFW (Computer Security Foundations Workshop) | |
| -- Crypto conferences below -- | ||
| Asiacrypt | International Conference on the Theory and Application of Cryptology and Information Security | |
| TCC | Theory of Cryptography Conference | |
| CHES | Conference on Cryptographic Hardware and Embedded Systems | |
| Tier 3 | SecureComm | Internation Conference on Security and Privacy in Communication Networks |
| CNS | IEEE Conference on Communications and Network Security | |
| DIMVA | GI SIG SIDAR Conference on Detection of Intrusions and Malware and Vulnerability Assessment | |
| ACNS | International Conference on Applied Cryptography and Network Security | |
| SAC | ACM Symposium on Applied Computing | |
| ACISP | Australasia Conference on Information Security and Privacy | |
| ICICS | International Conference on Information and Communications Security | |
| ISC | Information Security Conference | |
| ICISC | International Conference on Information Security and Cryptology | |
| SACMAT | ACM Symposium on Access Control Models and Technologies | |
| IFIP SEC | IFIP International Information Security Conference | |
| WiSec (WiSe, SASN) | ACM Conference on Wireless Network Security Supersedes WiSe (ACM Workshop on Wireless Security) and SASN (ACM Workshop on Security of Ad-Hoc and Sensor Networks) | |
| SOUPS | Symposium On Usable Privacy and Security | |
| IFIP WG 11.9 | IFIP WG 11.9 International Conference on Digital Forensics | |
| DFRWS | Digital Forensic Research Conference | |
| CODASPY | ACM Conference on Data and Application Security and Privacy | |
| MALCON | International Conference on Malicious and Unwanted Software | |
| -- Crypto conferences below -- | ||
| FSE | Conference on Fast Software Encryption (FSE) | |
| PKC | International Conference on Practice and Theory in Public Key Cryptography | |
| FC | International Conference on Financial Cryptography and Data Security | |
| CT-RSA | RSA Conference, Cryptographers' Track | |
| HOST | IEEE International Symposium on Hardware Oriented Security and Trust | |
| -- Workshops below -- | ||
| HotSec | USENIX Summit on Hot Topics in Security | |
| NSPW | New Security Paradigms Workshop | |
| IH&MMSec | Workshop on Information Hiding and Multimedia Security | |
| IWIA | IEEE International Information Assurance Workshop | |
| Others (Obsolete, or not ranked) | SecDev | IEEE Secure Development Conference |
| ISPEC | Information Security Practice and Experience Conference | |
| NordSec | Nordic Conference on Secure IT Systems | |
| ICITS | International Conference on Information Theoretic Security | |
Acceptance Ratio Statistic
Note:
- This could be the most complete (and accurate?) list of computer security conference statistics you can find on Internet. There are still some blanks in this list. If you have any reliable source of these information (or some other security conferences), please email me (guofei AT cse.tamu.edu). Thanks.
- You can see from the following statistic, security conferences are becoming harder and harder to get in in the recent five years! And I think this trend will possible continue in the near future.
- Unless noted, the acceptance typically only counts regular (full) papers.
| Year | Tier 1 | Tier 2 | Tier 3 | Year | ||||||||||||
| IEEE S&P | ACM CCS | USENIX Security | NDSS | CSF/CSFW | ESORICS | RAID | ACSAC | ASIACCS | IMC | SecureComm | DIMVA | ACNS | SOUPS | DFRWS | ||
| 2022 | 19.4%(32/165) | 18.5%(104/562) | 25%(35/139) | 28%(11/39) | 2022 | |||||||||||
| 2021 | 12.1%(115/952) | 22.3%(196/879) | 18.7%(246/1316) | 15.2%(87/573) | 25%(43/172) | 20.2%(71/351) | 23.2%(32/138) | 24.5%(80/326) | 18.9%(70/370) | 27%(53/196) | 19.9%(37/186) | 2021 | ||||
| 2020 | 12.4%(104/841) | 16.9%(121/715) | 16.1%(157/977) | 17.4%(88/506) | 25%(29/116) | 25.6%(31/121) | 23%(70/302) | 21.8%(67/308) | 24.5%( 53/216) | 29%(13/45) | 2020 | |||||
| 2019 | 12%(84/679) | 16%(149/934) | 15.5%(113/729) | 17%(89/52)1 | 34%(30/89) | 19.4%(67/344) | 22%(37/166) | 22.6%(60/266) | 17%(44/258, regular paper) | 20%(39/197) | 25.5%(38/149) | 28.8%(23/80) | 2019 | |||
| 2018 | 11.5%(63/549) | 16.6%(134/809) | 19.1%(100/524) | 21.5%(71/331) | 35%(25/72) | 22.8%(33/145) | 20%(60/299) | 16.8%(52/310) | 24.7%(43/174) | | 21%(28/132) | 2018 | ||||
| 2017 | 13%(60/457) | 17.9%(151/843) | 16.3%(85/522) | 16%(68/423) | 34%(32/94) | 16%(54/338) | 20%(21/105) | 19.7%(48/244) | 18.7%(67/359) | 23.4%(42/179) | 22.8%(34/149) | 27%(26/98) | 2017 | |||
| 2016 | 13.3%(55/413) | 16.5%(137/831) | 15.6(72/463) | 15.4%(60/389) | 35.6%(31/87) | 21%(60/285) | 25%(21/84) | 22.8%(48/210) | 21%(73/350) | 25%(46/184) | 31.8%(21/66) | 19%(35/183) | 28%(22/79) | 2016 | ||
| 2015 | 13.5%(55/407) | 19.8%(128/646) | 15.7%(67/426) | 16.9%(51/302) | 34%(35/102) | 20%(59/293) | 23.5%(28/119) | 24.4%(47/193) | 17.8%(48/269, regular), 23%(62/269) | 26%(44/169) | 28%(30/108) | 22.7%(17/75) | 21% (33/157) | 24%(22/93) | 34.8%(16/46) | 2015 |
| 2014 | 13%(44/334) | 19.5%(114/585) | 19%(67/350) | 18.6%(55/295) | 35%(29/83) | 24.8%(58/234) | 19.4%(22/113) | 19.9%(47/236) | 19.6%(50/255) | 22.4%(43/192) | 27.6%(27/98) | 23.3%(14/60) | 22.5%(33/147) | 26%(21/80) | 28.8%(15/52) | 2014 |
| 2013 | 12%(38/315) | 19.8%(105/530) | 15.9%(44/277) | 18.8%(47/250) | 26%(19/73) | 17.8%(43/242) | 23.1%(22/95) | 20%(34/171) | 16%(35/216,regular) 28%(61/216) | 23.6%(42/178) | 37%(26/70) | 31.6%(12/38) | 23.3%(35/150) | 29.4%(15/51) | 26.5%(13/49) | 2013 |
| 2012 | 13%(40/307) | 18.9%(80/423) | 19.4%(43/222) | 18%(46/258) | 24.8%(25/101) | 20.2%(50/248) | 21%(18/84) | 19%(44/231) | 22%(35/159,regular) 30.8%(49/159) | 24.6%(45/183) | 28.8%(21/73) | 31%(14/45) | 17.2%(33/192) | 21%(14/67) | 29.8%(14/47) | 2012 |
| 2011 | 11%(34/306) | 14%(60/429) | 17%(35/204) | 20%(28/139) | 26%(21/81) | 23.2%(36/155) | 23%(20/87) | 20%(39/195) | 16%(35/217,regular) 27.6%(60/217) | 19%(42/220) | 35.8%(23+11/95) | 31.7%(13/41) | 18%(31/172) | 33%(15/45) | 22.5%(14/62) | 2011 |
| 2010 | 11.6% (31/267) | 17.2%(55/320) | 14.9%(30/202) | 15.4%(24/156) | 28%(23/81) | 20.8%(42/201) | 23%(24/104) | 17%(39/227) | 15% (25/166) | 22%(47/211, both short and full) | 25%(28/112) | 34%(12/35) | 18%(32/178) | 24.6%(16/65) | 41%(16/39) | 2010 |
| 2009 | 10% (26/253) | 18.4%(58/315) | 14.7%(26/176) | 11.7% (20/171) | 23.6%(22/93) | 19.1%(42/220) | 28.8%(17/59) | 19.6%(44/224) | 22.4% (33/147, regular) 27% (40/147) | 22.4%(41/183, both short and full) | 25.3%(19/75,full paper) 34.7%(26/75) | 29.5%(13/44) | 21% (32/150) | 30.6%(15/49) | 37.5%(15/40) | 2009 |
| 2008 | 11.2% (28/249) | 18%(51/281) | 15.9% (27/170) | 17.8% (21/118) | 18%(21/115) | 22%(37/168) | 25%(20/80) | 24%(42/173) | 17.6% (32/182,regular) 22.5% (41/182) | 17.3%(32/185,both short and full) | 21%(26/124) | 33%(14/42) | 22.9%(30/131) | 30%(13/43) | 39.5%(17/43) | 2008 |
| 2007 | 8% (20/246,full paper) 12% (29/246) | 18% (55/303) | 12.3% (23/187) | 14.4% (18/125) | 25%(25/101) | 23.8%(39/164) | 18% (18/100) | 22%(42/191) | 18.3% (33/180,regular) 29.4% (53/180, including short paper) | 24.4%(21/86, full paper) | 26%(31/119) | 24.6%(14/57) | 12% (31/260) | 29%(12/41) | 47.2%(17/36) | 2007 |
| 2006 | 9.2% (23/251, full paper) 12.7% (32/251) | 14.8%(38/256) | 12.3% (22/179) | 13.4% (17/127) | 24.5%(25/102) | 20%(32/160) | 17% (16/93) | 30%(40/134) | 17.7% (33/186) Start from 2006 | 21% (19/92, full paper track) | 25.4%(32/126) | 26.8%(11/41) | 15.1% (33/218) | 36%(14/39) | 44.4%(16/36) | 2006 |
| 2005 | 8.9% (17/192) | 15.2% (38/250) | 14.8% (22/149) | 12.9% (16/124) | 20.8% (20/96) | 17.0% (27/159) | 20.5% (17/83) | 22.8% (45/197) | 27% (22/82, full paper) | 22.2% (32/144, full paper) 36.1% (52/144) Start from 2005 | 27%(14/51) | 22.2% (35/158) | 26%(10/39) | 2005 | ||
| 2004 | 10.2% (19/186) | 13.9% (35/251) | 12.0% (22/184) | 16.3% (16/98) | ? (20/?) | 17.0% (27/159) | 13.5% (16/118) | 26.1% (35/134) | 19% (19/98,full paper) | 34%(14/41) Start from 2004 | 12.1% (36/297) | 2004 | ||||
| 2003 | 14.5% (19/131) | 13.8% (35/253) | 16.4% (21/128) | 20.5% (17/83) | ? (17/?) | 16.7% (19/114) | 29.5% (13/44) | 30%(60/119) | 26% (19/73, full paper) | 16.8% (32/191) Start from 2003 | 2003 | |||||
| 2002 | 22.1% (21/95) | 17.6% (27/153) | 16.9% (22/130) | 19.0% (15/79) | 27.4% (23/84) | 19.3% (16/83) | 25.0% (16/64) | 32.3%(33/102) | 24% (15/62, full paper) | 2002 | ||||||
| 2001 | 17.8% (19/107) | 17.6% (27/153) | 28.9% (24/83) | 24.2% (16/66) | 38.9% (21/54) | not held | 21.8% (12/55) | 31.9%(38/119) | 26% (14/53), Start from 2001 | 2001 | ||||||
| 2000 | 13.1% (18/137) | 21.2% (28/132) | 20/? | 29.4% (15/51) | 45.8% (22/48) | 25.3% (19/75) | 53.8% (14/26) | 42%(42/100) | 2000 | |||||||
| 1999 | 24.6% (15/61) | 19.3% (16/83) | 27%(18/67) | 40.4% (19/47) | not held | ? (32/?) | 1999 | |||||||||
| 1998 | 16.4% (19/116) | 20.0% (17/85) | 27.7%(18/65) | 33.3% (15/45) | 40.4% (23/57) | 67.3% (35/52) Start from 1998 | 1998 | |||||||||
| 1997 | 18.2% (20/110) | 26.6% (17/64) | not held | 13/? | not held | 1997 | ||||||||||
| 1996 | 29.9% (20/67) | 32.2% (19/59) | 21/? | 14/? | 36.2% (21/58) | 1996 | ||||||||||
| 1995 | 27.8% (20/72) | not held | 21/? | not held | 1995 | |||||||||||
| 1994 | 29.2% (19/65) | 44.3% (31/70) | not held | 15/? Start from 1994 | 36.6% (26/71) | 1994 | ||||||||||
| 1993 | 24.3% (17/70) | 45.0% (27/60) Start from 1993 | 13/? | not held | 1993 | |||||||||||
| 1992 | 23.6% (21/89) | 27/? | ? (24/?) | 1992 | ||||||||||||
| 1991 | 30.4% (28/92) | not held | not held | 1991 | ||||||||||||
| 1990 | ?(34/?) | 25/? | ? (?/?) Start from 1990 | 1990 | ||||||||||||
| 1989 | ?(30/?) | not held | 1989 | |||||||||||||
| 1988 | ?(26/?) | Start from 1988? | Start from 1988 | 1988 | ||||||||||||
| 1987 | ?(26/?) | 1987 | ||||||||||||||
| 1986 | 27.5% (25/91) | 1986 | ||||||||||||||
| 1985 | 39.7% (25/63) | Start from 1985 | 1985 | |||||||||||||
| 1984 | 64.1% (25/39) | 1984 | ||||||||||||||
| 1983 | 67.6% (23/34) | 1983 | ||||||||||||||
| 1982 | 55.9% (19/34) | 1982 | ||||||||||||||
| 1981 | ?(18/?) | 1981 | ||||||||||||||
| 1980 | 100% (19/19) Start from 1980 | 1980 | ||||||||||||||
Thanks the following people for information and suggestions/comments on the ranking and statistic: Kevin Almeroth, Marco Balduzzi, Kevin Borgolte, Billy Brumley, Kevin Butler, Juan Caballero, Michele Campobasso, Yinzhi Cao, Jihyuk Choi, Nicolas Christin, Mihai Christodorescu, John Clemens, Ton van Deursen, Sven Dietrich, David Evans, Clement Fung, Simson Garfinkel, Edy Glatz, Payas Gupta, J. Alex Halderman, Ragib Hasan, Thorsten Holz, Muhammad Ikram, Ashar Javed, Chang-han Jong, Paul A. Karger, Jonathan Katz, Brian Levine, Yuhang Lin, Zhiqiang Lin, Martin Andreoni Lopez, Peter Mell, Weizhi (Yuxin) Meng, Antonis Michalas, Abedelaziz Mohaisen, Lukasz Olejnik, Hamed Okhravi, Mert D. Pesé, Juan D. Parra Rodriguez, Christian Rossow, Kent Seamons, Monirul Sharif, Jaryn Shen, Ivo Sluganovic, Robin Sommer, Chao Yang, Vinod Yegneswaran, Zhiyuan Zheng, Jianying Zhou, Thomas Zimmermann, ... and you.
No comments:
Post a Comment