Communications of the ACM
Communications of the ACM
Where Have All the Workshops Gone?
My initiation into the computing-research community was a workshop on "Logic and Databases" in 1979. I was the only graduate student attending that workshop; my graduate advisor was invited, and he got permission from the organizers to bring me along. In spite of the informality of the event I was quite in awe of the senior researchers who attended the workshop. In fact, I was quite in shock when one of them, an author of a well-respected logic textbook, proved to be far from an expert in the subject matter of his book.
Throughout the 1980s, workshops continued to be informal gatherings of researchers mixing networking with work-in-progress presentations and intellectually stimulating discussions. A workshop was typically a rather intimate gathering of specialists; an opportunity to invite one's scientific friends to get together. While conferences were the place to present polished technical results, workshops were a place to see if your colleagues were as impressed with your new results or directions as you were. The pace was leisurely, many presentations were done on blackboards, and it was perfectly acceptable to ask questions during presentations. Organizers may have posted an occasional "call for abstracts," but never a "call for papers." In fact, workshops typically had no formal proceedings.
Such informal workshops are almost extinct today. As selective conferences become our dominant way of publishing, workshops have gradually become mini-conferences. Today's workshops have typically large program committees, calls for papers, deadlines, and all the other accoutrements of computing-research conferences. What they usually lack is the prestige of major conferences. Furthermore, most workshops today do publish proceedings, before or after the meeting, which means a workshop paper cannot be resubmitted to a conference. As a result, today's workshops do not attract papers of the same quality as those submitted to major conferences.
Workshops have become, I am afraid to say, simply second-rate conferences. Yes, I am sure there are exceptions to this, but I believe my description does apply to the vast majority of today's computing-research workshops. It is not uncommon to see workshops where the size of the program committee exceeds the number of papers submitted to the workshop. It is not uncommon to see deadlines extended in the hope of attracting a few more submissions.
I miss the old workshops. Regardless of what one thinks of computing-research conferences (our community is now engaged in serious discussions on the advantages and disadvantages of these meetings), informal workshops played an important role in the computing-research ecosystem. Many preliminary results improved significantly as a result of feedback received from discussions carried out during these gatherings. The disappearance of such workshops is, in my opinion, a loss to our community.
I am a big fan of Schloss Dagstuhl, a workshop facility near the small town of Wadern in Germany. Schloss Dagstuhl was built as a manor house of a German prince in 1760. It was converted into the International Conference and Research Center for Computer Science in 1989, now called Leibniz Center for Informatics. The first week-long seminar (Dagstuhl workshops are called seminars) took place in August 1990. Since then, Dagstuhl has hosted close to 800 seminars, drawing about 30,000 participants. In addition to week-long seminars, Dagstuhl hosts perspectives workshops, summer schools, retreat stays of research guests, and the like. If you receive an invitation to a Dagstuhl seminar, accept it! The facility offers a good library and an outstanding wine cellar. The rural location facilitates both group and one-on-one interactions. In a nutshell, Dagstuhl is the place to experience the tradition of workshops as informal scientific gatherings. Its contributions to computing research over the past 20 years are incalculable. It is no wonder that the National Institute of Informatics in Japan recently created a similar center in Shonan, near Tokyo.
This brings me to a question that has been bothering me for years. Call it "Dagstuhl Envy," but why don't we have a North American "Dagstuhl"? There are several facilities in North America to host mathematics workshops, for example, the Banff International Research Station, and these are often used for workshops on topics in theoretical computer science. There is, however, no facility dedicated for general computing-research workshops. It would probably take about $10 million to build such a facility and approximately $2 million–$3 million annually to cover operating costs. These are modest sums in the context of the size of the North American computing-research portfolio and the size of the North American information-technology industry. Can we make it happen?
Moshe Y. Vardi, EDITOR-IN-CHIEF
©2011 ACM 0001-0782/11/0100 $10.00
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee.
The Digital Library is published by the Association for Computing Machinery. Copyright © 2011 ACM, Inc.
Comments
Keith Instone
Thanks for article. I think the loss of more informal gatherings for the community is a great loss.
My favorite part of the CHI conference is the pre-conference workshops. So I would say your version of a workshop is still alive and well there. As a practitioner, I use workshops to help me connect with researchers. ("Special interests groups" are my second favorite CHI venue, also informal.)
I have to admit that I turned down an invite to a Dagstuhl seminar - because I could not make the trip to Germany. If there was a location "closer to home" then, sign me up!
Jeremy Siek
Hear hear! A Dagstuhl in North America would be wonderful! Let's make it centrally located. I vote for Colorado :)
Angelos Keromytis
I agree --- some of my more pleasant experiences have been at informal workshops. The New Security Paradigms Workshop (NSPW) is an excellent example of such a venue that is still going strong. See http://www.nspw.org/ for details (there is a CFP, but that's to ensure a fair selection process in order to keep the workshop small and the discussions meaningful). The latest USENIX ;login: magazine had a report on the previous NSPW (which I co-chaired). For those interested, see http://www.usenix.org/publications/login/2010-12/openpdfs/NSPW10Reports.pdf
CACM Administrator
The following letter was published in the Letters to the Editor in the April 2011 CACM (http://cacm.acm.org/magazines/2011/4/106576).
--CACM Administrator
Moshe Y. Vardi's Editor's Letter (Jan. 2011) posed the possibly rhetorical question "Where Have All the Workshops Gone?" Just as business strategy is influenced by tax law, the nature of workshops is determined, in part, by academic- and corporate-funding policies. Corporate attendance at an external (to the organization) conference or workshop is often driven by whether a mainstream research paper has been accepted for publication in its proceedings. Likewise, academic promotions and salary increases at research universities are influenced by whether a paper was published in "first tier" conference or workshop publications. These policies are mainly responsible for the demise of the type of workshop Vardi described.
I have found, at least in my company, that enlightened management encourages the free exchange of ideas and best practices at such workshops, even though they are typically closed events due to IP concerns. However, organizing them so they're indeed open to the public and attract attendees and speakers likely requires a change in promotion and tenure policies at universities and a value proposition that encourages participation by industrial researchers.
Brian Berenbach
Princeton, NJ
Displaying all 4 comments