征稿已开启

查看我的稿件

注册已开启

查看我的门票

已截止
活动简介
Theme Many results in Software Engineering suffer from threats to validity that can be addressed by the replication of previous empirical studies. These threats include: 1) Lack of independent validation of empirical results; 2) Contextual shifts in Software Engineering practices or environments since the time of the original research studies; and 3) Limited data sets at the time of the original research studies. However, certain factors discourage replication studies: 1) A perception persists that replication studies are less valuable than the presentation of original studies; 2) Data sets are often not made publicly available; 3) Reports of empirical studies are often not sufficiently detailed to foster replication; and 4) Research tools are either not available or not usable, so precise replication is impractical. Goals The purpose of empirical replication is twofold: To increase our confidence in empirical results (the reliability test). To explore the impact of contextual variations on those results (the generality test). Meeting these two goals requires mature, high-quality research replications. Thus the primary goal of this workshop is to raise the quality and amount of replication work performed in software engineering research. In particular this means: Collecting replications, whether confirmatory or contradictory, of previous studies, whether recent or old, on important questions. Collecting and packaging advice, tools, and experience regarding replication. Forming full-scale replications, perhaps going much beyond the original study, from multiple small-scale replications performed in a coordinated manner. The workshop also intends to be a forum for small-scale replications that are otherwise hard to publish. Accordingly, and in addition to general paper submissions, we collect results for one specific joint replication each year—soliciting small-scale replications, from which we intend to form large-scale replications by meta-analysis. Through this process, we expect to produce valuable insights on practical issues concerning replication. In addition, the workshop seeks to identify and suggest solutions for recurring practical problems in selecting, designing, performing, reporting, and publishing replication studies by furthering appropriate methods, tools, and standards. Joint Replication Project Consider participating in this year's Joint Replication Project! Individual results will be compiled into a major, distributed, joint replication (i.e., a journal paper, special issue, or something of that sort). Contributors will also have the opportunity to participate in the synthesis and publication of joint results. Additionally, all reports will be published in full and authors will share their work in a joint session at the workshop. Student Project Reports In many graduate courses, students have opportunities to perform small-scale replications. We invite the submission of reports from student projects. Accordingly, these reports and/or projects are not expected to be as comprehensive as a full-scale study and, understandably, may be subject to more threats to validity. In particular, we hope students will take the opportunity to explore new angles to old problems (such as Conway's Law—this year's Joint Replication Project). Topics Practice Replications confirming previous studies. Replications contradicting previous studies. Useless replications—small replications that contribute a few data points for use in meta-analyses. Surveys of replication studies in selected topic areas. Consider participating in this year's Joint Replication Project. Student project reports (see above), particularly for the Joint Replication Project. Methods Experience-driven advice on replication techniques and tools. Reliable and accessible data stores. Methods of reporting results to facilitate replication. Replication methods and insights from other research fields. Theory Philosophical positions. Insights from other research fields.
征稿信息
留言
验证码 看不清楚,更换一张
全部留言
重要日期
  • 10月09日

    2013

    会议日期

  • 10月09日 2013

    注册截止日期

主办单位
Association for Computing Machinery Special Interest Group on Software
移动端
在手机上打开
小程序
打开微信小程序
客服
扫码或点此咨询