VL 'XX Reviewer Form


Table of Contents


Reviewer Questionaire for Research Papers

Original research papers should make clear what new contribution the work makes to visual languages, and how the work differs from related works. If this research is an incremental improvement over similar, previously-published research by the same authors, the paper should be explicit about what it contributes beyond the earlier publications. Research papers are expected to be the largest category of papers that will be accepted at VL'XX.

  1. In your opinion, what is the topic of this paper? (Check all that apply):
    • Visual and multimedia programming languages
    • Software visualization and animation
    • End-user programming languages
    • Demonstrational languages
    • HCI issues for VLs
    • Empirical studies and evaluations of VLs
    • Languages for interaction
    • Visual database languages
    • Languages for geographic information systems
    • Visual design languages
    • Pen-based languages
    • Theory of visual languages
    • Visual languages for programming on the Internet
    • Some other relevant topic (please specify): ___________
    • Not a relevant topic (please specify): ___________
  2. Is the paper 8 pages or less, 2-column, approximately IEEE conference style?
  3. What is the main point of this paper?
  4. What is the new contribution to the theory of, implementation of, design of, HCI of, or other aspect of either VLs in general or the topic area(s) you checked above specifically?
  5. Significance of this contribution to VLs or to the specific topic area(s): (Enter 0-10: 0=there is no new contribution of any importance to VLs, 5=this is an incremental contribution of moderate size, 10=this is a significant new breakthrough)
  6. Technical correctness (Enter 0-10: 0=major problems, 5=some problems, 8=appears to be correct, 10=correct). See detailed comments.
  7. Coverage of related work: includes reasonably complete comparison to the body of related work, number and appropriateness of references (Enter 0-10: 0=major problems, 5=some problems, 8=appears to be acceptable, 10=complete/excellent). See detailed comments.
  8. Quality of written paper, including quality of writing and readability of figures (Enter 0-10: 0=major problems, 5=some problems, 8=acceptable, 10=excellent). See detailed comments.
  9. Interest level for VL attendees (Enter 0-10: 0=no interest to any attendees, 2=marginal interest to a limited number of attendees, 5=strong interest to at least 20% of attendees but no interest to anyone else, 8=some interest to most attendees and strong interest to at least 20% of attendees, 10=general interest to all attendees).
  10. Overall recommendation (Enter 0-10: 0=strong reject, 2=reject, 4=marginal reject, 6=marginal accept, 8=accept, 10=strong accept).
  11. Do you want to nominate this paper for Best Paper Award? (Criteria for the Best Paper Award include originality, significance, clarity of the explanation, and overall value to other VL conference attendees. Only papers in the Research category are eligible for Best Paper Award.)
  12. Detailed comments for the author(s)

Reviewer Questionaire for Case Study Papers

This is a new category this year. Original case study/application papers should describe the use of one or more VLs in the real world. Such papers are especially encouraged if they report on ways to use VLs or applications of VLs that have not been reported before. These papers should identify how they provide new insights into the applicability, usefulness, or ways to use VLs.

  1. In your opinion, what is the topic of this paper? (Check all that apply):
    • Visual and multimedia programming languages
    • Software visualization and animation
    • End-user programming languages
    • Demonstrational languages
    • HCI issues for VLs
    • Empirical studies and evaluations of VLs
    • Languages for interaction
    • Visual database languages
    • Languages for geographic information systems
    • Visual design languages
    • Pen-based languages
    • Theory of visual languages
    • Visual languages for programming on the Internet
    • Some other relevant topic (please specify): ___________
    • Not a relevant topic (please specify): ___________
  2. Is the paper 6 pages or less, 2-column, approximately IEEE conference style?
  3. Does the title include the word "Case Study"? (This is important to add context and clarity to how this paper fits into the field of VL research, both for our conference's attendees and for later readers).
  4. What is the main point of this paper?
  5. What is the new contribution this adds to published knowledge of the use/usefulness/applicability/etc of either VLs in general or the topic area(s) you checked above specifically?
  6. Are there errors in the programs or use of the languages in the case study? (Enter 0-10: 0=major problems, 5=some problems, 8=appears to be correct, 10=correct). See detailed comments.
  7. Coverage of related work: includes reasonably complete comparison to reported similar uses of VLs (Enter 0-10: 0=major problems, 5=some problems, 8=appears to be acceptable, 10=complete/excellent). See detailed comments.
  8. Quality of written paper, including quality of writing and readability of figures (Enter 0-10: 0=major problems, 5=some problems, 8=acceptable, 10=excellent). See detailed comments.
  9. Interest level for VL attendees (Enter 0-10: 0=no interest to any attendees, 2=marginal interest to a limited number of attendees, 5=strong interest to at least 20% of attendees but no interest to anyone else, 8=some interest to most attendees and strong interest to at least 20% of attendees, 10=general interest to all attendees).
  10. Overall recommendation (Enter 0-10: 0=strong reject, 2=reject, 4=marginal reject, 6=marginal accept, 8=accept, 10=strong accept).
  11. Detailed comments for the author(s)

Reviewer Questionaire for Poster Papers

Poster papers are most suitable for interactive discussion, and an interactive session will be set aside during the conference for this purpose. Work in early stages is especially encouraged, but unpublished work in any stage of development that would benefit from an interactive presentation is invited. The purpose of poster papers is to encourage lively interactions among VL conference attendees about the most recent developments in VL-related areas.

  1. In your opinion, what is the topic of this paper? (Check all that apply):
    • Visual and multimedia programming languages
    • Software visualization and animation
    • End-user programming languages
    • Demonstrational languages
    • HCI issues for VLs
    • Empirical studies and evaluations of VLs
    • Languages for interaction
    • Visual database languages
    • Languages for geographic information systems
    • Visual design languages
    • Pen-based languages
    • Theory of visual languages
    • Visual languages for programming on the Internet
    • Some other relevant topic (please specify): ___________
    • Not a relevant topic (please specify): ___________
  2. Is the paper 2 pages or less, 2-column, approximately IEEE conference style?
  3. What is the main point of this paper?
  4. Does the poster represent work on a new contribution to the theory of, implementation of, design of, HCI of, use of, or other aspect of either VLs in general or the topic area(s) you checked above specifically?
  5. Do you think the poster will encourage one-on-one discussions and interactions during the conference poster session?
  6. Technical correctness (Enter 0-10: 0=major problems, 5=some problems, 8=appears to be correct, 10=correct). See detailed comments.
  7. Quality of written paper, including quality of writing and readability of figures (Enter 0-10: 0=major problems, 5=some problems, 8=acceptable, 10=excellent). See detailed comments.
  8. Interest level for VL attendees (Enter 0-10: 0=no interest to any attendees, 2=marginal interest to a limited number of attendees, 5=strong interest to at least 20% of attendees but no interest to anyone else, 8=some interest to most attendees and strong interest to at least 20% of attendees, 10=general interest to all attendees).
  9. Overall recommendation (Enter 0-10: 0=strong reject, 2=reject, 4=marginal reject, 6=marginal accept, 8=accept, 10=strong accept).
  10. Detailed comments for the author(s)


VLHCC Home

Technical Program Chair
Last modified: Fri Sep 25 16:53:32 CDT 1998