In-depth guide

How to Manage Abstract Submissions and Peer Review at Scale

A practical guide to planning the call for abstracts, reviewer assignments, scoring, decisions and programme handover for high-volume research events in Saudi Arabia.

See Dryfta in action

Managing hundreds or thousands of abstracts is not simply a matter of collecting files. It is a coordinated process involving authors, co-authors, reviewers, track chairs and programme staff. This guide explains how to design that process so submissions remain complete, reviews are fair and traceable, decisions are made on time, and accepted work moves into the conference programme without being rebuilt in spreadsheets.

01

Start with governance, dates and decision ownership

Before the call for abstracts opens, agree who owns each decision. The scientific or programme committee should define the themes, submission types, eligibility rules, review method and decision categories. The event manager should translate those rules into dates, responsibilities, forms, messages and reports. Name the people who may extend a deadline, replace a reviewer, resolve a conflict of interest, change a score, request a revision or approve the final programme.

Build one working calendar from the call launch to programme publication. Include the submission deadline, an administrative screening period, reviewer invitation and acceptance dates, the review window, late-review follow-up, committee moderation, author notification, revision deadlines, presenter confirmation and programme handover. Leave time between stages. If review closes on the same day that decisions must be sent, one unavailable reviewer or disputed score can delay the whole event.

Document the rules in a short operating guide and use the same language in the call, reviewer instructions and decision templates. This gives the project team an agreed answer when questions arise and helps new committee members understand the process without relying on memory or private email threads.

  • Name an owner and a backup for every deadline and approval.
  • Define what the platform may automate and what requires committee judgement.
  • Record how exceptions, withdrawals, late submissions and appeals will be handled.
  • Approve the review rubric before authors begin submitting.

02

Design the call and submission structure before building the form

A clear call for abstracts reduces incomplete submissions and avoidable support requests. State the purpose of the event, who may submit, the topics in scope, accepted presentation formats, word limits, file requirements, language rules, important dates and the basis on which work will be reviewed. Explain whether the event accepts individual abstracts, panels, posters, workshops, full papers or multi-stage proposals, because each type may need a different form and review path.

Choose categories that help both authors and reviewers. Too few categories produce vague assignments; too many make authors guess between nearly identical choices and leave some tracks without enough reviewers. Ask track chairs to test the proposed list using examples from recent events. Decide whether authors may choose more than one topic and whether the committee may reclassify a submission after screening.

Write an acceptance policy before launch. Specify the available outcomes, such as oral presentation, poster, alternative format, wait-list, revision or decline. If reviewers can recommend a presentation format that differs from the author's request, explain that possibility in the call. This avoids presenting a routine programme decision as a surprise after months of work.

03

Create an author-friendly submission form

Collect the information needed for review, publication and scheduling, but do not turn the form into an administrative interview. A typical record includes title, abstract text, topic, preferred presentation format, author and co-author details, affiliations, presenter, keywords and required declarations. Conditional fields can show questions only when they apply, such as workshop duration, panel members, supporting files or equipment needs.

Separate the research content from author identity when using blind review. Give authors clear instructions about removing names, institutions or acknowledgements from files and text fields. Add an administrative screening step so staff can return identifiable or incomplete submissions before reviewer assignment. Test how special characters, Arabic and English names, long affiliations, pasted formatting, equations and uploaded documents appear in both the reviewer view and exported reports.

Let authors save a draft, return before the deadline and see an unambiguous submission status. The confirmation page and email should include the submission number, title, deadline, editing instructions and support contact. Where co-authors need to confirm participation or update profiles, explain who can edit the record and which person receives official communication. A clear author experience improves data quality long before the committee begins reviewing.

  • Use plain field labels and place instructions beside the relevant question.
  • Validate word limits and file formats before the final submission step.
  • Show authors a review screen before they submit.
  • Keep operational messages separate from optional marketing consent.
  • Test the complete journey on a phone as well as a desktop computer.

04

Recruit enough suitable reviewers

Reviewer capacity should be estimated before invitations are sent. Multiply the expected number of submissions by the number of reviews required for each one, then divide by a realistic assignment limit per reviewer. Add a reserve for declined invitations, conflicts, illness and late work. For example, a committee that needs three reviews per submission should plan for the total number of review assignments, not just the number of abstracts.

Collect expertise in a structured way. Topics, methods, populations, geographic focus and keywords can all help with matching. Also record conflicts of interest, unavailable dates and a reviewer's maximum workload. Avoid treating a broad department name as sufficient evidence of fit. A reviewer may be highly qualified in one part of a track and unsuitable for another.

The invitation should state the event, expected workload, review period, confidentiality requirements, conflict policy, scoring method and support route. Ask invitees to accept or decline promptly. A clear commitment produces a more reliable reviewer pool than assigning work to everyone who was nominated and hoping they respond.

05

Assign submissions fairly and manage conflicts

Good assignment balances expertise, workload and independence. Topic and keyword matching can produce a useful first pass, but a track chair should inspect the result. Check that specialist submissions are not assigned only to generalists, that one reviewer has not received a disproportionate load and that the same small group is not deciding an entire track. Keep an assignment log so changes remain understandable later.

Require reviewers to declare conflicts before they open the full submission. Your committee should define what counts as a conflict, which may include recent collaboration, the same institution, supervisory relationships, personal relationships, financial interests or direct competition. The rule will vary by discipline and organisation, so it should be approved by the event's authorised committee rather than improvised by the software provider.

Prepare a replacement process. When a reviewer declines, reports a conflict or misses an early checkpoint, the administrator should be able to reassign the work without losing the audit trail. Keep author identity hidden wherever the approved review model requires it, including notifications, filenames, exports and discussion screens—not only on the main review form.

  • Match by specific expertise as well as the author-selected track.
  • Set a workload ceiling and monitor assignments across the whole reviewer pool.
  • Let reviewers declare a conflict before accessing identifiable material.
  • Use a named chair to approve overrides and difficult assignments.

06

Build a review rubric that supports consistent decisions

The review form should reflect the purpose of the event. Common criteria include relevance to the theme, originality, methodological quality, clarity, significance and suitability for the requested presentation format. Define each score in words. A scale from one to five is useful only when reviewers understand what a one, three and five mean. Avoid combining unrelated questions into one score that nobody can interpret later.

Ask for concise comments that help the committee reach a decision and, where appropriate, separate comments intended for authors from confidential notes for chairs. Decide whether every criterion is weighted equally, whether a minimum score applies and how missing or extreme scores are treated. If different submission types use different rubrics, make sure reports do not compare unlike totals as though they were equivalent.

Run a calibration exercise with several sample abstracts. Reviewers score the same examples, then the chair discusses large differences and ambiguous criteria. The purpose is not to make everyone agree; it is to reveal where the rubric is interpreted differently before live submissions are affected. Keep final judgement with the authorised committee even when automated quality checks or AI assistance are available.

07

Monitor review progress without waiting for the deadline

A progress dashboard should show accepted invitations, unaccepted assignments, reviews not started, reviews in progress and reviews completed. Check these figures by reviewer and track throughout the review window. An early checkpoint gives the team time to replace inactive reviewers; a final-day reminder does not. Track whether every submission has the required number of completed reviews, not merely whether reviewers have logged in.

Use a planned communication sequence: invitation, acceptance confirmation, opening notice, midpoint reminder, approaching-deadline reminder and targeted follow-up for incomplete work. Messages should state the number of assignments remaining, the deadline, the sign-in link and a contact for problems. Avoid sending the same urgent reminder to people who have already finished.

Contact reviewers personally when an automated message does not resolve the delay. If a deadline is extended, update the platform, committee calendar and communication together. Quietly changing one date creates conflicting instructions and can undermine confidence in the process.

  • Review assignment acceptance within the first few days.
  • Check coverage by submission, reviewer and track at each checkpoint.
  • Reassign early when a reviewer is clearly unavailable.
  • Keep reminders specific, courteous and linked to the outstanding task.

08

Moderate scores and make defensible decisions

Scores organise evidence; they do not remove the need for programme judgement. Before the decision meeting, identify missing reviews, large differences between reviewers, possible conflicts and comments that require moderation. Give track chairs a consistent report containing criteria scores, overall recommendations, format recommendations and relevant comments without exposing information that the approved blind-review model should hide.

Agree how ties, outliers and limited programme capacity will be handled. A strong submission may still need a different format because of room, time or track balance. Record the reason for an override or changed presentation format. This protects institutional memory, makes author communication clearer and helps the committee review the process after the event.

Send decisions from approved templates but personalise the result and required action. State the outcome, presentation format, response deadline, revision instructions, registration requirement and contact route. Do not mark a presenter as confirmed merely because an abstract was accepted. Acceptance, presenter confirmation and paid registration are related but distinct statuses that the project team should be able to monitor.

09

Move accepted work into sessions and the published programme

The handover to programme planning is where disconnected tools create duplicate work. Accepted titles, descriptions, authors, presenters, formats, topics and files should remain linked to the original submission. The programme team can then group related work into sessions, appoint chairs, assign rooms and times, and publish the schedule without copying rows between spreadsheets.

Create a readiness report showing accepted submissions that lack a confirmed presenter, required revision, biography, permission, registration or final file. Resolve these gaps before scheduling becomes crowded. When an author updates an approved field, define whether the public programme changes automatically or requires staff approval. This prevents a late profile edit from silently changing published academic content.

Maintain one source of truth through the event app, website programme, signage, certificates and post-event archive. If a title or speaker changes, the authorised update should flow to each destination or appear in a controlled update queue. The aim is not automation for its own sake; it is to reduce mismatched information for attendees and repeated checking for the event team.

10

Protect research data and prepare useful reports

Abstract records may contain personal information, unpublished research, reviewer identities, confidential comments and declarations. Decide who may access each part of the record, how long it is retained and what will be published. Use role-based access, remove temporary reviewer access after the process and limit exports to people who need them. Your organisation's legal, privacy and security teams should confirm the requirements that apply to the event.

For Saudi events, map the collection and use of personal data against your approved privacy process and the applicable requirements of the Personal Data Protection Law. Explain the purpose of author and reviewer fields, collect only what is needed, and publish an appropriate privacy notice. Dryfta states that Saudi customer event platforms will be hosted in the AWS Middle East (Bahrain) Region; each organisation should still complete its own regulatory, contractual and security review.

Plan reports before launch. Programme chairs may need score distributions and coverage by track; operations teams need presenter readiness; communications teams need status-based lists; leadership may need submission, acceptance and geographic summaries. Test every report with sample data and verify that blind or confidential fields are not exposed to the wrong audience.

11

Test the complete workflow before the call opens

A form preview is not an end-to-end test. Create several test authors, co-authors, reviewers and chairs. Submit different formats, save a draft, cross the word limit, upload an invalid file, withdraw a record, declare a conflict, reassign a reviewer, enter extreme and missing scores, request a revision, send each decision and convert an accepted submission into a programme session. Check the participant view, administrator record, email and report after every step.

Ask people who did not configure the workflow to test it. They are more likely to notice an unexplained term, missing instruction or misleading status. Run the journey in English and Arabic where both are offered, and test mobile layouts, keyboard access, time zones, dates and the sender and reply-to details in every message.

After testing, remove sample records, confirm production email and deadline settings, and record final approval from the programme owner. During the live call, review incomplete submissions, support questions, reviewer capacity and track distribution regularly. After decisions are complete, hold a short retrospective and preserve the findings for the next event cycle.

  • Every submission type follows the intended questions and validation rules.
  • Blind review hides identity in forms, files, emails and exports where required.
  • Conflicts, reassignments and late reviews follow the approved process.
  • Scores, comments, decisions and format recommendations appear in the right reports.
  • Accepted content reaches presenter management and programme scheduling correctly.
  • English and Arabic messages, deadlines and support details are complete.

Common questions

Quick answers for the project team

How many reviewers should assess each abstract?

There is no universal number. The programme committee should choose a number that fits the discipline, risk and available expertise, then apply the rule consistently. Many events use more than one independent review so a single opinion does not determine the outcome, but the approved governance model should decide the final requirement.

Should the review be single-blind or double-blind?

Choose the model that fits your discipline and policy. Single-blind review hides reviewer identity from authors; double-blind review also hides author identity from reviewers. Whichever model you choose, test names, affiliations, filenames, emails, exports and discussion views—not only the main abstract text.

Can AI replace academic reviewers?

No. Automated tools may flag missing sections, possible duplication, topic signals or potential format mismatches, but they can be wrong and should not make an acceptance decision. Qualified reviewers and the authorised programme committee remain responsible for assessing research quality, handling context and recording the final judgement.

What happens when reviewers strongly disagree?

Flag the submission for moderation. A chair can inspect the criteria and comments, check for conflicts or misunderstanding, request an additional independent review where appropriate, and record the reason for the final decision. Do not simply average incompatible reviews without examining why they differ.

When should accepted abstracts move into the programme?

Move them after the decision is recorded, but track presenter confirmation, revisions and registration separately. The programme team can begin grouping accepted work while withholding public publication until the required content and presenter commitments are complete.

What should organisers measure after the cycle?

Review submission completion, support demand, reviewer acceptance and completion, reassignment rates, coverage by track, score differences, decision turnaround, presenter confirmation and programme corrections. Use the findings to improve the next call, not to rank reviewers or authors without an approved purpose.

Apply this checklist to your Saudi event

The Dryfta Software Company team in Riyadh can map these steps to your event workflows, with Saudi customer platforms hosted in AWS Bahrain.

Request a demo

Continue exploring

Turn the guidance into an event plan

Guides

Explore guides