Average Score & Rankings

Overview

The Ranking Score page within the campaign configuration is a pivotal component that allows users to define the weight and significance of each survey question and configure the algorithm for leaderboard rankings. It consists of two main sections: the Question Ranking and the Ranking Configuration.

Question Ranking

The primary section of the Ranking Score page is dedicated to the individual questions within the survey. The main screen displays each question from the survey.

Open-ended question types appear greyed out and are ineligible to contribute to the survey ranking. The following question types do not contribute to a survey’s average score:

• open-ended question

• ranking question

• upload question

• image question

Open

Question Weight

For qualitative questions, check the checkbox beside the question number to include it in the survey score. Uncheck the checkbox to exclude a question from impacting the survey score. Once enabled, default values exist for question responses but can be customized according to specific campaign requirements.

Open

Each question, by default, carries an equal weight toward the overall survey score (1). For questions included in the ranking, customize the weight assigned to each to influence its impact on the overall score.

Ranking Configuration

The other significant part of the Ranking Score page is the Ranking Configuration, which serves as the algorithm to determine leaderboard rankings. It considers key data points, including survey completion rates, the number of verified reviews received, and the average score from reviews submitted to the Experience.com platform by verified customers.

Minimum Requirements

By default, to rank on the campaign’s leaderboard, a user must meet certain minimum requirements:

• Minimum number of (verified) reviews: 5

• Survey completion rate: at least 40%

Algorithm Factors

Survey completion rates, the number of verified reviews, and average scores from reviews contribute to the algorithm for calculating leaderboard rankings. Additionally, normalizers are added to balance the algorithm when calculating it monthly versus yearly.

Best Practices

• Regularly review and update question weights to reflect the evolving priorities of your survey.

  • Any updates made to the ranking configuration of an active campaign will apply those changes to new data only, and will not be retroactively applied to existing data for the campaign. 

• Consider the minimum requirements for leaderboard rankings to encourage meaningful participation in highly competitive groups.

Conclusion

The Ranking Score page empowers users to fine-tune survey question importance and configure a robust algorithm for leaderboard rankings. By providing flexibility in question customization and setting minimum requirements, this feature ensures a comprehensive and fair assessment of user performance on the Experience.com platform.