Calculation

Scoring System:

The Scoutflo Health Score employs a comprehensive scoring system where each element within a key metric is assigned a score based on specific criteria. These scores for individual elements are then aggregated to calculate the overall score for each key metric. The overall health score of a product is determined by taking the average of the individual scores for each key metric.

Continuous Evaluation:

The Scoutflo Health Score is an ongoing process, ensuring that open-source products are regularly reevaluated. This continuous evaluation approach ensures that users receive the most up-to-date and accurate scores. It allows us to track the progress and improvement of open-source products over time, providing valuable insights.

Scoring Range:

The overall health metric ranges from 0 to 10, with 0 being the lowest and 10 being the highest. In this scoring range, a higher score indicates a better-performing open-source product across all key metrics.

Weightage:

Currently, all metrics have been given equal weightage when calculating the final score. However, further research is being conducted to assign weightage to each element and key metric according to its importance for businesses.

Formulas

  • Scoutflo Health Score = {Σ(Security scores) / 8 + Σ(Code Quality & Maintenance scores) / 4 + (Support Score) / 4 + Σ(Community Activeness Score) / 5 + Σ(Business score) / 3} / 5.

  • Here are the formulas to calculate each key metric from their respective elements:

  1. Security Score = {[Binary Artifacts Score] + [Branch Protection Score] + [Dangerous Workflow Score] + [Fuzzing Score] + [Licenses Score] + [Security Policy Score] + [Pinned Dependencies Score]}/7

  2. Code Quality & Maintenance Score = {[Maintained Score] + [Code Review Score] + [Token Permissions Score] + [Vulnerabilities Score]}/ 4

  3. Support Score = {[Avg. Issues Resolution Time Score] + [Avg. Closed Issues/Total Created Issues Score] + [Avg. Review Closing Time Score] + [Avg. Reviews Closed/No. of Reviews Score]}/ 4

  4. Community Activeness Score = {[Release Frequency Score] + [Month-on-month Growth in GitHub (Stars and Forks) Score] + [Social Links (LinkedIn, Twitter, YouTube, Mastodon) Score] + [Communication Channels (Slack, Discord, Forums, etc.) Score]}/4

  5. Business Score = {[Commercial Cloud Offerings Score] + [Investment Details Score] + [Future Product Roadmap Score]}/3

Last updated