WordPress.org

Making WordPress.org

Opened 5 weeks ago

Last modified 5 weeks ago

#5196 new enhancement

New or enhanced rating system discussions

Reported by: Rhialto Owned by:
Milestone: Priority: normal
Component: Plugin Directory Keywords:
Cc:

Description

I want to open up discussions for a better plugin's rating system. The current star rating can be abused by some devs who suddenly completly change a plugin which is suddenly not appreciated but still keep enjoying good reputation because of a lot of 5 stars rating given all the previous years. I think this issue should have been looked into a while ago but the good news is it's never too late to revisit the problem and think on ways to improve. WP is still going strong and will only keep growing with more plugins being added every week but also plugins being updated at any time. Any opinion on this? Ideas?

Change History (6)

#1 follow-up: @joyously
5 weeks ago

How would you prevent what you are calling abuse? What changes are you advocating?

#2 in reply to: ↑ 1 @Rhialto
5 weeks ago

Replying to joyously:

How would you prevent what you are calling abuse? What changes are you advocating?

I just wanted to bring this up for discussions, some may aldreay have good ideas on ways to improve. Do you agree the current system was never enhanced since introduction and could get some improvements?

#3 follow-up: @joyously
5 weeks ago

I'm not ever reading reviews or looking at star ratings because I'm a programmer, so I look at the code. But most people do look at the ratings.
It sort of sounds like you are suggesting some sort of sliding time frame that the ratings are calculated from, so that the rating average is from current ratings (within that time frame) instead of the lifetime of the plugin. This would more accurately reflect the current state of the plugin, but the way around it (since people will game everything) is to close the plugin and start a new one.
Perhaps if the rating was tied to a version number, but how do you average those or display them all separately?

#4 in reply to: ↑ 3 @Rhialto
5 weeks ago

Replying to joyously:

It sort of sounds like you are suggesting some sort of sliding time frame that the ratings are calculated from, so that the rating average is from current ratings (within that time frame) instead of the lifetime of the plugin. This would more accurately reflect the current state of the plugin.

Exactly this.

but the way around it (since people will game everything) is to close the plugin and start a new one.

Well as an example, that's what latest 1 star ratings are saying while complaining about latest changes on a plugin I was watching but I don't think it is actually possible to force a plugin author to return a plugin to a previous state and start a new one.

This seems an issue with quite a few plugins from comments I was reading here and there and that triggered me into looking for a solution and there am I after begin redirected from support forum to slack to here. :-)

Perhaps if the rating was tied to a version number, but how do you average those or display them all separately?

That's what I was also thinking about, but just like you I didn't know how to solve the puzzle. With all the talented people working on WP, no doubt someone will come up with propositions.

#5 @Rhialto
5 weeks ago

Now that I think about it, Amazon also use a star rating systems but with a bit more code... https://www.amazon.com/gp/help/customer/display.html?nodeId=GQUXAMY73JFRVJHE
There could be inspiration ideas from it? They also have to deal with product updates.

Last edited 5 weeks ago by Rhialto (previous) (diff)

#6 @dd32
5 weeks ago

See Also: #1181 (Use a Rolling Time Frame for more current reviews).

I did some back-of-the-napkin maths a while back as shown in that ticket, and in general aside for a handful of plugins there was very little benefit to the overall ratings by applying a 6month rolling timeframe for reviews.
Having more data points (reviews) per theme/plugin would make it easier to change something here.

Note: See TracTickets for help on using tickets.