Navigating EdTech Product Research: A Guide to Using Repositories and User Reviews Effectively
By Stella Lee
In the ever-changing landscape of EdTech, finding the right tools can be a challenge. EdTech product repositories and user reviews such as elearningindustry.com, Talented Learning LMS directory, and Contact North offer a rich source of information. However, not all repositories are reliable and unbiased – to get the most out of these resources, we need to navigate them wisely and with a degree of caution.
Here are some tips to help you unpack the nuances and avoid potential pitfalls:
The Importance of Recent Reviews: Check how recent the reviews are – are they a few weeks old or a few years old? Older reviews might not reflect the current version of the product as technology changes quickly. On one hand, updates and improvements are continuously made, and what might have been a problem in the past could be resolved in the latest version. On the other hand, new updates might introduce issues not present in earlier versions. Equally important is the ability to track user reviews over time. By comparing older reviews with the most recent ones, you can get a sense of how the product has evolved. For example, if earlier reviews criticized the product for lacking certain features that are positively mentioned in recent reviews, it shows that the developers are responsive to user feedback and committed to improving their product.
Look for Patterns in Reviews: Rather than focusing on individual reviews, pay attention to consistent trends or common issues raised by multiple users. For example, when there are several mentions of particular technical glitches (e.g. errors in generating reporting data), difficulty in navigation (e.g. confusing buttons or inconsistent interfaces), or poor user experience (e.g. unable to reverse a mistake you made in the system), chances are you too would encounter similar problems. Conversely, if more than a few users report evidence of how the product streamlines their workflow, or how it enhances learning design. It is a good indication of the product’s effectiveness in this area.
Understand the Reviewer’s Perspective: Knowing the background of the reviewers (learning professionals, IT administrators, learners, etc.) can provide valuable context. A product might receive negative reviews from a particular user group (such as IT administrators) but rave reviews from another (such as learning designers). Understanding who is reviewing and their specific needs can help you assess whether the product aligns with your requirements. Also keep in mind that user reviews inevitably carry biases. What is more, some positive reviews could be incentivized or financially motivated, not necessarily reflecting the authentic user experience. Be wary of extreme opinions. These extremes could be a result of extrinsic motivation rather than authentic feedback, and can often be misleading or exaggerated.
Consult Multiple Sources: Do not limit yourself to a single repository. Diversifying your sources provides a more comprehensive view of the product’s performance and user satisfaction. Furthermore, endorsements and awards present in one repository might be influenced by factors other than the quality or effectiveness of a product. In cases where a product has received an award or endorsement, research the awarding body or individual. Scrutinizing the endorsers, their criteria, and potential biases is essential in evaluating the significance of the endorsement.
Keep an Open Mind on Lesser Known and Newer Products: It's important to keep an open mind about newer entries in the market. These products might not yet have made a significant presence in well-known repositories, or they may have fewer reviews compared to established counterparts. However, this does not necessarily mean they are of lesser quality. Newer products often incorporate the latest technological advancements and addressing niche needs in education. They might offer innovative features or approaches that more established products haven’t yet adopted. A case in point is that during the course of this year, many AI-enabled EdTech companies have entered the marketplace with products that integrate generative AI into the learning design and content creation process. Where reviews are sparse, consider reaching out directly to the early adopters of the product or the company itself to find out more information.
Remember, EdTech product repositories are just a starting point. Your research should include direct communication with vendors, trials or demonstrations of the products, and discussions with peers or other experienced users in your network. By adopting these strategies, you can navigate the wealth of information in EdTech product repositories more effectively, leading you to make more informed decisions in your selection and procurement journey.