Company: Umbrella IT
Company Description: Umbrella IT (UIT) is a globally oriented company providing web and mobile development and IT consulting services with a focus on fintech, retail, and media. Being on the market for 13 years already, UIT has completed more than 200 international projects for clients in over 22 countries.
Nomination Category: Product & Service Categories - Education & Education Technology Solutions
Nomination Sub Category: AI Solution in Ed Tech
 Nomination Title: Beyond Words AI-based VR platform for interactive language learning
- Which will you submit for your nomination in this category, a video of up to five (5) minutes in length about the the nominated new or new-version product or service, OR written answers to the questions for this category? (Choose one):
Written answers to the questions
- If you are submitting a video of up to five (5) minutes in length, provide the URL of the nominated video here, OR attach it to your entry via the "Add Attachments, Videos, or Links to This Entry" link above, through which you may also upload a copy of your video.
- If you are providing written answers for your submission, you must provide an answer to this first question: If this is a brand-new product, state the date on which it was released. If this is a new version of an existing product, state the date on which the update was released:
7 December 2023
- If you are providing written answers for your submission, you must provide an answer to this second question: Describe the features, functions, and benefits of the nominated product or service (up to 350 words):
Total 318 words used.
The Beyond Words VR platform is an IT product developed by Umbrella IT (a web and mobile developer and consultant) for Beyond Words (an EdTech startup specializing in corporate language courses and training).
The platform offers a unique learning experience by immersing users in the environment of the target language via VR simulations, and allowing them to practice their speaking skills in situations resembling real-life scenarios. After completing a lesson, the platform provides feedback to the student using AI technologies on their pronunciation in the form of a report, including a phonemic analysis of each spoken word and sound. The product makes the language learning process more interactive, efficient, and motivating.
The product was developed by a team consisting of frontend and backend developers, a UI/UX designer, a systems analyst, a DevOps engineer, a Data Scientist, and a project manager.
The team developed a custom tool for editing and launching spherical videos with the function of adding interactive elements (pop-ups, questions) as there were no ready-made solutions with the required functionality on the market. It was ensured that in the VR space, users can communicate with NPCs, pause the VR scene, and use an interactive panel with response options. After selecting a response, users need to voice it. After that, the system accepts the response, the panel disappears, and the conversation continues.
No neural network on the market was capable of phonemic analysis and real-time material assessment in VR, so the team had to develop the custom AI tool as well. To work on our own solution, we engaged a Data Scientist to integrate three different AI models into one module to ensure equally high-quality experience and flawless voice recognition and analysis in all available mediums – on the web and VR headsets.
An admin panel was developed to create accounts for students and teachers, launch new courses, add content, and grant access to them for specific users.
- If you are providing written answers for your submission, you must provide an answer to this third question: Outline the market performance, critical reception, and customer satisfaction with the product or service to date. State monetary or unit sales figures to date, if possible, and how they compare to expectations or past performance. Provide links to laudatory product or service reviews. Include some customer testimonials, if applicable (up to 350 words):
Total 214 words used.
Beyond Words AI-based VR platform for interactive language learning has no equivalent counterparts on the market, where competitors offer similar products and employ traditional teaching methodologies lacking the immersive experience.
The final IT product met the client's expectations in terms of:
time: Umbrella IT developed the product from scratch within a tight timeframe of 3.5 months;
cost: Umbrella IT utilized only open-source tools to develop all components of the VR platform and reduced hosting expenses.
adaptability: the project works with headsets of the Meta Quest and Pico families - Meta Quest 2, Meta Quest 3 and Meta Quest Pro, as well as Pico 4 and PICO Neo 3. Meta Quest headsets currently have an 80% market share. If you receive a request to support another virtual reality headset in the future, adapting will require minimal effort - just adapt to the headset design as we did with the Pico.
commercialisation: only European-compatible services and open source tools were used in the product building for potential grant eligibility and cost saving. Immediately after the product launch the VR platform was presented by Beyond Words CEO to the investors at an exhibition In Finland.
Results:
- The first learning VR platform with AI in Europe
- 4.8/5 rating of customer satisfaction
- 7 languages
- 3000+ interaction scenarios
These key achievements indicate the successful launch of the service and the fulfillment of the customer's business requirements, as evidenced by the positive feedback on Clutch.
- You have the option to answer this final question: Reference any attachments of supporting materials throughout this nomination and how they provide evidence of the claims you have made in this nomination (up to 250 words):
| Attachments/Videos/Links: |
|---|
|
