Using AI-ML with immersive technology we can carry out learning modules which involve training, practice and assessment, says Nitin Dahiwale, Creative Head, VXR at Tata Elxsi in an interaction with CIO AXIS.
CIO AXIS: How can we integrate immersive technologies and be a part of the 4th industrial revolution?
Nitin Dahiwale: There are a lot of ways how we can club multiple key technologies along with immersive technologies. Using AI-ML, with immersive technology we can carry out learning modules which involve training, practice and assessment.
We can use immersive technologies like VR & AR for training, and the practice aspect of the module can be combined with artificial intelligence and machine learning which assimilates learner’s actions and performance of the task.
To develop the platform, we can use gaming engines like Unity and Unreal. For immersive hardware Oculus Quest or Hololens or Varjo can be used. For visualizing platforms one can use platforms like virbella or ShapeXR.
CIO AXIS: How do you quantitatively assess the progress of a user/learner who is undergoing immersive learning program?
Nitin Dahiwale: Using Cutting edge technologies like internet of things, artificial intelligence and machine learning we can use techniques like Human Pose detection & Human Pose estimation to assess the progress of a learner undergoing immersive learning program.
Using Big data and cloud computing, AI and ML can make an assessment by drawing comparisons with benchmark standards, allowing one to measure the quantitative deviation. It can also call out the percentage error to learners on a particular learning session through leader boards.
CIO AXIS: List down keys trends that you can see in EDTECH space for the corporate sector?
Nitin Dahiwale: The key trends we are likely to witness in the EdTech space are in two categories-technology & learning content.
Technology trends
– Learning Analytics
o Learning analytics helps in measuring the key indicators of learner performance and helps learners understand their strengths and areas of improvement, which they can work on.
– Adaptive Learning
o With adaptive learning, employees can have flexible learning schedules. Learners can choose their learning path. Learners can learn from the content at their own pace. Thus, employees perceive this training as an opportunity and not as a task to be completed
– Microlearning Platforms
o There are several micro learning platforms now that aim to help learners learn subjects quickly and effectively. While some use assessment as their core strategy, others use courses and gamification to make the learning stick.
o It is a strong tool for learners to access impactful bite-sized learning.
Learning Content Trends
– Gamification and Game-Based Learning
o Gamification features like unlockable achievements give employees instant feedback whenever they do something positive
o ” You can also assign badges to specific pieces of content, like assessments.
o help organizations create engaging, fun, immersive, and memorable learning experiences.
– Virtual Reality-
o Virtual reality is one of the most popular mediums through which an array of training and learning content can be relayed to learners.
o Due to the advantages VR has to offer, companies and organizations use VR to expose their employees and teams to hazardous scenarios by simulated digital environment in a safe manner. They can train and prepare them for disaster management and hazardous situations.
– Continuous Learning Journeys
o People need to learn continuously to retain the learning imparted during formal training sessions.
o Micro learning can be used to carry out the continuous learning journey of a learner. There are many micro learning platforms which can make this very easy to implement in today’s times already.
o Continuous learning journeys are the need of the hour. We have seen an increase in its adoption, and it will continue to grow in the coming years.
CIO AXIS: How integrating smart learning and experiential learning across industries is benefiting the users (healthcare, automotive, rail, etc)
Nitin Dahiwale: The integration of smart and experiential learning can have a deep andpositive impact for users across industries. In healthcare, integration of these technologies assist in practicing and preparing for unique and complicated cases as well as tele mentoring for providing tailored guidance during the procedure by experts. Virtual environments for Paramedics enable to learn both procedures and self-control. It also educates physicians about various apparatus, equipments & procedures and provides course material to practice from anywhere. These technologies can also create stress relieving virtual environment using VR hardware and mobile apps (clubbed with internet based cognitive behavioural therapy) specific to phobia management and PTSD. As well as creating a safe environment for patients to engage in therapy sessions and provide emotional fidelity and real time feedback for patients. Additionally, it also provides a documented case repository for reference for psychologists.
In manufacturing, these technologies, use AI-ML for Human Pose Estimation & detection to assess task performance and specific movement evaluation and draw comparison with benchmarked movement. It also provides a safe environment and real time feedback for effective assessment.
In Retail, integration of these technologies allows retailers to educate themselves on the sales strategy for a particular brand from the comfort of their own space. Sales teams can train themselves about the unique selling points of textile materials. Infact, emerging paradigms like circular economy and sustainable design concepts can be promoted through this learning platform.
Similarly, in Automotive and Rail integration of smart and experiential learning allows vehicle designers and engineers to virtually conceptualise, ideate and create digital prototypes collaboratively as well as assess and evaluate outcome. At the same time, technicians can learn about the interiors of the vehicle in VR 3D world. As well as, locomotive pilots can experience the cockpit and prepare themselves for real time experiences.
CIO AXIS: How the implementation of smart and experiential learning will make businesses smart?
Nitin Dahiwale: The implementation of smart and experiential learning solutions across industries has huge potential to make business upskill, reskill and be relevant. For in healthcare it will make training sessions richer and more intuitive and expose the users to unique cases for better learning. VR will help keeping medical training formalised and ensure a stable level of performance quality and standardized skill set. It will ensure a more impactful therapy and faster detection of points of potential therapeutic manipulation and improved behavioural confidence.
In the manufacturing sector, the implementation of these technologies will witness a reduction in on-site training cost by 40%. As well as a significant reduction by 60% in training infrastructure set up cost and shorter training program periods. It will also enable 80% reduction in logistics and inventory loses and 76% cost reduction for train technicians and a shorter on boarding and orientation program on the shop floor.
The railway, automotive and retail space will also experience a reduction in prototype production time as well as a reduction in time & efforts to visualize the end-product. It will allow faster prototyping and enable ready-made product demonstrating platform.
With respect to utilities, execution time will fall by 30% and a 55% decrease in service resolution time
CIO AXIS: How smart learning can leverage immersive qualities, design for presence, Storytelling, sensory feedback and controls etc?
Nitin Dahiwale: Presence is an important design tool in immersive platforms. It ensures that users are well absorbed into the digital world and are engaged into the experience. Hence having a rich presence in the immersive world is a very critical aspect of imparting experiential learning.Whereas storytelling, Improv and Imagineering are extremely important skills needed for designing immersive platforms to ensure high levels of ‘presence’. Just like in 2D screens, wireframing, UI, UX are important aspects of an app, we have storytelling, improv and Imagineering for creating immersive worlds.
Storytelling helps in Navigating, Imagineering helps in UX and Improv helps in designing UI.
Using sensory feedback like audio cues, visuals, haptic feedback, coupled with emotional fidelity makes the entire learning experience enjoyable and impressionable. Sensory feedback in smart learning is a crucial component as only through multimodal feedbacks can the learner immersive themselves into the required contextual environment and build on the experiential learning.
CIO AXIS: How can brands use VXR platforms to keep up with emerging technologies and act as a change / driving force for experiential learning practices? (Highlight use cases / content consumption by individuals)
Nitin Dahiwale: VXR platform provides the necessaryfertile land to adopt and facilitate technologies like Digital Twins, Artificial intelligence, Machine learning, IOT etc. Immersive technologies coupled with these emerging technologies can propel experiential learning towards smart learning. Using these technologies in collaboration can help learners as well as trainers in terms of task performance assessment and evaluation, gamified learning experience, learning journey curve, through qualitative and quantitative data points.
In one of our interesting immersive projects, after creating an MR phygital welding simulator, it was equally important to assess the technicians weld job so that they can be graded. So, for the purpose of evaluation, we layered the MR platform with other cutting-edge technologies & techniques. We used external cameras and sensors for body pose tracking and vigilance purposes.
With the help of artificial intelligence and machine learning, we could detect the pose and evaluate specific movements. Infrared cameras helped track body movement and allowed to compare with the benchmark movement. The AI was then able to draw comparisons and evaluate on the basis of the input data points. The derived suggestions / assessments were relayed to the user for improving their physical task.
So, by using cutting edge technologies like AI and ML, we could detect and assess task performance based qualities. Such usage of emerging technologies is domain agnoistic.