Content
Proctoring Application
With user-centered approach, Empowering proctors with data-driven decision-making and seamless interaction
Streamline exam monitoring with real-time insights at your fingertips.
The proctoring app is facing serious issues that make it hard for proctors to properly monitor and secure remote exams. The system often crashes or has compatibility problems, and the alerts are confusing and poorly managed. There’s also a lack of real-time technical support, leaving proctors feeling overwhelmed and unable to do their job effectively. These problems reduce the reliability of the proctoring process. To fix this, the system needs to be more stable, the alert system should be clearer, and better tools and support should be provided to help proctors.
The Problem Statement
To make proctors' jobs easier and more efficient, the goal is to look at the current problems and suggest improvements. This includes making the system more stable, simplifying how alerts work, and giving proctors better support tools. Fixing these issues will make the proctoring process more reliable and easier to manage, ensuring that online exams are secure and run smoothly.
Objective
Solving these issues will enhance the efficiency of proctors, reduce stress during exam sessions, and significantly improve the platform's reliability in ensuring fair and secure testing environments.
Impact
Customizable Dashboards: Allowing stakeholders and product managers to track specific KPIs, including exam completion rates, false positives/negatives, and system uptime.
Reporting Tools: Generate automated reports on compliance, system performance, and user behavior, which are crucial for both product managers and stakeholders to make informed decisions.
Real-Time Alerts and Notifications: Immediate notifications for potential breaches of exam integrity or system issues.
Data Privacy and Compliance Features: Ensure both stakeholders and product managers can oversee data handling, making sure the platform adheres to regulations.
Output
Dashboard Overview
In the initial release of the proctoring dashboard, the focus was on laying a solid foundation with minimal yet essential features, and it was made available to a few beta customers for testing.
A visual breakdown of the proctor’s working hours, breaks, and out-of-schedule time over a series of days.
Displays a circular graph indicating the proctor’s adherence to schedule, tracking productivity, breaks, and meeting times.
Critical proctoring statistics such as CSAT (Customer Satisfaction Score), average concurrency (active sessions), adherence rate, rejected candidates, ART (Average Response Time), site ranking, and engagement score.
To make proctoring more effective, AI can be used to detect suspicious behavior and automate important tasks. Machine learning can look for patterns in how users behave and spot anything unusual that might suggest cheating. By adding these AI tools, along with improving system stability and simplifying alerts, proctors will be able to monitor exams more easily and ensure everything is fair.
Building a Solution
To effectively manage AI-powered proctoring solutions, KPIs are essential to ensure exam integrity, system efficiency, and user satisfaction
KPIs provide insights into the effectiveness, reliability, and fairness of AI proctoring systems, helping institutions maintain exam integrity while optimizing user experience.
What is the product promising?
Speak to our Proctors and gather Insights
I organized a session with our users to better understand how this dashboard is assisting them and what it needs, all while studying the real-world pain spots that slow them down in their daily Tasks. This session was conducted with five managers and proctors from different locations around the world.
Re-prioritising features and plan the roadmap
From the workshop with users, I gathered a lot of new insights that were not identified before. A list of critical needs was identified. The experience outcomes were updated with the latest needs.
Speak to our Proctors and gather Insights
I organized a session with our users to better understand how this dashboard is assisting them and what it needs, all while studying the real-world pain spots that slow them down in their daily Tasks. This session was conducted with five managers and proctors from different locations around the world.
Re-prioritising features and plan the roadmap
From the workshop with users, I gathered a lot of new insights that were not identified before. A list of critical needs was identified. The experience outcomes were updated with the latest needs.
Whats Next?
Adherence Monitoring:
dashboard shows the "Adherence Level" at 40%, along with important stats like how much time proctors are spending on tasks like productivity, meetings, breaks, and handling time (AHT). The negative numbers show areas that need improvement, like productivity being down by 13% and breaks by 7%.
A "Break Report" shows how much time was spent working, on breaks, or off-schedule over a few days.
Real-time Monitoring:
Proctors can watch six candidates at once. Each candidate has their own set of monitoring tools, like timers, alerts, and flags.
Alerts show up when there are issues, like suspected camera tampering or the use of banned items like smartwatches. For example, some candidates have alerts for camera or smartwatch detection.
There’s also a built-in chat feature for proctors to communicate directly with candidates, like how proctor Karthik is chatting with the candidate Shoo.
On the right, the proctor can see each candidate's connection status and history, which helps track if candidates are engaged or having connection problems, like trying to reconnect multiple times.
Each candidate's video feed has warning icons for issues, such as problems with the camera or suspicious behavior.
Insights
The goal is to help proctors stay more focused and productive, so they can make faster and more accurate decisions when managing candidates. Proctors will be able to easily monitor several candidates at once, quickly handle alerts, and address any suspicious activity. Communication with candidates will also improve, leading to better engagement. Key performance measures, like customer satisfaction and rankings, will get better, motivating proctors to perform well. With built-in scheduling, proctors will manage their time more efficiently. Clear data reports will help with smarter decision-making, making the proctoring process smoother and improving the overall experience for candidates.
Obtaining the desired outcome
NDA Disclaimer
