Remote Proctoring: How Examinees Cheat and How To Catch Them

00:48:35
https://www.youtube.com/watch?v=AznXrUImJXQ

Summary

TLDRThe webinar explores various strategies to maintain exam integrity in remote proctoring, presented by industry leaders, Patrick Ochoa and Don Castner from Monitor EDU, and Raul Rivera from Sumati. Monitor EDU utilizes live human proctors alongside a dual-camera setup, allowing for direct intervention during exams. Sumati offers AI-driven proctoring tools, including a secure browser, biometric authentication, and facial recognition, to detect suspicious behavior and ensure that the right candidate is taking the exam. The discussion highlighted students' various cheating tactics, including impersonation and using unauthorized materials. Participants addressed privacy issues and geographic challenges, emphasizing the importance of compliance with regulations such as GDPR. Proctoring on mobile devices currently faces technical limitations. Organizations remain vigilant about ensuring exam integrity through combined technological and human solutions. Both companies aim to offer solutions tailored to the exam's stakes and requirements, ensuring secure and fair testing environments.

Takeaways

  • 📹 Monitor EDU uses live human proctors and dual-camera setups for real-time monitoring during exams.
  • 🤖 Sumati's solution involves AI and biometric authentication to ensure the right individual is taking the exam.
  • 📚 Common cheating methods include impersonation, hidden notes, and unauthorized devices.
  • 🔒 Proctoring solutions have to balance privacy and security with effective monitoring.
  • 🌐 Internet stability can affect the performance of proctoring tools in certain regions.
  • 📲 Mobile devices are currently best used as secondary monitoring devices in proctoring solutions.
  • ⚖️ The approach to proctoring should be tailored to the stakes of the exam, whether high-stakes professional tests or broader civil service exams.
  • 🔍 There's an ongoing need to identify and close loopholes that students may exploit in remote settings.
  • 🛡️ Compliance with GDPR and local privacy laws is crucial in handling exam data securely.
  • 💡 IT and practical support are essential to ensure that proctoring tools are accessible and understandable for test-takers.

Timeline

  • 00:00:00 - 00:05:00

    The webinar introduces the topic of remote proctoring, discussing how examiners cheat and methods to catch them. Two experts represent their companies: Monitor EDU, emphasizing live human proctoring, and Sumati, focusing on scalable AI-based solutions. Initial introductions are made by representatives, highlighting their organization's core competencies and geographical operations.

  • 00:05:00 - 00:10:00

    Sumati is described as employing robust AI techniques for proctoring, using various authentication methods including facial and typing recognition, and a forthcoming voice recognition technology. They focus on validating exam environments and introducing a second camera for comprehensive supervision. They also mention their ability to block unauthorized system access during exams.

  • 00:10:00 - 00:15:00

    Examples of cheating are shared, including candidates using VPNs to leverage unauthorized help during exams. Proctors reported on candidates displaying abnormal behavior like eating during exams, leading to suspicion and uncovering of fraud. The need for vigilant monitoring using both technology and human oversight is emphasized.

  • 00:15:00 - 00:20:00

    They explain new challenges such as candidates using a second monitor for cheating, or employing virtual machines to bypass security. Emphasis is placed on developing robust system-level monitoring and application blocking to counter new cheating methods. Creative methods continue to evolve, prompting ongoing security enhancements.

  • 00:20:00 - 00:25:00

    The discussion shifts to VPN use during exams, noting that some candidates might need to use them based on geographical restrictions, such as in China. They outline the challenge of balancing necessary VPN use with the potential for misuse and highlight considerations needed for effective proctoring in diverse technological environments.

  • 00:25:00 - 00:30:00

    The topic of data privacy versus exam security is discussed. Solutions focus on ensuring compliance with international data protection regulations while still capturing necessary data for exam integrity. Emphasis is placed on adjusting data retention based on client needs and minimizing data storage as soon as client requirements are fulfilled.

  • 00:30:00 - 00:35:00

    Attention turns to client concerns, such as worries about proxy testing and ensuring proper candidate identity verification. Client priorities vary, with some focusing on test security and others on user accessibility of the technology, emphasizing the importance of comprehensive support and communication to ease test-taker anxiety.

  • 00:35:00 - 00:40:00

    The challenges and advantages of using mobile technology in exams are explored. While mobile phones are useful for secondary surveillance, primary testing on them remains problematic due to limitations in multitasking and screen size, affecting the quality and integrity of the test-taking experience.

  • 00:40:00 - 00:48:35

    The webinar concludes with insights on the practicality of approaches based on exam stakes. They explore scenarios where mobile delivery might be viable for initial screenings but later require rigorous proctoring for top candidates. Final remarks emphasize cooperation and alignment between proctoring providers to comprehensively tackle emerging challenges in remote testing.

Show more

Mind Map

Video Q&A

  • What companies were involved in the webinar?

    The companies involved were Monitor EDU, which focuses on live proctoring, and Sumati, which provides AI-based proctoring solutions.

  • What are some methods students use to cheat in online exams?

    Students may try using impersonation, hidden notes, VPNs, or additional monitors to cheat during online exams.

  • How does Monitor EDU ensure exam integrity?

    Monitor EDU uses live human proctors and a two-camera solution to monitor the exam environment and intervene in real-time if suspicious activities are detected.

  • What is Sumati's approach to remote proctoring?

    Sumati uses AI-based proctoring with a secure browser, biometric authentication, and facial recognition to ensure exam integrity.

  • What technological challenges are associated with using mobile phones in proctoring?

    Challenges include maintaining a stable connection and ensuring adequate battery life for the mobile device throughout the exam duration.

  • What is a significant concern for educational institutions regarding remote proctoring?

    Institutions are primarily concerned with ensuring that the correct individual is taking the exam and that no unauthorized materials are used.

  • How do proctoring solutions address the privacy and security of exam data?

    Proctoring solutions comply with privacy regulations like GDPR, establish clear data retention policies, and ensure secure handling of exam data.

  • What role does AI play in Sumati's proctoring solution?

    AI is used for detecting biometrics, monitoring student behavior, and identifying unauthorized actions during exams.

  • Are there geographic limitations mentioned for proctoring services?

    Yes, challenges such as internet stability are mentioned, especially in regions like Latin America.

  • Can exams be administered entirely on mobile devices?

    Currently, mobile devices are primarily used as secondary devices for monitoring due to limitations in multitasking and lockdown capabilities.

View more video summaries

Get instant access to free YouTube video summaries powered by AI!
Subtitles
en
Auto Scroll:
  • 00:00:00
    um thank you everyone for joining this
  • 00:00:02
    webinar on remote proctoring uh how
  • 00:00:04
    examine these cheat and how to catch
  • 00:00:05
    them
  • 00:00:06
    uh so this will be a discussion from two
  • 00:00:08
    perspectives from leaders in the
  • 00:00:09
    industry
  • 00:00:10
    uh on one hand we have monitor edu who
  • 00:00:12
    focuses on live human proctoring
  • 00:00:15
    so they're the type of organization that
  • 00:00:17
    works with high stakes exams where you
  • 00:00:20
    know it might be taking like a medical
  • 00:00:21
    certification
  • 00:00:23
    and the candidate will start the
  • 00:00:26
    exam but before you do that they have to
  • 00:00:29
    actually talk to a live proctor you know
  • 00:00:31
    they got to show their id card they got
  • 00:00:33
    to pick up their camera show it around
  • 00:00:35
    the room sometimes they have to use two
  • 00:00:36
    cameras um and uh the way the moderator
  • 00:00:39
    works is that they can have the webcam
  • 00:00:41
    coming on your face like this but also
  • 00:00:42
    tell them to stream on their phone
  • 00:00:44
    and go put that phone on the table in
  • 00:00:46
    the back of the room or on a bookshelf
  • 00:00:48
    so you get a great view
  • 00:00:50
    um and on the other hand we have rolo
  • 00:00:52
    rivera from zumani um executive director
  • 00:00:54
    of samadhi and samani provides
  • 00:00:57
    highly scalable uh yet secure remote
  • 00:01:00
    proctoring services and he's going to
  • 00:01:02
    tell you about some of the things that
  • 00:01:03
    they do to catch
  • 00:01:05
    illicit activities from
  • 00:01:07
    test takers
  • 00:01:09
    so with that i'll let each of them
  • 00:01:10
    introduce themselves i'll just do an
  • 00:01:13
    introduction before we get into talking
  • 00:01:14
    about remote proctoring um let's start
  • 00:01:16
    with robes
  • 00:01:17
    hi nathan nice to meet you and uh hello
  • 00:01:19
    everybody it's a pleasure to be here and
  • 00:01:21
    have the opportunity to talk about you
  • 00:01:23
    know what we're doing in the background
  • 00:01:24
    the proctoring industry
  • 00:01:26
    so my name is rivera and i represent
  • 00:01:28
    somali which and we're focused on the ai
  • 00:01:31
    based proctoring in the industry we have
  • 00:01:34
    uh been able to serve service many
  • 00:01:36
    customers around different geographies
  • 00:01:38
    particularly focusing in latin america
  • 00:01:40
    and europe we also have some footprint
  • 00:01:42
    and some customers in the middle east
  • 00:01:44
    and south africa happy to uh talk about
  • 00:01:47
    uh our experience with you guys it's a
  • 00:01:48
    pleasure thank you
  • 00:01:51
    okay thank you patrick
  • 00:01:53
    my name is patrick ochoa ceo of monitor
  • 00:01:56
    edu i've been uh proctoring uh
  • 00:01:59
    via live proctor uh for the last five
  • 00:02:02
    years we work across uh
  • 00:02:05
    north america
  • 00:02:07
    various medical boards as well as
  • 00:02:08
    government organizations as well as as
  • 00:02:11
    the professional testing and licensure
  • 00:02:13
    so pleasure to be here and talking about
  • 00:02:15
    how we
  • 00:02:17
    catch cheating and prevention
  • 00:02:19
    thanks and don and then down i still
  • 00:02:22
    don't see your
  • 00:02:23
    video yeah uh my apologies for not being
  • 00:02:25
    on video
  • 00:02:27
    my uh
  • 00:02:28
    i'm a little uh unprepared as far as my
  • 00:02:31
    appearance goes today so you can you get
  • 00:02:33
    the black screen uh but anyways just uh
  • 00:02:36
    just to go i mean patrick and i started
  • 00:02:38
    monitor edu together so i mean my my
  • 00:02:41
    history has a long history in the
  • 00:02:42
    industry i've been in the industry
  • 00:02:44
    really since the beginning in 2008 in
  • 00:02:46
    terms of remote uh proctoring services
  • 00:02:49
    so i started proctoru
  • 00:02:51
    founded that company grew it uh through
  • 00:02:53
    about 2016. stepped away
  • 00:02:56
    uh patrick was actually with me at
  • 00:02:58
    monitor edu since about 2011. i think
  • 00:03:01
    2012. i think our 10-year anniversary is
  • 00:03:03
    coming up here in june
  • 00:03:05
    um so he he came with me in fact there
  • 00:03:07
    was a famous day that he and i were
  • 00:03:09
    working for another company
  • 00:03:11
    in the assessment industry and
  • 00:03:12
    we're having a beer at the chicago
  • 00:03:14
    airport and patrick looked at me and
  • 00:03:15
    said what are we doing our own thing
  • 00:03:16
    again and so we monitor ud was born and
  • 00:03:20
    we've been running with it and it's been
  • 00:03:21
    real fascinating to watch
  • 00:03:24
    all the different changes in remote exam
  • 00:03:26
    delivery remote proctoring um
  • 00:03:28
    you know it was a new thing 15 years ago
  • 00:03:31
    it's not so new anymore and there's been
  • 00:03:34
    it's been a real challenge to really
  • 00:03:35
    focus on the ways that students can
  • 00:03:37
    cheat or test takers can cheat
  • 00:03:40
    because they're certainly getting a lot
  • 00:03:41
    more bold and be really interesting to
  • 00:03:43
    discuss that today
  • 00:03:46
    okay excellent thank you
  • 00:03:48
    uh and then let's take a couple minutes
  • 00:03:50
    for issue to talk a little bit about
  • 00:03:51
    your solution
  • 00:03:52
    what is the approach that you take what
  • 00:03:54
    are the clients that you work with what
  • 00:03:55
    are they looking to do when they say
  • 00:03:57
    they want to catch cheaters or keep
  • 00:03:59
    examines honest
  • 00:04:01
    and what are the things that you put
  • 00:04:02
    into place uh to make sure like how do
  • 00:04:04
    you do id checking uh how do you make
  • 00:04:06
    sure that the workspace is clear how do
  • 00:04:07
    you make sure there's no not two people
  • 00:04:08
    that sort of thing
  • 00:04:10
    um let's start back with role for that
  • 00:04:13
    yeah thank you nathan so as i said at
  • 00:04:15
    the beginning you know um we are focused
  • 00:04:17
    on the ai based proctoring and we have
  • 00:04:19
    developed a tool that is very robust in
  • 00:04:21
    terms of artificial intelligence in the
  • 00:04:23
    detection of biometrics to actually
  • 00:04:26
    deter and detect if students are making
  • 00:04:29
    um or presenting suspicious behavior so
  • 00:04:32
    the deterrent mode is something that's
  • 00:04:33
    really important to us so what do we do
  • 00:04:35
    we are a secure browser an application
  • 00:04:37
    that you download into your computer and
  • 00:04:39
    uh once you download it you know we use
  • 00:04:41
    a very robust integration and we are
  • 00:04:43
    compliant with standard from the
  • 00:04:44
    industry from the ims we're using lti so
  • 00:04:47
    we integrate to different platforms
  • 00:04:49
    right around the uh um that that are
  • 00:04:51
    configured to be commercial lms or
  • 00:04:53
    testing platforms
  • 00:04:54
    and uh or we also can connect to home
  • 00:04:57
    ground systems right so we have a very
  • 00:04:59
    robust layer of integration but the way
  • 00:05:01
    in which sumati acts is an application
  • 00:05:04
    it's a cool browser that you download
  • 00:05:06
    into your computer once you start what
  • 00:05:07
    it once it's downloaded through an
  • 00:05:09
    integration you're able to enter through
  • 00:05:11
    your plan to your platform where the
  • 00:05:12
    exam is right and once you enter then
  • 00:05:15
    somebody gets activated let's say so we
  • 00:05:18
    start using biometrics particularly
  • 00:05:20
    we're very focused on identifying a
  • 00:05:22
    student um using artificial intelligence
  • 00:05:25
    before they get into the exam right so
  • 00:05:28
    we authenticate them and we have a
  • 00:05:30
    multi-factor authentication method where
  • 00:05:31
    we use
  • 00:05:33
    facial recognition typing panel
  • 00:05:34
    recognition we're about to release voice
  • 00:05:36
    recognition and we are able to combine
  • 00:05:39
    the three of them or use just one of
  • 00:05:40
    them independently also as you were
  • 00:05:42
    mentioning at the beginning as some of
  • 00:05:44
    our colleagues are using other
  • 00:05:46
    mechanisms to identify the id card we
  • 00:05:48
    are also able using artificial
  • 00:05:49
    intelligence to uh detect specific words
  • 00:05:53
    and validate the photograph of a person
  • 00:05:55
    uh in an id card that we also can use to
  • 00:05:58
    authenticate a person towards an exam
  • 00:06:00
    right once that is done
  • 00:06:02
    right the student is taken directly to
  • 00:06:04
    the exam experience and during the exam
  • 00:06:06
    experience we enable uh artificial
  • 00:06:09
    intelligence in many aspects one of them
  • 00:06:11
    obviously is the facial recognition so
  • 00:06:12
    we take photographs constantly
  • 00:06:15
    and this can be a different intervals
  • 00:06:17
    that can be configured
  • 00:06:18
    for each particular exam
  • 00:06:20
    and each photograph actually detects
  • 00:06:22
    several things because we're using um
  • 00:06:24
    object detection as well so we detect
  • 00:06:26
    the face and we validate if that student
  • 00:06:28
    is the person who's supposed to be
  • 00:06:30
    because when it comes on ways of
  • 00:06:31
    cheating and you're talking about remote
  • 00:06:33
    examinations it's very it's like common
  • 00:06:36
    sense for students to try to use
  • 00:06:38
    impersonation as a way of cheating so in
  • 00:06:39
    other words they would use another
  • 00:06:40
    person to to impersonate them to take
  • 00:06:43
    the exam so you need to validate
  • 00:06:46
    with biometrics that that person is who
  • 00:06:48
    that person is supposed to be right but
  • 00:06:50
    also the what what we're doing with the
  • 00:06:52
    camera the frontal camera is that we're
  • 00:06:54
    validating the environment we're
  • 00:06:56
    validating if there's another person
  • 00:06:58
    behind them we're validating if they're
  • 00:06:59
    objects that aren't supposed to be you
  • 00:07:01
    can classify those objects like for
  • 00:07:03
    instance if a student is not supposed to
  • 00:07:05
    have a book or supposed to have a
  • 00:07:08
    phone or a notepad sorry an ipad sorry
  • 00:07:11
    that is detected that is flagged so that
  • 00:07:13
    is also something that we are um using
  • 00:07:16
    nowadays now we are also about to
  • 00:07:18
    release what you just meant to mention
  • 00:07:19
    nathan her colleague patrick and his
  • 00:07:21
    team are using which is a second camera
  • 00:07:23
    so we're basically right now just about
  • 00:07:26
    to release a second camera using your
  • 00:07:28
    phone through a session actually that
  • 00:07:30
    integrates with a qr code into your um
  • 00:07:33
    desktop application what this does is
  • 00:07:35
    that we also use uh photographs to do um
  • 00:07:40
    inferencing and detect objects and it
  • 00:07:42
    and basically supervise the entire
  • 00:07:44
    environment during the examination we've
  • 00:07:47
    realized we've seen that students are
  • 00:07:48
    very creative when it comes to online
  • 00:07:50
    and online education and remote
  • 00:07:52
    examinations right so
  • 00:07:54
    um having a tool that could actually
  • 00:07:56
    help to see the environment constantly
  • 00:07:58
    during the examination is also very
  • 00:08:00
    valid in additional to that you know
  • 00:08:02
    there are some other tricks that
  • 00:08:03
    students might want to use when it when
  • 00:08:04
    it comes to cheating and
  • 00:08:06
    so for instance they might want to open
  • 00:08:08
    another application and they want to
  • 00:08:10
    probably go to the internet and browse
  • 00:08:12
    for a particular topic and get the get
  • 00:08:15
    you know basically to a copy paste so
  • 00:08:16
    what we do with somebody as it is a
  • 00:08:18
    lockdown browser
  • 00:08:20
    as well we block other applications but
  • 00:08:22
    this is also selective right so an
  • 00:08:24
    institution can decide which
  • 00:08:25
    applications are to be open or are
  • 00:08:28
    authorized to be open during
  • 00:08:29
    examinations and which ones are not
  • 00:08:31
    right so this is also something very
  • 00:08:32
    configurable and um
  • 00:08:35
    if there's an an intention or actually
  • 00:08:37
    an action of opening an application then
  • 00:08:39
    somali would flag that and stop that so
  • 00:08:42
    we automatically are collecting data as
  • 00:08:45
    uh in real time from what's going on in
  • 00:08:48
    each particular exam and we're feeding
  • 00:08:49
    that information immediately to the
  • 00:08:51
    cloud right so we are a sas solution and
  • 00:08:54
    we're very scalable we've been able to
  • 00:08:56
    actually um supervise more than uh 40
  • 00:08:59
    000 exams a day during a weekend
  • 00:09:02
    of four hours directly so we are you're
  • 00:09:05
    basically leveraging the capacity of our
  • 00:09:07
    infrastructure
  • 00:09:08
    that sits on top of aws
  • 00:09:10
    and that information as i said it's a
  • 00:09:12
    lot of information that gets processed
  • 00:09:14
    organized and then put into reports on
  • 00:09:16
    the cloud that a supervisor or an
  • 00:09:19
    authorized person can actually go into
  • 00:09:21
    and look in real time and see how that
  • 00:09:23
    those students are behaving during an
  • 00:09:25
    examination that uh natives in general
  • 00:09:28
    terms how we operate
  • 00:09:31
    thank you rule that's a great summary of
  • 00:09:33
    how
  • 00:09:34
    your clients
  • 00:09:35
    uh anticipate uh the students
  • 00:09:37
    misbehaving and uh procedures and
  • 00:09:39
    software you put in place to deter it
  • 00:09:41
    uh patrick or don what do you wanna talk
  • 00:09:44
    a little bit about uh moderate e
  • 00:09:45
    solution and uh how you tackle those
  • 00:09:47
    similar tissue similar problems yeah
  • 00:09:50
    sure so with us we use a different
  • 00:09:52
    approach with the live proctors as well
  • 00:09:55
    as we utilize a two-camera solution so
  • 00:09:58
    normally we'll use the candidates webcam
  • 00:10:00
    as well as a secondary device primarily
  • 00:10:02
    it's the mobile phone but it could be an
  • 00:10:04
    ipad it could be a second computer with
  • 00:10:06
    a webcam
  • 00:10:07
    but that second device gives us the
  • 00:10:10
    ability to fully see the testing
  • 00:10:13
    environment we're able to look under the
  • 00:10:14
    desk make sure the cabinet's not pulling
  • 00:10:16
    out any any resources that they're not
  • 00:10:19
    supposed to we're able to see if they
  • 00:10:20
    get up from the works base if they're
  • 00:10:22
    supposed to are not supposed to
  • 00:10:24
    permit view the area for
  • 00:10:26
    unscheduled breaks
  • 00:10:28
    what have not and then we also work with
  • 00:10:31
    the assessment company to provide to
  • 00:10:34
    work with them on a lockdown browser so
  • 00:10:37
    we have the actual testing device that
  • 00:10:39
    is secured during the exam so our
  • 00:10:41
    proctors just need to focus on the
  • 00:10:44
    physical advice for some of our clients
  • 00:10:46
    that don't use a lockdown browser or
  • 00:10:47
    secure browser we just use screen
  • 00:10:49
    sharing technology to view the candid
  • 00:10:52
    screen in real time and if we need to
  • 00:10:55
    intervene the proctors that's great
  • 00:10:57
    thing about having a live person there
  • 00:10:59
    they can interact on the spots stop the
  • 00:11:01
    action from occurring
  • 00:11:03
    depending on the rules of the
  • 00:11:04
    institution some will let you just
  • 00:11:06
    document the incident and continue
  • 00:11:08
    others will have you shut down the exam
  • 00:11:10
    or suspended until
  • 00:11:12
    the client
  • 00:11:14
    makes a decision from there
  • 00:11:16
    so basically it's a little bit of
  • 00:11:18
    different approach than my colleague
  • 00:11:20
    role here but um the live proctor way is
  • 00:11:22
    our way don do you have anything else to
  • 00:11:24
    add yeah yeah i mean the the key really
  • 00:11:26
    we're designed more for
  • 00:11:28
    higher stakes assessments
  • 00:11:30
    you know where
  • 00:11:31
    you know there's a couple of different
  • 00:11:32
    elements one is starting with that it's
  • 00:11:34
    a high stress environment so having that
  • 00:11:36
    human element you know having somebody
  • 00:11:38
    there a proctor to
  • 00:11:40
    to guide the the candidate through to
  • 00:11:42
    make sure everything's set up properly
  • 00:11:43
    to assure a hundred percent that they're
  • 00:11:46
    meeting all of the requirements within
  • 00:11:48
    the room and the environment you know
  • 00:11:49
    ahead of time i mean we're going through
  • 00:11:51
    and talked a little bit about id you
  • 00:11:53
    know we're going through the id checks
  • 00:11:55
    we've got things recorded on videos we
  • 00:11:57
    work with our partners in terms of
  • 00:12:00
    making sure that there are unique
  • 00:12:01
    credentials for each candidate you know
  • 00:12:03
    we've got the permanent record so if
  • 00:12:05
    there's anything after the fact
  • 00:12:07
    to address a proxy tester we can address
  • 00:12:09
    that
  • 00:12:10
    but the key really is once you get them
  • 00:12:12
    into the test
  • 00:12:14
    um it's that ability to intervene and
  • 00:12:16
    stop things when it's when it's
  • 00:12:18
    happening so or to question things when
  • 00:12:20
    they're happening you know so something
  • 00:12:22
    appears odd the proctor notices the
  • 00:12:24
    behavior that shouldn't be there
  • 00:12:26
    you know they can they can intervene
  • 00:12:27
    into that assessment uh with our
  • 00:12:30
    partners we can stop the assessment so
  • 00:12:31
    with assessment systems we're we're
  • 00:12:33
    linked up to you guys you know on slap a
  • 00:12:36
    slack channel throughout the entire
  • 00:12:38
    assessment if there's ever an issue you
  • 00:12:39
    know we can pause it we can investigate
  • 00:12:42
    uh we can talk to the client to get
  • 00:12:44
    their determination on what we need to
  • 00:12:46
    do
  • 00:12:47
    um and then we can proceed forward so it
  • 00:12:49
    that communication that we've all got
  • 00:12:51
    it's not just a single proctor who's
  • 00:12:53
    watching a candidate it's it's a whole
  • 00:12:55
    organization that's that's focused on
  • 00:12:57
    that candidate and all the all the
  • 00:12:59
    candidates to make sure that the
  • 00:13:01
    assessment at the end of the day is
  • 00:13:02
    reliable and fair and that we know that
  • 00:13:04
    everybody followed the same set of rules
  • 00:13:06
    and so um it's it's it's dynamic in that
  • 00:13:10
    sense um
  • 00:13:11
    but yeah it's it's really designed for
  • 00:13:13
    higher stakes i'd say probably 80 to 90
  • 00:13:15
    percent of our our clientele or outside
  • 00:13:17
    higher education so
  • 00:13:20
    thank you don
  • 00:13:21
    yeah i think that provides a great
  • 00:13:23
    comparison of the the two approaches
  • 00:13:25
    here uh you know there's certainly
  • 00:13:26
    discussion going on uh within the field
  • 00:13:28
    of ai versus live proctoring which is
  • 00:13:30
    the best but i think there's absolutely
  • 00:13:32
    a room and situations for both of them
  • 00:13:35
    you know i do work with don and patrick
  • 00:13:38
    on
  • 00:13:38
    high stakes medical certifications or
  • 00:13:40
    financial certifications things like
  • 00:13:41
    that where they might have you know
  • 00:13:44
    100 people take an exam twice a year on
  • 00:13:46
    a saturday morning or something like
  • 00:13:48
    that and it's perfectly feasible to use
  • 00:13:51
    live property in those cases and of
  • 00:13:52
    course the candidates because
  • 00:13:53
    certification them
  • 00:13:55
    they might be paying four hundred
  • 00:13:56
    dollars per exam
  • 00:13:58
    in which case spending thirty forty
  • 00:14:00
    dollars whatever it ends up being for
  • 00:14:02
    proctoring uh is not a problem that's
  • 00:14:04
    still less than 10 to the cost of the
  • 00:14:06
    exam
  • 00:14:07
    on the other hand if you're working with
  • 00:14:09
    let's say civil service exams and you've
  • 00:14:11
    got a government with limited budget and
  • 00:14:13
    they've got continually people applying
  • 00:14:15
    to take jobs and you know that's they've
  • 00:14:16
    got 5000 people coming in per week
  • 00:14:19
    that's just not feasible to work with
  • 00:14:21
    live property in that case um and
  • 00:14:23
    there's a different type of solution
  • 00:14:24
    that's needed in those cases and that's
  • 00:14:26
    where tsumati is excellent fit
  • 00:14:29
    totally agree nate
  • 00:14:31
    thank you
  • 00:14:33
    um
  • 00:14:34
    so let's talk a little bit about the
  • 00:14:36
    theme of the the webinar you know how
  • 00:14:38
    students cheat and how to catch them uh
  • 00:14:40
    we talked a little bit about
  • 00:14:41
    uh the the how to catch the piece in
  • 00:14:44
    terms of the deterrence that you have in
  • 00:14:45
    the place uh the software that's in
  • 00:14:47
    place the procedures um let's talk a
  • 00:14:49
    little bit about specifics uh you know
  • 00:14:51
    do you have any stories about
  • 00:14:54
    let's start with the the cheating side
  • 00:14:56
    and then we'll come in talking about
  • 00:14:57
    deterrence and uh policies
  • 00:14:59
    um
  • 00:15:00
    uh do you have any specific uh stories
  • 00:15:02
    from your clients about how candidates
  • 00:15:04
    have cheated and what you know what are
  • 00:15:06
    certain things that would be useful into
  • 00:15:08
    catching uh those types of situations
  • 00:15:11
    i got a couple of really interesting
  • 00:15:13
    stories to share nate um you know just
  • 00:15:15
    one thing i can say and this is
  • 00:15:18
    all the colleagues i've talked to in the
  • 00:15:19
    industry we've all been talking about
  • 00:15:21
    the fact that online cheating online
  • 00:15:23
    exams has gone up significantly in the
  • 00:15:25
    last couple of years
  • 00:15:27
    and you know one of there's lots of
  • 00:15:29
    reasons for that we can get into that
  • 00:15:30
    when we a little bit later in the
  • 00:15:32
    webinar but just in terms of stories
  • 00:15:33
    that my two favorite stories uh which
  • 00:15:36
    both happened the last three or four
  • 00:15:37
    months
  • 00:15:38
    uh one of the the candidates that we had
  • 00:15:41
    um he was able to figure out a way
  • 00:15:43
    around some of the technology and he was
  • 00:15:45
    vpn
  • 00:15:46
    and somebody else was actually taking
  • 00:15:48
    the exam on screen and so the proctor
  • 00:15:51
    you know a lot of what we do is based on
  • 00:15:52
    visual you know observation looking at
  • 00:15:55
    behavior um but this guy got you know
  • 00:15:58
    because in order to pull that off you've
  • 00:16:00
    got to be able to
  • 00:16:01
    you know we're watching the screen we're
  • 00:16:03
    screen sharing we're seeing the the
  • 00:16:04
    mouse move we're seeing them go question
  • 00:16:06
    question but you're also watching the
  • 00:16:08
    candidate and the actions weren't
  • 00:16:10
    syncing up and so the proctor started
  • 00:16:11
    really paying attention and what really
  • 00:16:13
    gave it away is at some point he picked
  • 00:16:14
    up a bag of potato chips started eating
  • 00:16:16
    them
  • 00:16:17
    and the test was moving forward and so
  • 00:16:20
    that was that was easy we couldn't what
  • 00:16:22
    we realized is you know that there are
  • 00:16:24
    people especially with these higher
  • 00:16:25
    stakes assessments are going to try to
  • 00:16:27
    figure out ways around the technology
  • 00:16:29
    and so ultimately we have to make sure
  • 00:16:30
    that we're we're also providing that
  • 00:16:32
    good observation to sync those things up
  • 00:16:34
    and it's a challenge for someone to pull
  • 00:16:36
    that off over a three hour exam because
  • 00:16:38
    they have to they have to sync up all
  • 00:16:40
    their actions and he wasn't able to do
  • 00:16:41
    it he actually wasn't too smart because
  • 00:16:43
    you shouldn't be eating potato chips uh
  • 00:16:45
    while you're your thing's moving
  • 00:16:47
    um
  • 00:16:48
    so the second story and this is going to
  • 00:16:50
    be
  • 00:16:51
    related to materials later is
  • 00:16:54
    or rules later we had we have a
  • 00:16:56
    a partner where they allow a significant
  • 00:16:58
    amount of resources to come in reference
  • 00:17:00
    materials and things of that nature
  • 00:17:02
    there's a big difference between the
  • 00:17:03
    test center and remote in a test center
  • 00:17:05
    you know you can physically look through
  • 00:17:07
    all of these you can you can require
  • 00:17:09
    that people leave things behind there's
  • 00:17:10
    lots of things you can do to really
  • 00:17:12
    control materials but in a remote
  • 00:17:13
    environment it's very difficult to do
  • 00:17:15
    that
  • 00:17:16
    you know we can see that they're using
  • 00:17:17
    those materials
  • 00:17:19
    anyways this particular guy
  • 00:17:21
    had uh had gotten uh hold of an answer
  • 00:17:23
    sheet and so he had stuck it in between
  • 00:17:25
    one of his pages and the proctor was
  • 00:17:28
    watching pretty closely as he was going
  • 00:17:30
    through materials and she noticed that
  • 00:17:32
    you know even though he had like six or
  • 00:17:33
    seven workbooks he was only referring to
  • 00:17:35
    one workbook and he was basically trying
  • 00:17:37
    to hide it every time
  • 00:17:38
    um he went in and looking the one page
  • 00:17:40
    and so she stopped him and said i need
  • 00:17:42
    to see that and so he played a game with
  • 00:17:44
    her he showed her all the other ones
  • 00:17:46
    because she goes no no i want to see the
  • 00:17:47
    one that you were looking at and then he
  • 00:17:49
    kind of fumbled around with it and then
  • 00:17:51
    threw it off the desk
  • 00:17:53
    and then then at that point it was out
  • 00:17:54
    of view and he went over and grabbed it
  • 00:17:56
    off the floor came back said see i've
  • 00:17:57
    got nothing in there well we obviously
  • 00:18:00
    we had enough evidence to to ascertain
  • 00:18:02
    so
  • 00:18:03
    really both those cases was was you know
  • 00:18:06
    technology allows us to see all of those
  • 00:18:08
    different things but ultimately was that
  • 00:18:09
    proctor observing behavior just like you
  • 00:18:12
    would in a test center that identified
  • 00:18:14
    that that somebody was doing something
  • 00:18:16
    so those are two really interesting
  • 00:18:17
    stories that we've had recently
  • 00:18:21
    okay excellent thank you
  • 00:18:23
    uh raul do you have any uh specific
  • 00:18:25
    examples of uh things that candidates
  • 00:18:27
    have done with your exam
  • 00:18:29
    yeah it's very funny right um you know
  • 00:18:31
    it's sometimes you know the students get
  • 00:18:33
    very creative when it comes to cheating
  • 00:18:35
    right you know i think what happened in
  • 00:18:36
    a face-to-face environment uh
  • 00:18:39
    you know it also happens in remote exam
  • 00:18:41
    and remote environments right and i
  • 00:18:43
    think that they even get more creative
  • 00:18:44
    we had one opportunity when we
  • 00:18:46
    saw that a student was actually
  • 00:18:48
    continuously looking up
  • 00:18:50
    uh to the roof apparently for no reason
  • 00:18:52
    while he was taking the examination
  • 00:18:54
    right it turned out that he actually had
  • 00:18:56
    created like an answer sheet that he had
  • 00:18:57
    pasted on the roof this is this is true
  • 00:19:00
    and he was actually taking a look at
  • 00:19:02
    a several amount of uh answer sheets on
  • 00:19:04
    the roof
  • 00:19:05
    paste it and you know
  • 00:19:06
    what what's interesting about artificial
  • 00:19:08
    intelligence and how it has a lot these
  • 00:19:10
    days is that it actually can
  • 00:19:12
    particularly detect behaviors right you
  • 00:19:14
    know it can detect that i'm so um
  • 00:19:16
    biometrically detect my identity and
  • 00:19:18
    validate my identity but also it would
  • 00:19:21
    allow us right now nowadays to
  • 00:19:22
    understand if or ask the question why is
  • 00:19:24
    this person constantly changing the
  • 00:19:27
    the way the the direction of their
  • 00:19:29
    eyesight or where his head is actually
  • 00:19:31
    pointing right so we can detect that and
  • 00:19:34
    the other thing yes
  • 00:19:35
    i'm looking at comments over there from
  • 00:19:37
    catalina yes it's sometimes they're very
  • 00:19:39
    creative and that is where you know the
  • 00:19:41
    second camera really comes and it comes
  • 00:19:43
    in very handy because
  • 00:19:45
    you know once you are able to position
  • 00:19:47
    it in a very strategic location of the
  • 00:19:49
    room it can actually detect anything and
  • 00:19:51
    everything in that room right and um you
  • 00:19:54
    know still we have some challenges the
  • 00:19:56
    other thing that we we came across was
  • 00:19:58
    that uh they found the way to actually
  • 00:20:01
    plug in a second monitor to their camera
  • 00:20:04
    and this was way back uh a couple of
  • 00:20:06
    years ago so they actually plugged in an
  • 00:20:09
    additional monitor to the computer and
  • 00:20:12
    um at that point in time we were just
  • 00:20:14
    blocking applications but we were not
  • 00:20:17
    really addressing you know the
  • 00:20:18
    peripherals in a very strict manner so
  • 00:20:20
    what this person did is that with the
  • 00:20:22
    second camera basic second monitor sorry
  • 00:20:24
    they actually pre-loaded all the an
  • 00:20:26
    answer cheat on the second monitor
  • 00:20:29
    and they were actually reading those
  • 00:20:30
    answers in the examination so nowadays
  • 00:20:33
    what we've had to do is that we since
  • 00:20:35
    we're able to go to the operating system
  • 00:20:37
    itself we're able to block peripherals
  • 00:20:39
    and we're monitoring even the traffic
  • 00:20:41
    that comes uh through the network right
  • 00:20:43
    so those are two very interesting
  • 00:20:45
    creative ways in which they um some of
  • 00:20:47
    our students have uh found ways to to to
  • 00:20:50
    actually do some cheating um
  • 00:20:54
    we're doing a lot of work in terms of
  • 00:20:55
    you know really become getting our our
  • 00:20:59
    operating system capabilities um robust
  • 00:21:02
    enough for us to track all the behavior
  • 00:21:04
    right um but this is something that is
  • 00:21:06
    always going to be a challenge to and
  • 00:21:08
    one last example nate is that uh
  • 00:21:10
    students are using or started to use
  • 00:21:12
    virtual computers or virtual machines
  • 00:21:15
    for those of you who don't know what
  • 00:21:16
    that is basically they are able to just
  • 00:21:19
    click on an icon and it opens another
  • 00:21:21
    sort of computer inside of your
  • 00:21:22
    operating system
  • 00:21:24
    right so normally we didn't see that as
  • 00:21:26
    an application that needed to be blocked
  • 00:21:28
    so
  • 00:21:29
    with that they actually connected to
  • 00:21:31
    other networks and they were able to
  • 00:21:33
    serve to bypass some of the operating
  • 00:21:36
    system restrictions right so we've had
  • 00:21:37
    to do a lot of work in terms of our our
  • 00:21:40
    browser to really go into the operating
  • 00:21:42
    system and detect everything that is
  • 00:21:43
    going on behind nowadays students are
  • 00:21:45
    very tech savvy right so um it's not
  • 00:21:49
    only for engineers many people in
  • 00:21:50
    different uh from different faculties
  • 00:21:52
    and different uh education uh streams
  • 00:21:55
    are very
  • 00:21:56
    capable of actually understanding how a
  • 00:21:58
    computer works so
  • 00:22:00
    our uh secure browser really focused on
  • 00:22:03
    the most technical details that we can
  • 00:22:05
    think of because students are very
  • 00:22:06
    creative so those are three examples
  • 00:22:08
    nathan that come to mind that we've been
  • 00:22:10
    able to detect and we have addressed
  • 00:22:12
    through our solution
  • 00:22:14
    okay thank you roll
  • 00:22:16
    uh we have our question in the comments
  • 00:22:17
    is it possible to use a vpn uh with a
  • 00:22:19
    lockdown browser
  • 00:22:21
    uh
  • 00:22:22
    and i can say that i think it depends
  • 00:22:24
    upon like on browser uh so my platform
  • 00:22:27
    uses uh respondus
  • 00:22:29
    uh white labeled version of the
  • 00:22:31
    respondus lockdown browser and there's
  • 00:22:33
    actually an option when you publish an
  • 00:22:34
    examiner platform do you want to allow
  • 00:22:37
    virtual machines or not
  • 00:22:39
    i think the vpn is probably something
  • 00:22:41
    that's uh probably can't be controlled
  • 00:22:43
    but i'm not technical enough to respond
  • 00:22:45
    to that rule would you have a response
  • 00:22:47
    on that for yours
  • 00:22:48
    there are many ways in which a vpn can
  • 00:22:50
    be enabled in a computer right so one of
  • 00:22:52
    them is actually using an application
  • 00:22:53
    right like for instance i have in my
  • 00:22:54
    computer vpn express which is the
  • 00:22:56
    application that i used to
  • 00:22:58
    to connect to vpn we could also use
  • 00:23:00
    other more commercial and more robust
  • 00:23:02
    solutions like cisco for instance so
  • 00:23:04
    what we're doing again is that we are
  • 00:23:06
    going behind the scenes we're going
  • 00:23:08
    through the operating system and we're
  • 00:23:10
    detecting all these applications that
  • 00:23:12
    are that are operating behind and what
  • 00:23:14
    somali is doing is that it's blocking
  • 00:23:16
    them so application blocking is really
  • 00:23:17
    important when it comes to lockdown
  • 00:23:19
    browser so our lockdown browser really
  • 00:23:21
    has this robust feature of blocking
  • 00:23:23
    applications um detecting those
  • 00:23:25
    applications before the exam is actually
  • 00:23:27
    activated and if those applications are
  • 00:23:30
    running behind the scenes somali won't
  • 00:23:32
    give access to the exam right until
  • 00:23:34
    those applications are brought um are
  • 00:23:37
    actually turned off or closed and also
  • 00:23:40
    if they try to open them to mighty has
  • 00:23:42
    like this thing again we're going to the
  • 00:23:43
    operating system so we actually um
  • 00:23:46
    are able to detect if they want to open
  • 00:23:48
    them once they are in the examination as
  • 00:23:50
    well
  • 00:23:52
    okay
  • 00:23:53
    so catalina's question is it doesn't
  • 00:23:55
    detect it unless you specify which
  • 00:23:57
    application to look for and yes i think
  • 00:23:59
    you're right is that we can't look for
  • 00:24:01
    where the web traffic is coming from and
  • 00:24:03
    block it but we can scan the computer to
  • 00:24:05
    see what applications are running which
  • 00:24:06
    could be nordvpn or many of the other
  • 00:24:08
    common ones that are out there right
  • 00:24:09
    rule
  • 00:24:10
    that is correct and that's the second
  • 00:24:12
    phase you know really monitoring the
  • 00:24:14
    traffic is something that we have had on
  • 00:24:16
    the back of our heads right now but
  • 00:24:18
    still we have not been able to come up
  • 00:24:19
    or develop a feature we're still
  • 00:24:21
    thinking through it to understand really
  • 00:24:23
    you know because again we don't want to
  • 00:24:25
    create an overhead for the cpu of a
  • 00:24:28
    computer of a local computer right so we
  • 00:24:30
    wanted we want to keep it as lean as
  • 00:24:32
    possible in terms of processing our
  • 00:24:34
    resources
  • 00:24:35
    so we're really assessing uh what we
  • 00:24:37
    want to detect in terms of traffic but
  • 00:24:38
    it's something that has been on the back
  • 00:24:40
    of our heads it could be a second phase
  • 00:24:41
    of our solution
  • 00:24:44
    yeah and then nate and there and the the
  • 00:24:46
    vpn thing is is interesting too because
  • 00:24:48
    there are there are situations where
  • 00:24:51
    that's the way that the candidate has to
  • 00:24:53
    connect so there are countries that
  • 00:24:55
    candidates test in uh china comes to
  • 00:24:57
    mind where
  • 00:24:59
    the with the internet restrictions
  • 00:25:00
    sometimes the only way that they can
  • 00:25:02
    access the assessment and different
  • 00:25:04
    tools and the proctoring tools is to run
  • 00:25:05
    through a vpn
  • 00:25:07
    so for us the the real key and and the
  • 00:25:09
    other piece of that too is the the more
  • 00:25:12
    known a technology is you know the more
  • 00:25:15
    that people try to break that technology
  • 00:25:17
    as well
  • 00:25:18
    um so you've got two different things
  • 00:25:20
    going one is that there's a need for
  • 00:25:23
    vpns in certain situations the second
  • 00:25:24
    one is that these technologies that are
  • 00:25:26
    well known um are constantly under
  • 00:25:28
    attack with people trying to figure out
  • 00:25:30
    how to beat them
  • 00:25:31
    so what's important is to be able to
  • 00:25:33
    identify
  • 00:25:34
    when somebody's running through a vpn so
  • 00:25:36
    you can take a look at the traffic you
  • 00:25:37
    can take a look at at the ip addresses
  • 00:25:41
    when they're coming in so for example
  • 00:25:42
    you might have a candidate who's in
  • 00:25:44
    china and they pop up with a us-based ip
  • 00:25:46
    address okay clearly they're they're bpa
  • 00:25:49
    they're using a vpn service
  • 00:25:51
    in order to access it
  • 00:25:52
    so it then becomes adding layers of
  • 00:25:54
    protocols to that on how you deal with
  • 00:25:56
    that situation and so it's it's like
  • 00:26:00
    most things it's not one single thing
  • 00:26:02
    that's gonna allow you to try to catch
  • 00:26:04
    prevent and deter
  • 00:26:05
    it's really trying to put those pieces
  • 00:26:07
    together and really making sure you're
  • 00:26:08
    meeting the needs of those testers and
  • 00:26:11
    and as well mentioned i mean people are
  • 00:26:13
    getting smarter so for for us in the
  • 00:26:15
    industry it's constantly trying to
  • 00:26:17
    identify where there are holes and and
  • 00:26:20
    every time we plug a hole we know
  • 00:26:22
    someone's going to try to find a new
  • 00:26:23
    hole so then we got to go plug it
  • 00:26:25
    um so it's it's a number of things that
  • 00:26:27
    we constantly have to look at and
  • 00:26:28
    constantly share so like we have a good
  • 00:26:30
    relationship with somebody we share
  • 00:26:32
    information with each other and we talk
  • 00:26:34
    about things that we all experience we
  • 00:26:35
    have that same relationship with other
  • 00:26:36
    people in the industry um so that we can
  • 00:26:39
    constantly stay ahead of it just like in
  • 00:26:41
    test centers people figured out ways to
  • 00:26:43
    come into a test center and cheat and so
  • 00:26:45
    the test centers had to change their
  • 00:26:46
    protocols and things that they did
  • 00:26:48
    so we're facing the same thing and we're
  • 00:26:50
    trying to balance the needs of the test
  • 00:26:52
    taker and delivering that exam with the
  • 00:26:54
    security so we can assure that that
  • 00:26:56
    again the security is covered at the end
  • 00:27:01
    excellent thank you
  • 00:27:05
    see um
  • 00:27:07
    since we're talking a little about a lot
  • 00:27:08
    about security here uh one of the key uh
  • 00:27:11
    issues within remote proctoring is
  • 00:27:13
    privacy
  • 00:27:14
    um what are your thoughts on balancing
  • 00:27:16
    uh privacy with some of the needs for
  • 00:27:20
    security here because we've got our
  • 00:27:21
    client saying you know we need to track
  • 00:27:23
    everything we need to get pictures of
  • 00:27:24
    their faces we need to get pictures of
  • 00:27:26
    id cards uh we need to make sure we have
  • 00:27:28
    their you know let's say government id
  • 00:27:30
    number there's so many aspects that
  • 00:27:32
    might go into this how do you balance
  • 00:27:33
    that with uh considerations for privacy
  • 00:27:38
    yeah i'd say it depends on two factors
  • 00:27:41
    one the
  • 00:27:42
    the needs of the clients and then the
  • 00:27:45
    the level of the assessments if it's say
  • 00:27:49
    maybe an entry-level assessment in my
  • 00:27:51
    opinion you don't need to track down
  • 00:27:53
    that heavy
  • 00:27:55
    personal type of
  • 00:27:57
    data especially from the proctor side
  • 00:27:59
    having them collected i think the
  • 00:28:01
    assessment tool is better suited for
  • 00:28:04
    for tracking that information and it
  • 00:28:06
    could be done either pre-assessment or
  • 00:28:09
    post-assessment as well and that would
  • 00:28:11
    allow the information if the client
  • 00:28:13
    truly needs it to be stored within
  • 00:28:16
    one system
  • 00:28:18
    in terms of
  • 00:28:20
    recordings and
  • 00:28:22
    tracking ids
  • 00:28:25
    authorization letters for testing it's
  • 00:28:27
    all
  • 00:28:28
    what policies do you set in place uh
  • 00:28:30
    what's your video retention so for us
  • 00:28:32
    our standard is a 30-day retention for
  • 00:28:35
    videos unless the client
  • 00:28:37
    asks for a longer storage
  • 00:28:41
    i i think it's i think patrick hit the
  • 00:28:44
    nail on the head which it it's dependent
  • 00:28:45
    upon the stakes and the requirements on
  • 00:28:48
    that what you what's appropriate to
  • 00:28:50
    collect and store and then the other
  • 00:28:52
    piece of it comes down to
  • 00:28:53
    to compliance and communication so you
  • 00:28:56
    know compliance and understanding the
  • 00:28:58
    different privacy laws within the
  • 00:28:59
    different states in the us within the
  • 00:29:01
    different countries in the world within
  • 00:29:03
    the eu
  • 00:29:04
    uh making sure you're respecting that
  • 00:29:06
    candidate privacy making sure they
  • 00:29:08
    understand
  • 00:29:09
    uh what it is that you're collecting
  • 00:29:10
    giving them the opportunity uh to be
  • 00:29:12
    forgotten uh when you when the purpose
  • 00:29:15
    for having that data
  • 00:29:17
    no longer exists and then working
  • 00:29:18
    closely with the
  • 00:29:19
    with the the client um because
  • 00:29:21
    ultimately you know our view is the
  • 00:29:23
    client owns that data
  • 00:29:25
    and we would like to make sure that
  • 00:29:27
    we've got very short retention policies
  • 00:29:29
    that we provided them the data when they
  • 00:29:31
    need it and at that point you know we
  • 00:29:33
    step out we shouldn't store that data
  • 00:29:35
    anymore once it's been turned over
  • 00:29:37
    over to the client because at that point
  • 00:29:39
    we don't have any purpose to store it
  • 00:29:41
    so it's again it's really it's
  • 00:29:42
    understanding what's required what's
  • 00:29:44
    appropriate
  • 00:29:45
    making sure you're in compliance and
  • 00:29:47
    then just really having good
  • 00:29:48
    communication with the client and the
  • 00:29:50
    candidate
  • 00:29:52
    yeah
  • 00:29:53
    first of all i mean i'm 100 in agreement
  • 00:29:55
    with don and patrick i mean um it's it's
  • 00:29:57
    the right balance understanding really
  • 00:29:59
    what the needs the the customer has but
  • 00:30:01
    also compliancy with you know
  • 00:30:02
    international uh policies right like for
  • 00:30:05
    instance what we're doing on our side is
  • 00:30:06
    that we're getting certified in gdpr
  • 00:30:08
    which is the i would i would consider it
  • 00:30:10
    one of the most robust data protection
  • 00:30:12
    policies that's just around the world
  • 00:30:13
    basically or mostly it's focused in
  • 00:30:15
    europe but it's the baseline for other
  • 00:30:17
    data protection policies and other
  • 00:30:19
    geographies right and you know
  • 00:30:20
    understanding how to be compliant there
  • 00:30:22
    it's you know gives you
  • 00:30:24
    the proper knowledge to see to
  • 00:30:26
    to to know what to do from a security
  • 00:30:28
    and technology perspective with the tool
  • 00:30:30
    right so we um and again we for for us
  • 00:30:33
    to be able to enter to europe we had to
  • 00:30:35
    actually uh be compliant with gdpr and
  • 00:30:38
    on top of that we're putting a lot of
  • 00:30:39
    security measures on the peri on the
  • 00:30:41
    perimeter perimeter of our uh of our
  • 00:30:43
    tool particularly in the cloud right so
  • 00:30:47
    we are complying with those standards
  • 00:30:48
    but also we have to understand from each
  • 00:30:51
    customer what the work what their data
  • 00:30:53
    retention policy is and based on that we
  • 00:30:55
    also establish processes so it's not
  • 00:30:57
    only the technology but also uh aligning
  • 00:31:00
    with the needs of the customer for some
  • 00:31:02
    customers
  • 00:31:03
    they want us to keep the data for at
  • 00:31:05
    least six months or a year but for
  • 00:31:07
    others you know they just want us to
  • 00:31:08
    keep the data stored in our
  • 00:31:09
    infrastructure for only a month or a
  • 00:31:11
    week right uh and they actually uh
  • 00:31:14
    request evidence that we are actually um
  • 00:31:16
    erasing the data from our infrastructure
  • 00:31:18
    once the exams have been taken right so
  • 00:31:20
    it depends on the customer so it's you
  • 00:31:22
    have to have the proper balance of being
  • 00:31:24
    compliant with security policies and
  • 00:31:26
    data protection policies and also align
  • 00:31:28
    with your customer on an operational
  • 00:31:30
    perspective to understand what they
  • 00:31:32
    expect from uh from data retention right
  • 00:31:35
    so
  • 00:31:35
    uh it's that perfect balance and on top
  • 00:31:37
    of that what we're doing is that we're
  • 00:31:38
    also you know being very constantly you
  • 00:31:41
    know assessing you know uh technical
  • 00:31:44
    um security issues and threats that are
  • 00:31:46
    coming out every every single time right
  • 00:31:48
    so we constantly have our security teams
  • 00:31:51
    you know assessing uh the
  • 00:31:52
    vulnerabilities that our infrastructure
  • 00:31:54
    has and again you know we live in a
  • 00:31:56
    cyber world these days right so there's
  • 00:31:58
    a lot of people hackers who are
  • 00:31:59
    constantly trying to you know penetrate
  • 00:32:02
    into your into infrastructure from
  • 00:32:03
    different um
  • 00:32:05
    solutions right and being in the
  • 00:32:07
    proctoring industry um you know we are
  • 00:32:10
    we are solutions that are actually
  • 00:32:12
    concentrating a lot of private data so
  • 00:32:14
    we are a target for these uh for these
  • 00:32:17
    people around the world so we constantly
  • 00:32:19
    have to be assessing that and we are
  • 00:32:21
    constantly you know uh implementing new
  • 00:32:23
    security measures and working directly
  • 00:32:25
    with external ethical hackers and we are
  • 00:32:27
    um you know creating new solutions on
  • 00:32:30
    top of our infrastructure to make it as
  • 00:32:32
    robust as possible and not dated as
  • 00:32:34
    possible as we move forward
  • 00:32:37
    okay thank you rule
  • 00:32:39
    um let's take a step back and uh think
  • 00:32:42
    about it from the client perspective
  • 00:32:43
    whether it's a university or a
  • 00:32:45
    certification board or somebody else
  • 00:32:48
    uh what do you guys hear about are the
  • 00:32:50
    things that are the the highest concerns
  • 00:32:52
    for them in terms of threats such as
  • 00:32:54
    security
  • 00:32:55
    you know are they most concerned about
  • 00:32:56
    proxy testers having the wrong person
  • 00:32:58
    take the exam by you know sending in a
  • 00:33:00
    substitute are they concerned about
  • 00:33:02
    bringing in materials like the book that
  • 00:33:04
    patrick talked about are they concerned
  • 00:33:05
    about having two people there are they
  • 00:33:07
    you know what are the when they come to
  • 00:33:09
    you saying we need remote proctoring
  • 00:33:11
    what is it that you hear from them
  • 00:33:15
    it depends me so it's
  • 00:33:17
    all those situations are are going to be
  • 00:33:19
    different so
  • 00:33:20
    um certainly with with high stakes
  • 00:33:23
    especially with the the amount of
  • 00:33:25
    resources dedicated to creating items
  • 00:33:27
    item writing
  • 00:33:28
    um test security
  • 00:33:31
    you know content theft is is is a always
  • 00:33:34
    a number
  • 00:33:35
    um and so developing you know a good
  • 00:33:37
    process and protocol using the right
  • 00:33:39
    tools like the respondus lockdown
  • 00:33:41
    browser all those things help us you
  • 00:33:43
    know mitigate that concern um certainly
  • 00:33:46
    they're concerned about um you know exam
  • 00:33:48
    rules and
  • 00:33:50
    and making sure that every candidate is
  • 00:33:51
    following those particular exam rules
  • 00:33:53
    you know it at the university level in a
  • 00:33:56
    faculty level um you know they're
  • 00:33:59
    worried about the tests getting out but
  • 00:34:00
    in many of those cases they're allowing
  • 00:34:02
    test takers to take a test over a larger
  • 00:34:04
    window you know so a high stakes
  • 00:34:06
    assessment that test typically happens
  • 00:34:09
    either everybody testing it once or
  • 00:34:10
    everybody testing a short window in
  • 00:34:12
    higher ed it can be over wide open
  • 00:34:15
    and so you know a lot of that
  • 00:34:17
    content that is really dependent upon
  • 00:34:19
    them they're more worried about you know
  • 00:34:21
    unauthorized assistance you know is that
  • 00:34:23
    student is somebody else helping that
  • 00:34:25
    student is that student bringing
  • 00:34:27
    materials in is that student accessing
  • 00:34:28
    other websites you know there's
  • 00:34:30
    many many websites out there now that
  • 00:34:32
    you could you could put a test question
  • 00:34:34
    into and get the answer
  • 00:34:35
    um so they're worried about making sure
  • 00:34:38
    that the the person's not going outside
  • 00:34:40
    of the test to to access other items you
  • 00:34:43
    know so they're not bringing notes or
  • 00:34:45
    cheat notes into it so i think you know
  • 00:34:48
    with the lower stakes higher volume
  • 00:34:50
    things and this is why royal
  • 00:34:52
    tools is great be because those are wide
  • 00:34:54
    open it's really about is it the right
  • 00:34:56
    person
  • 00:34:57
    and
  • 00:34:58
    you know what are they having
  • 00:34:59
    unauthorized materials with the higher
  • 00:35:01
    stakes it's really a lot more about exam
  • 00:35:04
    and test security more traditional
  • 00:35:06
    you know additional items we really have
  • 00:35:07
    to focus on number one the test security
  • 00:35:10
    and the number two really the
  • 00:35:12
    environment um to make sure
  • 00:35:15
    so um raul
  • 00:35:17
    yeah and aren't you're right 100 i have
  • 00:35:19
    i have the same perspective donna from
  • 00:35:21
    what you say i would just add that in
  • 00:35:23
    our case because you know we're very
  • 00:35:25
    strong on technology you know our
  • 00:35:27
    institutions whether it is the
  • 00:35:28
    government institution or a higher ed
  • 00:35:30
    institution their biggest concern is are
  • 00:35:32
    are the students going to be able to use
  • 00:35:34
    the tool properly are they going to
  • 00:35:36
    understand how to log into it will they
  • 00:35:38
    have in exam support in case they run
  • 00:35:41
    out and they run into a problem because
  • 00:35:42
    they cannot they cannot properly load
  • 00:35:44
    the tool or the exam uh is not loading
  • 00:35:47
    properly so that is why you know even
  • 00:35:50
    when we are an ai-based solution we have
  • 00:35:52
    a robust customer care team that is
  • 00:35:54
    actually helping and working together
  • 00:35:56
    with the support team of the institution
  • 00:35:58
    itself during the examinations right and
  • 00:36:00
    we do a lot of pre-work uh before each
  • 00:36:02
    exam to be able to enable uh students
  • 00:36:05
    and also faculty or
  • 00:36:07
    supervisors to understand how to use the
  • 00:36:10
    tool and allow them to have a successful
  • 00:36:12
    experience the other thing that i've
  • 00:36:14
    been able to to note out is that this is
  • 00:36:17
    coming directly from the institutions
  • 00:36:18
    but also directly from students is that
  • 00:36:20
    they get nervous you know and we don't
  • 00:36:22
    want to impact their the academic
  • 00:36:24
    outcomes of a student right so
  • 00:36:26
    we need to be able to
  • 00:36:28
    um calm down students while they're
  • 00:36:30
    taking an examination because once they
  • 00:36:33
    see that they're being supervised once
  • 00:36:34
    they realize that there's an ai behind
  • 00:36:36
    every every single action that they take
  • 00:36:39
    they get nervous and that somehow could
  • 00:36:42
    impact that i'm not saying i'm not
  • 00:36:43
    saying it does but it could impact the
  • 00:36:45
    academic integrity or the academic
  • 00:36:47
    outcome of the assessment so that is
  • 00:36:50
    where uh in exam uh support really comes
  • 00:36:53
    in handy right so we have to enable
  • 00:36:55
    channels where the student is able to
  • 00:36:57
    actually talk to a person if needed if
  • 00:36:58
    they have questions right because even
  • 00:37:01
    when we're not high stakes exams as uh
  • 00:37:02
    you know um
  • 00:37:04
    what don and patrick supervise we still
  • 00:37:06
    you know for a student and you know and
  • 00:37:08
    a particular exam can be very important
  • 00:37:10
    for him or her particularly at any point
  • 00:37:12
    in time of their career right so
  • 00:37:14
    um they
  • 00:37:16
    they can get anxious and our
  • 00:37:17
    institutions
  • 00:37:18
    really are asking us to implement any
  • 00:37:21
    procedure or every procedure possible to
  • 00:37:24
    really ensure that the student is going
  • 00:37:26
    to be able to use the tool properly and
  • 00:37:28
    is going to be able to take the exam at
  • 00:37:30
    the end of the day right so that is one
  • 00:37:33
    of the the things that we've seen that
  • 00:37:34
    most of our customers are interested in
  • 00:37:36
    guaranteeing
  • 00:37:39
    okay thank you patrick anything you'd
  • 00:37:40
    like to add
  • 00:37:42
    uh no i think both don and rule
  • 00:37:44
    summarized everything perfectly so
  • 00:37:46
    anything else i would add would just be
  • 00:37:47
    repeating so no need to do that okay
  • 00:37:50
    thanks
  • 00:37:51
    uh we just got a question in the q a
  • 00:37:54
    using a mobile phone as a secondary
  • 00:37:55
    capturing source might be a good idea
  • 00:37:57
    but the same time could bring lots of
  • 00:37:59
    ingredients to support and proctors uh
  • 00:38:01
    what does the experience you guys have
  • 00:38:03
    in using it in terms of both
  • 00:38:04
    technological issues but then also end
  • 00:38:07
    user issues and making sure that they're
  • 00:38:09
    able to do it effectively
  • 00:38:11
    i would
  • 00:38:12
    we've been doing it for for five years
  • 00:38:14
    and you certainly learn a lot i mean
  • 00:38:15
    people are really good with their phones
  • 00:38:17
    so if if you've got the right you know
  • 00:38:19
    application you make it easy and i think
  • 00:38:22
    that was right you have to make it easy
  • 00:38:24
    for them to to use it to load up the
  • 00:38:26
    video
  • 00:38:26
    to get it going um you know
  • 00:38:29
    95 of people don't have an issue you've
  • 00:38:31
    always got that five percent that is
  • 00:38:33
    going to struggle
  • 00:38:34
    um
  • 00:38:35
    the proctors because they do this
  • 00:38:37
    constantly you know they know the
  • 00:38:39
    support they know the answers they know
  • 00:38:40
    how to how to advise people to get that
  • 00:38:43
    up and running on their on their device
  • 00:38:45
    the the two biggest problems that that
  • 00:38:48
    we see with the mobile are number one
  • 00:38:50
    that
  • 00:38:51
    the mobiles are great but the
  • 00:38:52
    consistency isn't as as good or the
  • 00:38:55
    stability of the internet connection
  • 00:38:56
    sometimes isn't as good and so that's
  • 00:38:58
    why it's important to have that second
  • 00:38:59
    camera going because sometimes you get a
  • 00:39:01
    drop call
  • 00:39:02
    uh because of the area they're in the
  • 00:39:05
    wi-fi connection the vpn connection so
  • 00:39:07
    you got to make sure the technology you
  • 00:39:08
    know auto reconnects uh to the phone and
  • 00:39:11
    then the other problem which is really
  • 00:39:13
    on the user side is that uh they don't
  • 00:39:15
    plug the phone in to the charger and
  • 00:39:17
    that's something we you know you put in
  • 00:39:19
    your protocols but again what we've
  • 00:39:21
    learned over time is have the right
  • 00:39:23
    backup procedures in place that's that's
  • 00:39:25
    why the second camera is so important
  • 00:39:26
    because it creates that redundancy and
  • 00:39:28
    it gives you that ability then to figure
  • 00:39:30
    out why you suddenly just lost that
  • 00:39:32
    connection but those are again less than
  • 00:39:34
    five percent of the cases you're going
  • 00:39:35
    to see
  • 00:39:36
    see issues and we work hard to reduce
  • 00:39:38
    that number um and we're actually seeing
  • 00:39:40
    it fall to one to two percent now so
  • 00:39:43
    okay excellent yeah that that plugging
  • 00:39:45
    in is an important thing because they're
  • 00:39:46
    gonna be streaming video for maybe six
  • 00:39:48
    hours um so you gotta make sure that
  • 00:39:50
    they're able to do that before they
  • 00:39:52
    start the exam
  • 00:39:53
    uh roll what have been your experiences
  • 00:39:55
    in integrating the uh camera as a second
  • 00:39:57
    video
  • 00:39:59
    well
  • 00:40:00
    it's you know nowadays you know cell
  • 00:40:02
    phones are very robust in terms of
  • 00:40:03
    technology and most of them have gpus
  • 00:40:05
    right but sometimes um you know the the
  • 00:40:09
    end user device is not as robust as
  • 00:40:11
    possible as necessary when it comes to
  • 00:40:13
    the uh quality of the camera right so
  • 00:40:15
    that's one and then the other thing that
  • 00:40:17
    don't mention it's really really common
  • 00:40:18
    particularly in latin america where
  • 00:40:21
    internet connectivity is not as uh
  • 00:40:23
    efficient and reliable as it is probably
  • 00:40:25
    in the us for instance right so those
  • 00:40:28
    are the two key main aspects so we've
  • 00:40:30
    had to actually design the tool
  • 00:40:32
    developer tool um a samadhi version in
  • 00:40:35
    the
  • 00:40:36
    mobile application that actually can
  • 00:40:38
    respond and adapt to changes in the
  • 00:40:40
    connectivity
  • 00:40:41
    uh and also um be able to understand the
  • 00:40:44
    dynamically the capabilities of hard
  • 00:40:47
    work that that's to enhance right so
  • 00:40:49
    those are the two key main aspects when
  • 00:40:51
    it comes to second camera that we've
  • 00:40:53
    identified
  • 00:40:54
    okay thank you
  • 00:40:55
    uh we have another follow-up question uh
  • 00:40:57
    is it possible with proctoring solutions
  • 00:40:59
    to take the assessment on a mobile phone
  • 00:41:00
    with the camera running on the mobile
  • 00:41:02
    phone um or is it still in a situation
  • 00:41:05
    where it's
  • 00:41:06
    highly preferred to have them on laptop
  • 00:41:08
    or desktop with the mobile phone as a
  • 00:41:10
    second
  • 00:41:11
    so
  • 00:41:13
    not really most most mobile phones to
  • 00:41:15
    this
  • 00:41:17
    point in time
  • 00:41:18
    typically or only allow you to do single
  • 00:41:21
    applications up front and so if you have
  • 00:41:23
    an application that engages the the
  • 00:41:25
    mobile phone and then you try to take
  • 00:41:26
    the test on top of that you typically
  • 00:41:28
    you're going to lose the camera
  • 00:41:30
    um
  • 00:41:31
    now they're getting the the newer ios is
  • 00:41:33
    especially with apple
  • 00:41:35
    uh developing their own chip i know on
  • 00:41:36
    the new ipads for example um they do
  • 00:41:39
    allow multitasking with the ambulance
  • 00:41:40
    ship and so that's changing and evolving
  • 00:41:43
    um
  • 00:41:45
    so there are other protocols that we use
  • 00:41:47
    of so someone wanted to take an exam on
  • 00:41:49
    a mobile device you again
  • 00:41:51
    with with most of these things you need
  • 00:41:53
    multiple devices to really proctor
  • 00:41:54
    effectively because when you rely on
  • 00:41:56
    just one device
  • 00:41:58
    proctor especially if that device is the
  • 00:41:59
    test taking device then you know you've
  • 00:42:01
    got a single point of failure and so
  • 00:42:04
    having multiple devices important so we
  • 00:42:06
    could still proctor someone taking a
  • 00:42:08
    test on a mobile phone
  • 00:42:10
    if we've got that second camera and we
  • 00:42:11
    can observe them also knowing that as of
  • 00:42:14
    today you can't multitask on a phone and
  • 00:42:16
    so that gives some love security but
  • 00:42:19
    once the phones have the ability to do
  • 00:42:21
    that multitasking
  • 00:42:22
    which is coming soon
  • 00:42:24
    then we can sort of change that up and
  • 00:42:25
    we might be able to do
  • 00:42:27
    an environment where they can take the
  • 00:42:28
    test on their phone have the phone
  • 00:42:30
    camera running and then still have that
  • 00:42:31
    second camera to watch them
  • 00:42:34
    thanks roh
  • 00:42:36
    yeah i agree with don i mean right now
  • 00:42:37
    we've assessed the the possibility
  • 00:42:39
    opportunity or feasibility of actually
  • 00:42:41
    allowing students to take exams in a
  • 00:42:43
    mobile device
  • 00:42:44
    and uh like for instance
  • 00:42:46
    we just we realized that a lockdown
  • 00:42:48
    browser cannot operate in a mobile
  • 00:42:50
    device right now there's there's no way
  • 00:42:51
    to actually allow for that to happen so
  • 00:42:53
    what we're recommending to our customers
  • 00:42:55
    is that if they want to use mobile
  • 00:42:57
    devices right now at this point in time
  • 00:42:59
    they should just consider them as you
  • 00:43:01
    know uh additional support to the to the
  • 00:43:03
    entire supervision proctoring experience
  • 00:43:06
    right um we're recommending against it
  • 00:43:08
    right now to only rely on mobile devices
  • 00:43:11
    the mobile devices should only be
  • 00:43:13
    considered as additional support um for
  • 00:43:17
    supervision but the main
  • 00:43:19
    application should run on a computer
  • 00:43:22
    on a desktop for a laptop right because
  • 00:43:23
    of the
  • 00:43:24
    technology restrictions that we have to
  • 00:43:27
    actually really ensure that the student
  • 00:43:30
    won't actually present on authorized
  • 00:43:31
    behavior by opening other applications
  • 00:43:34
    or um
  • 00:43:35
    yeah basically um
  • 00:43:37
    you know using other other software to
  • 00:43:40
    actually uh be able to answer questions
  • 00:43:42
    right so
  • 00:43:43
    um we recommend against it so we're
  • 00:43:45
    doing as much as we can to understand uh
  • 00:43:47
    you know whether it is on mac or windows
  • 00:43:50
    what uh you know what are the options
  • 00:43:52
    that we have as technology evolves to be
  • 00:43:54
    able to to understand at what point in
  • 00:43:57
    time we will recommend for an exam to be
  • 00:43:59
    taken on a mobile device only does that
  • 00:44:01
    make sense yeah it does
  • 00:44:03
    um and i'd also like to add in the layer
  • 00:44:05
    of the the exam experience itself um you
  • 00:44:08
    know i always say that mobile exams
  • 00:44:10
    don't work very well because a lot of
  • 00:44:12
    our clients are doing high stakes or
  • 00:44:14
    high depth testing um so it might be a
  • 00:44:16
    medical certification where they have to
  • 00:44:18
    look at x-rays or it's a financial
  • 00:44:20
    certification where they've got to read
  • 00:44:21
    this scenario and look at a screenshot
  • 00:44:23
    of microsoft excel uh something like
  • 00:44:25
    that and that kind of stuff just doesn't
  • 00:44:27
    work well on a mobile phone it's hard to
  • 00:44:29
    see a whole screenshot of excel it was
  • 00:44:32
    taken on a monitor on a tiny mobile
  • 00:44:34
    phone
  • 00:44:35
    so it just doesn't work from the exam
  • 00:44:36
    perspective
  • 00:44:38
    yeah the level of eye strain would just
  • 00:44:40
    uh kill me probably within item two of
  • 00:44:42
    that assessment so just the practicality
  • 00:44:44
    of trying to do a high stakes assessment
  • 00:44:46
    on such a tiny screen a little more
  • 00:44:48
    daunting than i'd want to do to be
  • 00:44:50
    honest yep exactly that's what i was
  • 00:44:51
    thinking
  • 00:44:52
    um
  • 00:44:53
    one
  • 00:44:54
    way that uh mobile delivery could be
  • 00:44:56
    useful is uh in the
  • 00:44:58
    confirmation testing approach which is
  • 00:45:00
    one that's used often with civil service
  • 00:45:02
    and pre-employment exams you know with
  • 00:45:04
    the certification exam everybody's
  • 00:45:06
    taking the high stakes exam once uh when
  • 00:45:09
    you're talking about applying for jobs
  • 00:45:11
    they might have you know 20 000 people
  • 00:45:13
    take a low stakes version of the exam
  • 00:45:16
    maybe on their phone maybe on their
  • 00:45:17
    laptop on proctor that sort of thing
  • 00:45:19
    and then only let's say the top ten
  • 00:45:21
    percent that qualify from that initial
  • 00:45:23
    exam would then come in and take the
  • 00:45:26
    proctored version of the exam on a
  • 00:45:27
    laptop a desktop
  • 00:45:28
    and that would allow you to save a lot
  • 00:45:30
    of money by you know you're not
  • 00:45:32
    proctoring 90 of those people and they
  • 00:45:33
    can take it on their cell phones
  • 00:45:35
    and yeah there's more opportunity to
  • 00:45:37
    cheat then but if they have the
  • 00:45:38
    opportunity to cheat and they're still
  • 00:45:40
    not able to get in the top 10 percent
  • 00:45:42
    you know that's why they probably don't
  • 00:45:44
    deserve to do the retake or what not
  • 00:45:46
    it's not the retake then it's the
  • 00:45:47
    confirmation test because then if you
  • 00:45:49
    did cheat on that initial exam that's
  • 00:45:51
    unproctored you might come in and take
  • 00:45:53
    that second exam that's proctored and
  • 00:45:55
    you're going to totally bomb it and
  • 00:45:56
    therefore not be qualified for the exam
  • 00:45:58
    that's the the argument of that approach
  • 00:46:03
    okay uh do we have any other questions
  • 00:46:05
    from the
  • 00:46:07
    attendees
  • 00:46:11
    i've seen it's
  • 00:46:13
    growing here um by the way we did have
  • 00:46:14
    up to 60 people uh there's been people
  • 00:46:16
    rotating in and out but i saw that the
  • 00:46:18
    number logged in did get up to 60 so
  • 00:46:20
    thank you all for attending today
  • 00:46:22
    nice
  • 00:46:25
    appreciate it thank you everybody
  • 00:46:27
    thanks jerome and thanks and and thanks
  • 00:46:29
    nate for for putting together and raul
  • 00:46:31
    thanks i love i love sharing information
  • 00:46:33
    with each other so they're talking about
  • 00:46:35
    it because at the end of the day you
  • 00:46:36
    know we all
  • 00:46:37
    test delivery it it takes a village and
  • 00:46:40
    there's so many different ways to do it
  • 00:46:41
    and there's so many different
  • 00:46:42
    perspectives and client needs and we
  • 00:46:44
    both specialize in different parts of
  • 00:46:46
    the market so it makes it really easy to
  • 00:46:48
    to have this kind of collaboration and
  • 00:46:50
    nate does a great job of pulling us all
  • 00:46:51
    together i agree with that don it's a
  • 00:46:53
    pleasure to have the opportunity to
  • 00:46:55
    share a panel with you and you know
  • 00:46:56
    educate the entire industry about this
  • 00:46:58
    so thank you again for the opportunity
  • 00:47:00
    nathan
  • 00:47:01
    yeah you're very welcome um since we've
  • 00:47:03
    got a couple minutes here i'll leave
  • 00:47:05
    some time for each of you to uh give
  • 00:47:06
    some information about your companies
  • 00:47:08
    and yourselves now somebody can connect
  • 00:47:09
    with you if they want to learn more uh
  • 00:47:11
    your website your linkedin twitter
  • 00:47:12
    whatever it is you'd like
  • 00:47:16
    sure so uh yeah doncaster and patrick
  • 00:47:18
    ochoa with monitor edu so our website is
  • 00:47:21
    monitoryu.com
  • 00:47:23
    our emails are easy it's just dawn
  • 00:47:25
    monetaryd.com or patrick monitoredu.com
  • 00:47:29
    um
  • 00:47:30
    we're both on linkedin you can find me
  • 00:47:32
    under the the
  • 00:47:34
    under don castner you can search for me
  • 00:47:35
    or you can look at aju president so it's
  • 00:47:38
    my my linkedin account goes back to the
  • 00:47:40
    very beginning back when i was a
  • 00:47:41
    university president back in the 2000's
  • 00:47:44
    and then patrick is just patrick ochoa
  • 00:47:45
    yeah i'm just boring old patrick ochoa
  • 00:47:48
    so
  • 00:47:50
    happy okay thank you enroll
  • 00:47:54
    so i'm actually just putting on the chat
  • 00:47:56
    you know uh you can actually send us an
  • 00:47:57
    email to info at samadhi.net or you can
  • 00:48:00
    send me a direct message to raul.rivera
  • 00:48:02
    at samadhi.net i just posted both email
  • 00:48:04
    addresses on the chat and also you can
  • 00:48:07
    find us at
  • 00:48:09
    www.sumati.net which i also also posted
  • 00:48:12
    on the on the chat so happy to get in
  • 00:48:14
    touch with anybody who's interested
  • 00:48:18
    okay
  • 00:48:19
    well with that thank you to raul patrick
  • 00:48:21
    and don for the excellent discussion and
  • 00:48:23
    uh thank you again to all of the
  • 00:48:24
    attendees uh that uh joined us today
  • 00:48:29
    have a good day everybody take care
  • 00:48:31
    everyone
Tags
  • Remote Proctoring
  • Exam Integrity
  • Cheating Prevention
  • AI Proctoring
  • Human Proctoring
  • Biometric Authentication
  • Privacy Compliance
  • Mobile Proctoring
  • Exam Security
  • Technological Challenges