Automated Video Exam

[WrayMedia]

Hi all,

I'm working on an education solution which will reduce the amount of time needed for an examiner to conduct 121 interviews with students.  Typically these can take one to two hours.

The intention is to replace the time the examiner spends with the student initially and focus only on answers that the student did not answer well enough. 

I have a collection of existing interviews with written reports on how well the student did on each question for training.

I see the process as follows:-

- Pose a series of questions to a student in a linked video.

- Record their responses in video.

- Use Azure Video Indexer (or similar) to extract a transcript of the student's answers

- Use Copilot to reference the answers against previous answers that have additional information about the quality of response.  E.g. the student mentions the correct topics.

- Create a report that tells the examiner which questions the student did well on and which ones need attention.

- Link to video of each question.

- Examiner meets the student to only discuss the problem questions.

Any thoughts or suggestions would be appreciated.

Thanks

Richard

[Nived_Nambiar]

Hi @WrayMedia 

Interesting usecase 🙂

Yes I think it may be possible as you are able to extract the transcripts from video using some other tools (i am not sure around that), after extracting those you can create a prompt in AI Builder which should tell whether the students has ansewered the questions correctly or not correspodning to each question.

The Prompt design for to built a prompt in AI Builder should be like this 

Hi,

For the below questions,
{{questions}}

Answers are extracted from video transcript like below
{{answers transcript}}

Could you help to know whether the answers are correct for each question. Also Kndly note that at start of each question, students has mentioned at starting like Answer for Question 1 like that for example for 1st Question etc.

I hope if you can make user to say before answering a question something like Answer for Question 1 like that it would help ai to understand and see whether each question have answer matching that and can return a summary of that.

So, flow design should be like this -

1. Flow fed the video details to transcript extracting tool

2. Captures the output from step 1

3. Enters the question and output from step 1 to AI Prompt in power automate

4. Gets the response from it as well.

5. sends a report.

Hope it helps !

Thanks & Regards,

Nived N 🚀

LinkedIn: Nived N's LinkedIn
YouTube: Nived N's YouTube Channel

🔍 Found my answer helpful? Please consider marking it as the solution!
Your appreciation keeps me motivated. Thank you! 🙌

[WrayMedia]

Thanks.  I thought it would be possible.

I need to work out if I can add enough knowledge to the Copilot via Copilot Studio or if I have use some other tool like Azure A.I.

Any thoughts would be appreciated.

[Nived_Nambiar]

Hi @WrayMedia 

How you are thinking to design the flow , like kind of chatbot deisgn ?

Thanks & Regards,

Nived N 🚀

LinkedIn: Nived N's LinkedIn
YouTube: Nived N's YouTube Channel

🔍 Found my answer helpful? Please consider marking it as the solution!
Your appreciation keeps me motivated. Thank you! 🙌

[WrayMedia]

A chatbot is a possibility, but maybe more the assessor.

I'd like to keep the students focussed on answering the questions.

[Nived_Nambiar]

Hi @WrayMedia 

Actually i have tried to achieve something simmilar 

What i did is record a voice clip of my answers and then extract the text from voice clip (using a software - manually done), then i input those into my power automate cloud flows which go through the prompt to check answers are correct or not and finally it gave me results in html table like below

Thanks & Regards,

Nived N 🚀

LinkedIn: Nived N's LinkedIn
YouTube: Nived N's YouTube Channel
Blog: Nived Nambiar's Blogs

🔍 Found my answer helpful? Please consider marking it as the solution!
Your appreciation keeps me motivated. Thank you! 🙌

[WrayMedia]

Thanks

I've managed to get Azure A.I. to use past markings and audio transcripts to provide the results I want.

Now I need to train the A.I. with more data and automate the full process.