Question Management

You can create seven types of assessment questions on Evalgator, namely,  Descriptive, Fill in the Blanks, HTML, Single Select MCQ, Weighted MCQ, Video, and Coding. You can set questions suitable for the role you are hiring for.  Note: Evalgator provides a free question bank. You can use these questions as it is while creating your assessment or customize them to make them your own. They will be displayed on selecting Evalgator, next to My Company, on the Questions dashboard.

Creating Coding Questions

A coding question tests the technical skills of your candidate. You can create a coding question or select one from the Evalgator question bank and edit it.

  1. Click Questions on the left navigation pane. A Questions dashboard opens up with a tabbed view of My Company and Evalgator. My Company displays the list of questions created by you and Evalgator displays the list of preload questions.
  2. Select My Company and click  New Question  at the top right corner. From the drop-down, select Coding.
  3. The Create Coding Question page opens up.
  4. There are four steps involved in creating a coding question: Question, Code Snippet, Test Cases, and Summary.

  5. STEP 1: Question

    This is where you set the difficulty level, time, etc. of the coding question.

  6. In the title field, enter a short title for the question you are about to add. 
  7. Select the difficulty level. There are three levels: Easy, Medium, Hard.  It can be selected based on the difficulty level of the question.
  8. In the time field, enter an expected time for answering the question in minutes.
  9. In the add tags field, enter a tag by which the question can be recalled. To add multiple tags, add tag and press enter.
  10. Select the category of the question from the drop-down menu.
  11. In the problem description field, you can add a short description of the question. The description is the question that will be visible to the candidate.

    This field provides you with basic editing options such as add highlight, and add a code block, among others. You can position your mouse on each icon to find out what it is for.

    Please note that all the above fields are mandatory.

  12. Finally, add the interviewer guidelines for the question if necessary. You can add notes on how you arrived at the answer for that particular question or include any other pertinent information for future reference.
  13. Click  Save & Proceed  to move on to the next step. The Step 2 dashboard will appear.
  14. STEP 2: Code Snippet

    After completing step 1 you can proceed to step 2. Here you can enter the function name, return type, the function parameters, select the coding language, and generate code.

  15. In the Function Name field, enter the Function Name.
  16. From the Return Type drop-down menu, select the Return function. The supported return types are integer, string, boolean, integer array, string array, void, 2D string array, 2D integer array.
  17. Next, add the Function Parameters. Click the + icon. This opens up a drop-down menu to select the Parameter type and a field to enter the Parameter name.
  18. Next, click Generate Code. The code will be generated in all the languages. The code will be displayed in the language that was selected by default.
  19. To view the code in your preferred language, select it from the Language drop-down list.
  20. Click  Save & Proceed . You will be taken to the third step of adding the test cases.
  21. STEP 3: Test Cases

    You can proceed to the third step after completing steps 1 and 2. Step 3 consists of adding Test cases for the assessment. The evaluation of the coding question is based on the number of test cases passed by the candidate.

  22. Click the  + Add Test Case  button to add test cases for the program. An Add New Test Case modal will appear. The modal has a Learn More tab at the bottom where instructions on how to add test cases for different parameters are provided for your reference.
  23. Add the test case name. By default, it will be set as Test Case - 01.
  24. Select the difficulty level from the drop-down menu under Difficulty.

  25. Enter the score the candidate should receive on clearing the test case.

  26. Add the Input and expected Outputs.
  27. You can make it a sample test case using the toggle button. Every question must have at least one sample test case.
  28. The input and expected output of any one of the sample test cases will be shown to the candidate.
  29. You can use the toggle button to keep the test case visible or hidden from the candidate. If you select the hidden test case option, the candidate won't be able to see the input or output values; just whether they passed the test case will be visible to them.
  30. Click on  Save.
  31. After adding all the test cases click   Save & Proceed.  A summary of the question will be displayed for a quick review in the STEP 4 Summary.

     

    After saving the question, if you want to delete or edit any test case, find the question from the Questions dashboard that is displayed on selecting Questions on the left navigation pane and click on the pencil icon to the right end of the question.

     

    • You will be taken to STEP 4 Summary. Click on STEP 3 Test Cases.
    • Click the pencil icon to the right of the test case to edit it.

     

    • Click the dustbin icon to the right of the test case to delete any test case.

  32. STEP 4: Summary

    After completing steps 1, 2, and 3, you will be taken to the next step, i.e. step 4, where a summary of the question will be displayed. You can try the question in this step.

  33. Check the summary of the question.
  34. Click the green checkmark near the steps on the top to make changes if required.
  35. Click the  Try question button at the bottom to ensure that the question is working as expected. On selecting the  Try question button you will be able to view the question as it appears for the candidates.
  36. Select the language from the drop-down menu next to Language at the top of the page.

  37. Select light mode or dark mode by clicking the sun or moon symbol respectively.
  38. Click the Toggle Theater mode or Toggle Full-Screen mode by selecting the respective icons next to the moon symbol.
  39. Click the settings icon to change the font size. You can change the font to small, medium, or large.
  40. Click the Input & Output button to enter the input to test the code. The output will be generated based on the logic entered.
  41. In the edit box, enter the code below the ‘Type your code’ line.
  42. Click the  Run Code button below the editor to run the code. 

  43. Click Test Cases  to view the test codes set for the question. The hidden test cases will have a lock symbol to the right of the bar.

  44. Click  Run Test Cases to start running the test case based on the written logic. We can verify if the test cases pass.

Creating Descriptive Questions

This type of question allows the candidate to write a descriptive answer to the question. This can be used to check the subject knowledge, language, and writing skills, among others.

    1. Select My Company and click Descriptive from the drop-down menu for  New Question . A Create Descriptive Question dashboard with drop-downs and widgets to customize the question will be displayed.
    2. In the Title field, enter the title of the question.
    3. Select the difficulty level of the question from the drop-down menu under Difficulty.
    4. In the Duration field, enter the duration of the question in minutes.
    5. In the Tags field, enter tags that you want the question to be recalled. You can add any number of tags. Add a tag and press enter to add the next tag.
    6. In the Score field, enter the marks to be assigned for the question.
    7. Select the category of the question from the drop-down menu that appears when you click on Category.
    8. You can choose to allow candidates to upload files that are 5 MB or less along with their answers by enabling the toggle button.
    9. In the Description text field, enter a description of the question. Problem description provides you with basic editing options such as add highlight, increase/decrease indent, add a code block, among others. You can position the cursor over each icon to see what it is for.
    10. Finally, add the interviewer guidelines for the question if necessary. You can add guidelines about the expected answer or include any other pertinent information for future reference.
    11. Click  Save Question . A popup with an option to try the question will appear. You can either try the question or select Maybe later to try it later.
Creating Fill-in-the-Blanks Questions

This type of question contains a phrase or a sentence with missing word/s that have to be filled by the candidates. You can add as many blanks as required.

  1. Select My Company and select Fill in the Blanks from the drop-down menu on  New Question. A dashboard to Create Fill in the Blanks Question with drop-downs and widgets to customize the question will be displayed.
  2. In the title field, enter the title of the question.
  3. Select the difficulty level of the question from the drop-down menu.
  4. In the duration field, enter the duration of the question in minutes.
  5. In the tags field, enter the tags that you want the question to be recalled for. You can add multiple tags. Add a tag and press enter to add the next tag.
  6. From the category drop-down, select the category of the question.
  7. In the description field, enter the description of the question. Problem description editor provides you with editing options such as add highlight, increase/decrease indent, add a code block, among others. You can take the cursor over each icon and stay for a second to see what it is for.
  8. Enter the statement with blanks in the Fill in the blanks Template box. Each blank should be given a name and placed in the placeholder [()].

    For example, a statement can be: The book is [(blank1)] the table. The window is [(blank2)] the book.  The book has [(blank3)] pages. Here, the statement has three blanks named blank1, blank2, and blank3 respectively, each placed inside the placeholder.

  9. Click  Generate Placeholders to the bottom right of the template. A table with a row for each blank will appear.
  10. Enter all the probable answers and score.
  11. Select Trim if the answers are independent of space between words or characters. 

    For example, if the accepted answer is “dropdown” and the candidate answers “drop down”, it will still be marked correct by the system.

     

  12. Select the Case Sensitive box if the correct answer is case sensitive. 
  13. Add Grace Marks for candidates who enter all the blanks correctly. This is optional. You can save the question with or without the grace marks.
  14. Finally, add the interviewer guidelines for the question if necessary. You can add notes on how you arrived at the answer for that particular question or include any other pertinent information for future reference.
  15. Click  Save Question.  A popup box with an option to try the question will appear. You can either try the question or select Maybe later to try it later.
Creating HTML Questions

This question format tests the HTML, CSS and JavaScript proficiency of your candidates.

  1. Select My Company and click HTML from the drop-down menu for  New Question . A Create HTML Question dashboard will be displayed.
  2. In the title field, enter the title of the question.
  3.  Select the difficulty level of the question from the drop-down menu next to the title.
  4. In the duration field, enter the number of minutes the candidates can take to answer the question.
  5. In the Tags field, enter the tags that you want the question to be recalled for. Add a tag and press enter to include more than one tag.
  6. In the Score field, enter the marks to be assigned for the question.
  7. Select the category of the question from the drop-down menu.
  8. Enter the description in the box provided below Category. Problem description provides you with basic editing options such as add highlight, increase/decrease indent, and add a code block, among others You can take the cursor over each icon and stay for a second to see what it is for.
  9. There will be a default snippet, which you can customize if needed as per your requirements. This snippet will be loaded for the candidates when they attend this question during the assessment. 
  10. Add the interviewer guidelines for the question if necessary. You can add notes on how you arrived at the answer for that particular question or include any other pertinent information for future reference.
  11. Click  Save Question . A popup box with an option to try the question will appear. You can either try the question or select Maybe later to try it later.
  12. It is recommended that you try the question so you can see how it will look to candidates during the assessment.
  13. Saved questions can be viewed under the My Company tab in the Questions dashboard.

Creating Single Select Multiple-Choice Questions

Single select multiple choice questions have multiple options available as answers. The candidate has to select the correct answer from the options available.

  1. Select My Company and click Multiple choice from the drop-down menu and select Single Select MCQ on  New Question . A Create Single Select Multiple Choice Question dashboard will be displayed.
  2. In the title field, enter the title of the question.
  3. Select the difficulty level of the question from the drop-down menu next to the title.
  4. In the duration field, enter the duration of the question in minutes.
  5. In the Tags field, enter the tags that you want the question to be recalled for. Add a tag and press enter to include more than one tag.
  6. In the Score field, enter the marks to be assigned for the question.
  7. Select the category of the question from the drop-down menu.
  8. Enter the description in the box provided below Category. Problem description provides you with basic editing options such as add highlight, increase/decrease indent, and add a code block, among others You can take the cursor over each icon and stay for a second to see what it is for.
  9. Select  +Add Option  under Answer Options to generate multiple choices for the candidates.
  10. Select the right answers among the options by clicking Correct to the right of the option.
  11. To delete an option, click the dustbin icon next to it.
  12. Finally, add the interviewer guidelines for the question if necessary. You can add notes on how you arrived at the answer for that particular question or include any other pertinent information for future reference.
  13. Click  Save Question . A popup box with an option to try the question will appear. You can either try the question or select Maybe later to try it later.

 

Creating Weighted Multiple Choice Questions

Weighted multiple choice question is a question category where a question can have more than one correct answer, and each answer has a corresponding score. The candidate has to select an answer from the available options and will receive the corresponding score.

  1. Select My Company, click Multiple choice from the drop-down menu on  New Question, and select Weighted MCQ from the sub dropdown menu. A Create Weighted Multiple Choice Question dashboard will be displayed.
  2. In the title field, enter the title of the question.
  3. Select the difficulty level of the question from the drop-down menu next to the title.
  4. In the duration field, enter the number of minutes the candidates can take to answer the question.
  5. In the Tags field, enter the tags that you want the question to be recalled for. Add a tag and press enter to include more than one tag.
  6. Select the category of the question from the drop-down menu.
  7. Enter the description in the box provided below Category. Problem description provides you with basic editing options such as add highlight, increase/decrease indent, and add a code block, among others You can take the cursor over each icon and stay for a second to see what it is for.
  8. Select  +Add Option  under Options to generate multiple choices for the candidates.
  9. Assign scores for each option in the enter score box to the right of the option.
  10. You can also assign 0 or negative numbers as scores.
  11. To delete an option, click the dustbin icon next to it.
  12. Add the interviewer guidelines for the question if necessary. You can add notes on how you arrived at the answer for that particular question or include any other pertinent information for future reference.
  13. Click  Save Question . A popup box with an option to try the question will appear. You can either try the question or select Maybe later to try it later.
  14. Saved questions can be viewed under the My Company tab in the Questions dashboard. 
Creating Video Questions

This type of question allows the candidate to record a video of themselves presenting the answer. We can assess the candidate’s language skills, presentation skills, and body language.

  1. Select My Company and click Video from the drop-down menu for  New Question . A Create Video Question dashboard with drop-downs and widgets to customize the question will be displayed.
  2. In the Title field, enter the title of the question.
  3. Select the difficulty level of the question from the drop-down menu under Difficulty.
  4. In the Duration field, the time is set to 1.5 minutes as default and cannot be changed.
  5. In the Tags field, enter tags that you want the question to be recalled. You can add any number of tags. Add a tag and press enter to add the next tag.
  6. In the Score field, enter the marks to be assigned for the question.
  7. Select the category of the question from the drop-down menu that appears when you click on Category.
  8. In the Description text field, enter a description of the question. Problem description provides you with basic editing options such as add highlight, increase/decrease indent, add a code block, among others. You can position the cursor over each icon to see what it is for.
  9. Finally, add the interviewer guidelines for the question if necessary. You can add guidelines about the expected answer or include any other pertinent information for future reference.
  10. Click  Save Question . A popup with an option to try the question will appear. You can either try the question or select Maybe later to try it later.
Bulk Uploading Questions

You can upload single select and weighted multiple choice questions in bulk to Evalgator. 

  1. Select My Company and select Bulk Upload from the drop-down menu on  New Question.
  2. Select the question type, download the sample template, fill in the question details, and upload it to import them.
  3. Select the file and click on Import.
  4. Your questions will be uploaded to Evalgator.
Copying/Cloning Preloaded Questions
  1. Click Questions from the left navigation pane on the main dashboard. A Questions dashboard with questions that are already added, different filters for the questions, and an option to add new questions will be displayed. It also has two options: My Company and Evalgator at the top.
  2. My Company displays the list of questions created by you and Evalgator displays the list of preload questions.
  3. Select the copy icon next to the question you want to clone. A confirmation modal to clone the question will appear. Select OK.
  4. You will be taken to the Edit Question dashboard. Here you can make changes to the question if needed.
  5. If you don't want to make any changes, scroll down and click Cancel.
  6. If you have made any changes, click Save. A modal with an option to try the question will appear. You can either try the question or select Maybe later to try it later. 
  7. You can find the cloned question under My Company on the tabbed menu. It will be named as Copy of (Question Title).
Trying Out a Question Before Publishing

Ideally, you should try every new question before an assessment to ensure it appears to the candidates as expected and correctly evaluates the attempted answer.

New Question

To try a new question click the  Try Question  that appears in the popup box when you save a question for the first time.

Existing Question

To try an existing question, find the question in the Questions dashboard and view it by clicking the eye icon on the right side of the row. Select Try Question at the top right corner of the View Question dashboard.