Module backend.test_suggestions
This file contains Prompt Engineering tests for evaluating possible system prompts and methods of prompt engineering for providing resume suggestions. The test output files are located in the suggestions_test_output folder.
Functions
def export_file(path, content)
-
Creates and exports the provided content into the file at the given path.
def import_file(path)
-
Imports and returns the text content from a file at the given path.
def suggestions_test(self, prompt_file, resume_file, job_file, example_files=[])
-
Master template for Resume Suggestion Prompt Engineering Tests.
Takes the prompt, resume, job description, and example files if provided, reads in the content from the files in the sample_data file, and runs the given test. The output is in the suggestions_test_output folder.
Classes
class FlaskTest (methodName='runTest')
-
A class whose instances are single test cases.
By default, the test code itself should be placed in a method named 'runTest'.
If the fixture may be used for many test cases, create as many test methods as are needed. When instantiating such a TestCase subclass, specify in the constructor arguments the name of the test method that the instance is to execute.
Test authors should subclass TestCase for their own tests. Construction and deconstruction of the test's environment ('fixture') can be implemented by overriding the 'setUp' and 'tearDown' methods respectively.
If it is necessary to override the init method, the base class init method must always be called. It is important that subclasses should not change the signature of their init method, since instances of the classes are instantiated automatically by parts of the framework in order to be run.
When subclassing TestCase, you can set these attributes: * failureException: determines which exception will be raised when the instance's assertion methods fail; test methods raising this exception will be deemed to have 'failed' rather than 'errored'. * longMessage: determines whether long messages (including repr of objects used in assert methods) will be printed on failure in addition to any explicit message passed. * maxDiff: sets the maximum length of a diff in failure messages by assert methods using difflib. It is looked up as an instance attribute so can be configured by individual tests if required.
Create an instance of the class that will use the named test method when executed. Raises a ValueError if the instance does not have a method with the specified name.
Expand source code
class FlaskTest(unittest.TestCase): def test_zero_shot_Cynthia_Lenovo(self): suggestions_test(self, "suggestion_zero_shot.txt", "cynthia_dwayne.txt", "lenovo.txt") def test_zero_shot_Ava_EpicGames(self): suggestions_test(self, "suggestion_zero_shot.txt", "ava_johnson.txt", "epicgames.txt") def test_zero_shot_Charles_Fidelity(self): suggestions_test(self, "suggestion_zero_shot.txt", "charles_mcturland.txt", "fidelity.txt") def test_zero_shot_Cynthia_RedHat(self): suggestions_test(self, "suggestion_zero_shot.txt", "cynthia_dwayne.txt", "redhat.txt") def test_zero_shot_Charles_Apple(self): suggestions_test(self, "suggestion_zero_shot.txt", "charles_mcturland.txt", "apple.txt") def test_one_shot_Cynthia_Lenovo(self): suggestions_test(self, "suggestion_one_shot.txt", "cynthia_dwayne.txt", "lenovo.txt", one_shot_examples) def test_one_shot_Ava_EpicGames(self): suggestions_test(self, "suggestion_one_shot.txt", "ava_johnson.txt", "epicgames.txt", one_shot_examples) def test_one_shot_Charles_Fidelity(self): suggestions_test(self, "suggestion_one_shot.txt", "charles_mcturland.txt", "fidelity.txt", one_shot_examples) def test_one_shot_Cynthia_RedHat(self): suggestions_test(self, "suggestion_one_shot.txt", "cynthia_dwayne.txt", "redhat.txt", one_shot_examples) def test_one_shot_Charles_Apple(self): suggestions_test(self, "suggestion_one_shot.txt", "charles_mcturland.txt", "apple.txt", one_shot_examples) def test_one_shot_long_Cynthia_Lenovo(self): suggestions_test(self, "suggestion_one_shot_long.txt", "cynthia_dwayne.txt", "lenovo.txt", one_shot_examples) def test_one_shot_long_Ava_EpicGames(self): suggestions_test(self, "suggestion_one_shot_long.txt", "ava_johnson.txt", "epicgames.txt", one_shot_examples) def test_one_shot_long_Charles_Fidelity(self): suggestions_test(self, "suggestion_one_shot_long.txt", "charles_mcturland.txt", "fidelity.txt", one_shot_examples) def test_one_shot_long_Cynthia_RedHat(self): suggestions_test(self, "suggestion_one_shot_long.txt", "cynthia_dwayne.txt", "redhat.txt", one_shot_examples) def test_one_shot_long_Charles_Apple(self): suggestions_test(self, "suggestion_one_shot_long.txt", "charles_mcturland.txt", "apple.txt", one_shot_examples)
Ancestors
- unittest.case.TestCase
Methods
def test_one_shot_Ava_EpicGames(self)
def test_one_shot_Charles_Apple(self)
def test_one_shot_Charles_Fidelity(self)
def test_one_shot_Cynthia_Lenovo(self)
def test_one_shot_Cynthia_RedHat(self)
def test_one_shot_long_Ava_EpicGames(self)
def test_one_shot_long_Charles_Apple(self)
def test_one_shot_long_Charles_Fidelity(self)
def test_one_shot_long_Cynthia_Lenovo(self)
def test_one_shot_long_Cynthia_RedHat(self)
def test_zero_shot_Ava_EpicGames(self)
def test_zero_shot_Charles_Apple(self)
def test_zero_shot_Charles_Fidelity(self)
def test_zero_shot_Cynthia_Lenovo(self)
def test_zero_shot_Cynthia_RedHat(self)