Heuristics are a weak supervision technique used to label a dataset and are based on a subject matter expert’s (SME’s) domain-specific knowledge.
On this page you will find:
How to Manually Generate a Heuristic Within the Jaxon Platform
- To manually generate heuristics within the Jaxon Platform, fill out the fields in the Heuristic Editor shown here
- When satisfied, click Save
In this example, if an example contains the phrase “I hated it” it will be given the label “neg”.
- Heuristic Editor Field Descriptions (Regular Expressions)
- Creating Zero-Shot to Target Heuristics will change the Fields found in the Heuristic Editor slightly.
- Heuristic Editor Field Descriptions (Zero-Shot to Target Class)
<aside>
<img src="https://s3-us-west-2.amazonaws.com/secure.notion-static.com/743655a0-9af5-4c21-bc5a-ed38b17a40e2/0_JAXON_Logo_Mark.jpg" alt="https://s3-us-west-2.amazonaws.com/secure.notion-static.com/743655a0-9af5-4c21-bc5a-ed38b17a40e2/0_JAXON_Logo_Mark.jpg" width="40px" /> In this example, if an example contains the word “hate”, the heuristic will return the target class. If the example contains “love”, the heuristic will abstain.
</aside>
Back to the top ↑
How to Automatically Generate Heuristics
- To automatically generate heuristics within the Jaxon Platform, fill out the fields in the Generate Heuristics box shown here.
- Click Generate Suite
- Generate Heuristics Box Field Descriptions
- The heuristics will display as shown below once they have finished generating. This may take minutes to several hours.
Back to the top ↑
How to Test a Heuristic
- To the right of the Heuristic Editor, select a heuristic from the list. A successfully selected heuristic will be blue.
- Click Test to check the pattern’s effectiveness
- Type a sample example in the Test Custom Input box
- Based on whether the sample example matches the Pattern provided in the heuristic, the Target Label or “abstain” will be displayed.
<aside>
<img src="https://s3-us-west-2.amazonaws.com/secure.notion-static.com/788e93e4-c73e-4d48-9593-91a2f547fb2d/0_JAXON_Logo_Mark.jpg" alt="https://s3-us-west-2.amazonaws.com/secure.notion-static.com/788e93e4-c73e-4d48-9593-91a2f547fb2d/0_JAXON_Logo_Mark.jpg" width="40px" /> In this example, the Target Pattern was “I hate it” and the Target Label was “neg”.
</aside>
In this case, the sample example matches the target pattern and so the target label is displayed.
In this case, the sample example does not match the target pattern and so “abstain” is displayed.
Back to the top ↑
How to Delete a Heuristic
- To the right of the Heuristic Editor, select a heuristic from the list. A successfully selected heuristic will be blue.
- Click the trash can icon to the right of the heuristic.
- Click OK on the box that pops up if you really want to delete the heuristic and all dependent ensembles. We cannot stress enough that this action cannot be undone.
Back to the top ↑
© Copyright Jaxon, Inc. 2023 All rights reserved.