---
title: 'Annotation Guideline'
author: Singamsetty Sandeep
---

Annotation guideline for half-true claim editing
===

# What is a half-truth?

A half-truth is a deceptive statement that includes some element of truth. The statement might be partly true, the statement may be totally true but only part of the whole truth, or it may use some deceptive element, especially if the intent is to deceive, evade, blame or misrepresent the truth.

Consider the following examples of half-truths.

1. ***Aswattama Hathaha! (Kunjaraha)***
The above example is from the Mahabharatha. Yudhishthira, the elder brother of the Pandavas was forced to lie that Ashwattama, son of Dronacharya, is dead. But Yudhishthira being the follower of Dharma, never lied. So, he said Aswattama Hathaha, loudly and Kunjaraha (an elephant) slowly. Here he made a deceptive statement, which is half-true.

2. ***Electronic gadgets mandatory for e-census in 2023. (hidden: people need not buy gadgets and the government will provide them)***
The news is partially accurate (half-true) but also includes misleading information (deceptive). It fails to mention (hidden) that the gadgets will be distributed by government officials, and the public will not be required to purchase them. This crucial detail is necessary to prevent confusion for the reader.

---

# Claim Editing
Given a half-true claim and corresponding counter as input, our claim editing pipeline uses the counter to edit the half-true claim and make it a true claim.
**Input:** half-true claim and corresponding counter
**Output:** true claim

**Example:**

**Original claim**- *The Dolphins stadium renovation will create more than 4,000 new local jobs.*
**Counter**- *The key omission here is that these are jobs associated with the 25-month stadium renovation project and include temporary positions.*
**Edited claim**- *"The Dolphins stadium renovation will create temporary jobs."*

# Annotation

We have three columns in the Excel file.
1. Original Claim
2. Counter
3. Edited claim

The task is to evaluate the Edited claim on 2 important parameters.
1. **Fluency** (On a scale of 1-3)
* Less fluent and incorrect grammar- score of 1
* Medium level fluency- score of 2
* Fluent and grammatically correct- score of 3
2. **Correctness** (On a scale of 1-3)
* Incorrect edit- score of 1 (Edited the incorrect part)
* Partially correct edit- score of 2 (Edited the right part but not correctly edited)
* Correctly edited- score of 3