Grammar metrics

Below are the detailed feedback metrics appearing in the response for grammar along with their descriptions, are as follows.

These metrics are returned by including include_ielts_feedback = 1 parameter in the Spontaneous Speech API.

ParameterDescription

grammar.overall_metrics.length

The sufficiency of the response length in words to demonstrate the necessary grammatical range.

grammar.overall_metrics.lexical_diversity

The degree of variation in syntactic structures such as diversity in verbs, adjectives and adverbial modifiers.

grammar.overall_metrics.grammatical_accuracy

The degree of grammatical inaccuracies in the response. A list of grammatical errors with suggested replacements is returned in the grammar.errors node when this index is low.

grammar.overall_metrics.grammatical_range

The degree of grammatical range demonstrated in the response. This score is further broken down into 4 additional sub-indices:

  • noun_phrase_variation

  • noun_phrase_complexity

  • verb_construction_variation

  • adverb_modifier_variation

grammar.overall_metrics.grammatical_range.noun_phrase_variation

The degree of variation in structure of noun phrases such as the number and types of modifiers used in the response.

grammar.overall_metrics.grammatical_range.noun_phrase_complexity

The degree of complexity of noun phrases such as the richness of adjectives, relative clauses, prepositional phrases, nonfinite elements, determiners, and demonstratives used in the response.

grammar.overall.metrics.grammatical_range.verb_construction_variation

The degree of variation in verbal structures such as the number and types of verb structural elements used in the response.

grammar.overall.metrics.grammatical_range.adverb_modifier_variation

The degree of variation in types of adverbs or adverb phrases to modify clauses, verbs, and adjectives used in the response.

An example of grammar feedback metrics looks like below:

{   
"grammar": 
  {
    "overall_metrics": {
      "length": {
         "score": 4,
         "level": "mid"
       },
       "lexical_diversity": {
          "score": 8,
          "level": "high"
       },
       "grammatical_accuracy": {
           "score": 8,
           "level": "high"
        },
        "grammatical_range": {
            "score": 5,
            "level": "mid",
            "message": "Your response has less grammatical range than most advanced speakers. To improve, you should use a wider range of phrasal and clausal structures and verb-argument constructions.",
            "noun_phrase_complexity": {
               "score": 1,
               "level": "low",
               "message": "Your response lacks noun phrase complexity. You should use richer modifiers in noun phrases by using adjectives, relative clauses, prepositional phrases, non-finite elements, determiners, and demonstratives."
            },
            "noun_phrase_variation": {
                "score": 5,
                "level": "mid"
            },
            "verb_construction_variation": {
                "score": 6,
                "level": "mid"
             },
             "adverb_modifier_variation": {
                 "score": 9,
                 "level": "high"
              }
         }
     },
     "errors": [
      {
         "category": "STYLE",
         "message": "Did you mean 'different from'? 'Different than' is often considered colloquial style.",
         "span": [44,48],
         "matched_text": "than",
         "replacements": ["from"]
      }
     ]
 }
}

Grammatical Error

The grammar.errors node contains a JSON array of grammatical errors found in the response. Each array element is an object with the following properties:

keyDescription

category

The type of error such as; STYLE, GRAMMAR, COLLOCATION, CONFUSED_WORDS

message

A descriptive message of the error. The message may refer to words within the evaluated text and include suggested replacements within the ... markup tags.

span

The [begin, end] indices of the matched text in characters.

matched_text

The matched text where the error was found.

replacements

An array of zero or more suggested replacements where applicable.

Last updated