Class: Insika::Evals::Pairwise::Verdict

Inherits:
Struct
  • Object
show all
Defined in:
lib/insika/evals/pairwise.rb

Overview

vs names WHO the reference half actually is: agent (model against model) or human-assisted (a person typed part of it, P23a's origin: operator). It rides on the verdict rather than beside it so a report cannot print the outcome without the label.

Instance Attribute Summary collapse

Instance Method Summary collapse

Instance Attribute Details

#judges ⇒ Object

Returns the value of attribute judges

Returns:

  • (Object) —

    the current value of judges



45
46
47
 
# File 'lib/insika/evals/pairwise.rb', line 45

def judges
  @judges
end

#order_dependent ⇒ Object

Returns the value of attribute order_dependent

Returns:

  • (Object) —

    the current value of order_dependent



45
46
47
 
# File 'lib/insika/evals/pairwise.rb', line 45

def order_dependent
  @order_dependent
end

#outcome ⇒ Object

Returns the value of attribute outcome

Returns:

  • (Object) —

    the current value of outcome



45
46
47
 
# File 'lib/insika/evals/pairwise.rb', line 45

def outcome
  @outcome
end

#reason ⇒ Object

Returns the value of attribute reason

Returns:

  • (Object) —

    the current value of reason



45
46
47
 
# File 'lib/insika/evals/pairwise.rb', line 45

def reason
  @reason
end

#vs ⇒ Object

Returns the value of attribute vs

Returns:

  • (Object) —

    the current value of vs



45
46
47
 
# File 'lib/insika/evals/pairwise.rb', line 45

def vs
  @vs
end

Instance Method Details

#decided? ⇒ Boolean

Returns:

  • (Boolean) 


47
 
# File 'lib/insika/evals/pairwise.rb', line 47

def decided? = [BETTER, COMPARABLE, WORSE].include?(outcome)

#human_assisted? ⇒ Boolean

Returns:

  • (Boolean) 


46
 
# File 'lib/insika/evals/pairwise.rb', line 46

def human_assisted? = vs == "human-assisted"