Class: Iriq::Clusterer

Inherits:
Object
  • Object
show all
Defined in:
lib/iriq/clusterer.rb

Overview

Groups many identifiers by host + path shape. Use add to feed inputs and clusters to read out the groups. explain annotates a single identifier against the cluster it would fall into, including which positions are stable across all observed members.

Implemented as a thin wrapper over Storage::Memory — the same code path Corpus uses for the cluster portion of its state, so there's only one place that knows how clusters get stored.

Instance Method Summary collapse

Constructor Details

#initialize(classifier: SegmentClassifier::DEFAULT) ⇒ Clusterer

Returns a new instance of Clusterer.



11
12
13
14
 
# File 'lib/iriq/clusterer.rb', line 11

def initialize(classifier: SegmentClassifier::DEFAULT)
  @classifier = classifier
  @storage    = Storage::Memory.new(classifier: classifier)
end

Instance Method Details

#add(input, shape: nil) ⇒ Object 



16
17
18
19
20
 
# File 'lib/iriq/clusterer.rb', line 16

def add(input, shape: nil)
  iri = coerce(input)
  key, host, scheme, derived = Cluster.key_for(iri, classifier: @classifier, shape: shape)
  @storage.add_to_cluster(key, host, scheme, derived, iri)
end

#clusters ⇒ Object 



22
23
24
 
# File 'lib/iriq/clusterer.rb', line 22

def clusters
  @storage.clusters
end

#explain(input) ⇒ Object

Returns a per-segment explanation for the input, merging classifier output with what we've observed in its cluster (i.e. positions that are factually stable get marked variable: false even if classifier would otherwise call them variable).



34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
 
# File 'lib/iriq/clusterer.rb', line 34

def explain(input)
  iri = coerce(input)
  key, * = Cluster.key_for(iri, classifier: @classifier)
  cluster = clusters.find { |c| c.key == key }
  stats   = cluster ? cluster.segment_stats : []
  hinted  = SegmentHints.derive(iri.path_segments, @classifier)

  hinted.each_with_index.map do |entry, i|
    stable = stats[i] && stats[i][:stable]
    entry.merge(
      variable: !stable && entry[:variable],
      stable:   !!stable,
    )
  end
end

#size ⇒ Object 



26
27
28
 
# File 'lib/iriq/clusterer.rb', line 26

def size
  @storage.cluster_size
end