Class: Maglev::Chunker

Inherits:

Object

Object
Maglev::Chunker

show all

Defined in:: lib/maglev/chunker.rb

Instance Method Summary collapse

#call(text) ⇒ Object
#initialize(max_characters: Maglev.configuration.chunk_size) ⇒ Chunker constructor
A new instance of Chunker.

Constructor Details

#initialize(max_characters: Maglev.configuration.chunk_size) ⇒ `Chunker`

Returns a new instance of Chunker.



5
6
7

# File 'lib/maglev/chunker.rb', line 5

def initialize(max_characters: Maglev.configuration.chunk_size)
  @max_characters = max_characters
end

Instance Method Details

#call(text) ⇒ `Object`



9
10
11

# File 'lib/maglev/chunker.rb', line 9

def call(text)
  text.to_s.split(/\n{2,}/).flat_map { |part| split_part(part.strip) }.reject(&:empty?)
end