Class: SimpleFlow::ParallelExecutor

Inherits:
Object
  • Object
show all
Defined in:
lib/simple_flow/parallel_executor.rb

Overview

ParallelExecutor handles parallel execution of steps. Uses the async gem for fiber-based concurrency if available, falls back to Ruby threads otherwise.

Class Method Summary collapse

Class Method Details

.async_available? ⇒ Boolean

Check if async is available

Returns:

  • (Boolean) 


76
77
78
 
# File 'lib/simple_flow/parallel_executor.rb', line 76

def self.async_available?
  ASYNC_AVAILABLE
end

.execute_parallel(steps, result, concurrency: :auto, max_concurrent: nil) ⇒ Array<Result>

Execute a group of steps in parallel

Parameters:

  • steps (Array<Proc>) —

    array of callable steps

  • result (Result) —

    the input result

  • concurrency (Symbol) (defaults to: :auto) —

    concurrency model (:auto, :threads, :async)

Returns:

  • (Array<Result>) —

    array of results from each step



24
25
26
27
28
29
30
31
32
33
34
35
36
37
 
# File 'lib/simple_flow/parallel_executor.rb', line 24

def self.execute_parallel(steps, result, concurrency: :auto, max_concurrent: nil)
  case concurrency
  when :auto
    ASYNC_AVAILABLE ? execute_with_async(steps, result, max_concurrent: max_concurrent)
                    : execute_with_threads(steps, result)
  when :threads
    execute_with_threads(steps, result)
  when :async
    raise ArgumentError, "Async gem not available" unless ASYNC_AVAILABLE
    execute_with_async(steps, result, max_concurrent: max_concurrent)
  else
    raise ArgumentError, "Invalid concurrency option: #{concurrency.inspect}"
  end
end

.execute_with_async(steps, result, max_concurrent: nil) ⇒ Array<Result>

Execute steps with async gem (fiber-based concurrency)

Parameters:

  • steps (Array<Proc>) —

    array of callable steps

  • result (Result) —

    the input result

Returns:

  • (Array<Result>) —

    array of results from each step



43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
 
# File 'lib/simple_flow/parallel_executor.rb', line 43

def self.execute_with_async(steps, result, max_concurrent: nil)
  results = []

  Async do
    semaphore = max_concurrent ? Async::Semaphore.new(max_concurrent) : nil
    barrier   = Async::Barrier.new(parent: semaphore)
    tasks     = []

    steps.each do |step|
      tasks << barrier.async { step.call(result) }
    end

    barrier.wait
    results = tasks.map(&:result)
  end

  results
end

.execute_with_threads(steps, result) ⇒ Array<Result>

Execute steps with Ruby threads (fallback for true parallelism)

Parameters:

  • steps (Array<Proc>) —

    array of callable steps

  • result (Result) —

    the input result

Returns:

  • (Array<Result>) —

    array of results from each step



66
67
68
69
70
71
72
 
# File 'lib/simple_flow/parallel_executor.rb', line 66

def self.execute_with_threads(steps, result)
  threads = steps.map do |step|
    Thread.new { step.call(result) }
  end

  threads.map(&:value)
end