Class: Mammoth::Sources::Postgres

Inherits:
Object
  • Object
show all
Defined in:
lib/mammoth/sources/postgres.rb

Overview

Concrete PostgreSQL CDC source for Mammoth.

Postgres realizes the CDC Ecosystem libraries for Mammoth's product boundary. It composes pgoutput-client, pgoutput-parser, pgoutput-decoder, and pgoutput-source-adapter into a single source that yields CDC::Core-shaped work to the delivery runtime.

This class may mention pgoutput implementation details because it is the concrete PostgreSQL source adapter used by Mammoth. The rest of Mammoth should remain source-agnostic and consume only the work yielded here. rubocop:disable Metrics/ClassLength

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(config, runner: nil, parser: nil, decoder: nil, adapter: nil, checkpoint_store: nil) ⇒ Postgres

Build a PostgreSQL CDC source.

Parameters:

  • config (Mammoth::Configuration) —

    loaded configuration

  • runner (#start, nil) (defaults to: nil) —

    injected pgoutput-client runner

  • parser (Object, nil) (defaults to: nil) —

    injected pgoutput parser or relation tracker

  • decoder (Object, nil) (defaults to: nil) —

    injected pgoutput decoder

  • adapter (Object, nil) (defaults to: nil) —

    injected source adapter

  • checkpoint_store (Mammoth::CheckpointStore, nil) (defaults to: nil) —

    persisted checkpoints for restart resume



39
40
41
42
43
44
45
46
 
# File 'lib/mammoth/sources/postgres.rb', line 39

def initialize(config, runner: nil, parser: nil, decoder: nil, adapter: nil, checkpoint_store: nil)
  @config = config
  @runner = runner
  @parser = parser
  @decoder = decoder
  @adapter = adapter
  @checkpoint_store = checkpoint_store
end

Instance Attribute Details

#adapter ⇒ Object? (readonly)

Returns injected CDC source adapter.

Returns:

  • (Object, nil) —

    injected CDC source adapter



27
28
29
 
# File 'lib/mammoth/sources/postgres.rb', line 27

def adapter
  @adapter
end

#checkpoint_store ⇒ Mammoth::CheckpointStore? (readonly)

Returns checkpoint store used for restart resume.

Returns:



29
30
31
 
# File 'lib/mammoth/sources/postgres.rb', line 29

def checkpoint_store
  @checkpoint_store
end

#config ⇒ Mammoth::Configuration (readonly)

Returns loaded Mammoth configuration.

Returns:



19
20
21
 
# File 'lib/mammoth/sources/postgres.rb', line 19

def config
  @config
end

#decoder ⇒ Object? (readonly)

Returns injected pgoutput decoder.

Returns:

  • (Object, nil) —

    injected pgoutput decoder



25
26
27
 
# File 'lib/mammoth/sources/postgres.rb', line 25

def decoder
  @decoder
end

#parser ⇒ Object? (readonly)

Returns injected pgoutput protocol parser.

Returns:

  • (Object, nil) —

    injected pgoutput protocol parser



23
24
25
 
# File 'lib/mammoth/sources/postgres.rb', line 23

def parser
  @parser
end

#runner ⇒ #start? (readonly)

Returns injected pgoutput-client runner.

Returns:

  • (#start, nil) —

    injected pgoutput-client runner



21
22
23
 
# File 'lib/mammoth/sources/postgres.rb', line 21

def runner
  @runner
end

Instance Method Details

#each {|work| ... } ⇒ Enumerator?

Stream CDC::Core-shaped work from PostgreSQL logical replication.

Calling this method starts the injected or configured pgoutput-client runner. The runner owns the PostgreSQL replication connection and slot lifecycle; this class only composes the parser, decoder, and adapter libraries around the stream.

Yield Parameters:

  • work (Object) —

    CDC::Core::ChangeEvent or TransactionEnvelope

Returns:

  • (Enumerator, nil)

Raises:



58
59
60
61
62
63
64
65
66
67
68
69
 
# File 'lib/mammoth/sources/postgres.rb', line 58

def each(&block)
  return enum_for(:each) unless block_given?

  effective_runner.start do |payload, metadata = nil|
    process_payload(payload, metadata, &block)
  end
  nil
rescue StandardError => e
  raise e if e.is_a?(ReplicationError)

  raise ReplicationError, "PostgreSQL CDC source failed: #{e.message}"
end