Module: DataDrain

Defined in:
lib/data_drain.rb,
lib/data_drain/engine.rb,
lib/data_drain/errors.rb,
lib/data_drain/record.rb,
lib/data_drain/storage.rb,
lib/data_drain/version.rb,
lib/data_drain/storage/s3.rb,
lib/data_drain/glue_runner.rb,
lib/data_drain/validations.rb,
lib/data_drain/storage/base.rb,
lib/data_drain/configuration.rb,
lib/data_drain/file_ingestor.rb,
lib/data_drain/observability.rb,
lib/data_drain/storage/local.rb,
lib/data_drain/types/json_type.rb

Overview

DSL para extraer, archivar y purgar datos entre PostgreSQL y un Data Lake en Parquet.

Defined Under Namespace

Modules: Observability, Storage, Types, Validations Classes: Configuration, ConfigurationError, Engine, Error, FileIngestor, GlueRunner, IntegrityError, Record, StorageError

Constant Summary collapse

VERSION = 
"0.2.1"

Class Method Summary collapse

Class Method Details

.configuration ⇒ DataDrain::Configuration

Returns:



23
24
25
 
# File 'lib/data_drain.rb', line 23

def configuration
  @configuration ||= Configuration.new
end

.configure {|config| ... } ⇒ Object

Yield Parameters:



28
29
30
 
# File 'lib/data_drain.rb', line 28

def configure
  yield(configuration)
end

.reset_configuration! ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future. 



33
34
35
36
 
# File 'lib/data_drain.rb', line 33

def reset_configuration!
  @configuration = Configuration.new
  DataDrain::Storage.reset_adapter!
end