Module: DataDrain

Defined in:

lib/data_drain.rb,
lib/data_drain/engine.rb,
lib/data_drain/errors.rb,
lib/data_drain/record.rb,
lib/data_drain/storage.rb,
lib/data_drain/version.rb,
lib/data_drain/storage/s3.rb,
lib/data_drain/glue_runner.rb,
lib/data_drain/validations.rb,
lib/data_drain/storage/base.rb,
lib/data_drain/configuration.rb,
lib/data_drain/file_ingestor.rb,
lib/data_drain/observability.rb,
lib/data_drain/storage/local.rb,
lib/data_drain/types/json_type.rb,
lib/data_drain/observability/timing.rb

Overview

DSL para extraer, archivar y purgar datos entre PostgreSQL y un Data Lake en Parquet.

Defined Under Namespace

Modules: Observability, Storage, Types, Validations Classes: Configuration, ConfigurationError, Engine, Error, FileIngestor, GlueRunner, IntegrityError, Record, StorageError

Constant Summary

VERSION =

Returns versión semver de la gema.

Returns:

• (String) —

  versión semver de la gema

"0.4.0"

Class Method Summary

• .configuration ⇒ DataDrain::Configuration
• .configure {|config| ... } ⇒ Object
• .reset_configuration! ⇒ void private

Class Method Details

.configuration ⇒ DataDrain::Configuration

Returns:

• (DataDrain::Configuration)

# File 'lib/data_drain.rb', line 24

def configuration
  @configuration ||= Configuration.new
end

.configure {|config| ... } ⇒ Object

Yield Parameters:

• config (DataDrain::Configuration)

# File 'lib/data_drain.rb', line 29

def configure
  yield(configuration)
end

.reset_configuration! ⇒ void

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.

This method returns an undefined value.

# File 'lib/data_drain.rb', line 35

def reset_configuration!
  @configuration = Configuration.new
  DataDrain::Storage.reset_adapter!
end