Class: Aws::S3::DirectoryUploader::FileProducer Private

Inherits:
Object
  • Object
show all
Includes:
Enumerable
Defined in:
lib/aws-sdk-s3/directory_uploader.rb

This class is part of a private API. You should avoid using this class if possible, as it may be removed or be changed in the future.

Defined Under Namespace

Classes: UploadEntry

Constant Summary collapse

DEFAULT_QUEUE_SIZE =

This constant is part of a private API. You should avoid using this constant if possible, as it may be removed or be changed in the future. 

100
DONE_MARKER =

This constant is part of a private API. You should avoid using this constant if possible, as it may be removed or be changed in the future. 

:done

Instance Method Summary collapse

Constructor Details

#initialize(opts = {}) ⇒ FileProducer

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.

Returns a new instance of FileProducer.



124
125
126
127
128
129
130
131
132
133
134
 
# File 'lib/aws-sdk-s3/directory_uploader.rb', line 124

def initialize(opts = {})
  @directory_uploader = opts[:directory_uploader]
  @source_dir = opts[:source_dir]
  @bucket = opts[:bucket]
  @s3_prefix = opts[:s3_prefix]
  @recursive = opts[:recursive]
  @follow_symlinks = opts[:follow_symlinks]
  @filter_callback = opts[:filter_callback]
  @request_callback = opts[:request_callback]
  @file_queue = SizedQueue.new(DEFAULT_QUEUE_SIZE)
end

Instance Method Details

#close ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future. 



140
141
142
143
 
# File 'lib/aws-sdk-s3/directory_uploader.rb', line 140

def close
  @file_queue.close
  @file_queue.clear
end

#closed? ⇒ Boolean

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.

Returns:

  • (Boolean) 


136
137
138
 
# File 'lib/aws-sdk-s3/directory_uploader.rb', line 136

def closed?
  @file_queue.closed?
end

#each ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future. 



145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
 
# File 'lib/aws-sdk-s3/directory_uploader.rb', line 145

def each
  producer_thread = Thread.new do
    if @recursive
      find_recursively
    else
      find_directly
    end
    @file_queue << DONE_MARKER
  rescue ClosedQueueError
    # abort requested
  rescue StandardError => e
    # encountered a traversal error, we must abort immediately
    close
    raise DirectoryUploadError, "Directory traversal failed for '#{@source_dir}': #{e.message}"
  end

  while (file = @file_queue.shift) && file != DONE_MARKER
    yield file
  end
ensure
  producer_thread.value
end