i uploading s3 using below code:
config = transferconfig(multipart_threshold=1024) transfer= s3transfer(s3_client, config) transfer.upload_file(fileadded, bucket, key,callback=progresspercentage(file))
i couldnt on how internally boto handles multipart upload. have few questions regarding same, lets assume have 2.5 mb file:
- then file uploaded in 3 parts 1, 1 , .5 mb?
- all 3 parts uploaded in parallel or sequential?
- in aws library java have transfermanager, similar thing in boto?
- if code sufficient multi part uploads? because came across complicated code samples same
any appreciated.
your code correct. s3 transfer use config created transfer files. check documentation on transferconfig see parameters can set , defaults.
to answer questions:
- yes
- parallel, using threads
- boto3 uses s3transfer internally, use
transferconfig
- yes
Comments
Post a Comment