Skip to content

Commit ca17ed3

Browse files
authored
Merge pull request #200 from analytically/feature/bzip2
Add bzip2 archive support for unpack parameter
2 parents 06c3d7c + 49b2f2b commit ca17ed3

File tree

9 files changed

+448
-36
lines changed

9 files changed

+448
-36
lines changed

Dockerfile

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,7 @@ FROM ${base_image} AS resource
2424
RUN apk --no-cache add \
2525
tzdata \
2626
ca-certificates \
27+
cmd:bunzip2 \
2728
cmd:unzip \
2829
cmd:tar \
2930
cmd:gunzip

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -154,7 +154,7 @@ Places the following files in the destination:
154154

155155
* `skip_download`: *Optional.* Skip downloading object from S3. Same parameter as source configuration but used to define/override by get. Value needs to be a true/false string.
156156

157-
* `unpack`: *Optional.* If true and the file is an archive (tar, gzipped tar, other gzipped file, or zip), unpack the file. Gzipped tarballs will be both ungzipped and untarred. It is ignored when `get` is running on the initial version.
157+
* `unpack`: *Optional.* If true and the file is an archive (tar, gzipped tar, bzip2 compressed tar, other gzipped file, other bzip2 compressed file, or zip), unpack the file. Gzipped and bzip2 compressed tarballs will be both decompressed and untarred. It is ignored when `get` is running on the initial version.
158158

159159
* `download_tags`: *Optional.* Write object tags to `tags.json`. Value needs to be a true/false string.
160160

@@ -326,4 +326,4 @@ In addition to the required permissions above, the `s3:PutObjectTagging` permiss
326326
### Contributing
327327

328328
Please make all pull requests to the `master` branch and ensure tests pass
329-
locally.
329+
locally.

go.mod

Lines changed: 37 additions & 32 deletions
Original file line numberDiff line numberDiff line change
@@ -5,54 +5,59 @@ go 1.24.0
55
toolchain go1.24.1
66

77
require (
8-
github.com/aws/aws-sdk-go-v2 v1.37.0
9-
github.com/aws/aws-sdk-go-v2/config v1.30.1
10-
github.com/aws/aws-sdk-go-v2/credentials v1.18.1
11-
github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.18.1
12-
github.com/aws/aws-sdk-go-v2/service/s3 v1.85.0
13-
github.com/aws/aws-sdk-go-v2/service/sts v1.35.0
8+
github.com/aws/aws-sdk-go-v2 v1.40.0
9+
github.com/aws/aws-sdk-go-v2/config v1.32.1
10+
github.com/aws/aws-sdk-go-v2/credentials v1.19.1
11+
github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.20.11
12+
github.com/aws/aws-sdk-go-v2/service/s3 v1.92.0
13+
github.com/aws/aws-sdk-go-v2/service/sts v1.41.1
1414
github.com/cppforlife/go-semi-semantic v0.0.0-20160921010311-576b6af77ae4
1515
github.com/fatih/color v1.18.0
1616
github.com/google/uuid v1.6.0
1717
github.com/h2non/filetype v1.1.3
18-
github.com/maxbrunsfeld/counterfeiter/v6 v6.11.3
18+
github.com/maxbrunsfeld/counterfeiter/v6 v6.12.0
1919
github.com/mitchellh/colorstring v0.0.0-20190213212951-d06e56a500db
20-
github.com/onsi/ginkgo/v2 v2.23.3
21-
github.com/onsi/gomega v1.37.0
22-
github.com/vbauerster/mpb/v8 v8.10.2
20+
github.com/onsi/ginkgo/v2 v2.27.2
21+
github.com/onsi/gomega v1.38.2
22+
github.com/vbauerster/mpb/v8 v8.11.2
2323
)
2424

2525
require (
26+
github.com/Masterminds/semver/v3 v3.4.0 // indirect
2627
github.com/VividCortex/ewma v1.2.0 // indirect
2728
github.com/acarl005/stripansi v0.0.0-20180116102854-5a71ef0e047d // indirect
28-
github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream v1.7.0 // indirect
29-
github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.18.0 // indirect
30-
github.com/aws/aws-sdk-go-v2/internal/configsources v1.4.0 // indirect
31-
github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.7.0 // indirect
32-
github.com/aws/aws-sdk-go-v2/internal/ini v1.8.3 // indirect
33-
github.com/aws/aws-sdk-go-v2/internal/v4a v1.4.0 // indirect
34-
github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.13.0 // indirect
35-
github.com/aws/aws-sdk-go-v2/service/internal/checksum v1.8.0 // indirect
36-
github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.13.0 // indirect
37-
github.com/aws/aws-sdk-go-v2/service/internal/s3shared v1.19.0 // indirect
38-
github.com/aws/aws-sdk-go-v2/service/sso v1.26.0 // indirect
39-
github.com/aws/aws-sdk-go-v2/service/ssooidc v1.31.0 // indirect
40-
github.com/aws/smithy-go v1.22.5 // indirect
41-
github.com/go-logr/logr v1.4.2 // indirect
29+
github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream v1.7.3 // indirect
30+
github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.18.14 // indirect
31+
github.com/aws/aws-sdk-go-v2/internal/configsources v1.4.14 // indirect
32+
github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.7.14 // indirect
33+
github.com/aws/aws-sdk-go-v2/internal/ini v1.8.4 // indirect
34+
github.com/aws/aws-sdk-go-v2/internal/v4a v1.4.14 // indirect
35+
github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.13.3 // indirect
36+
github.com/aws/aws-sdk-go-v2/service/internal/checksum v1.9.5 // indirect
37+
github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.13.14 // indirect
38+
github.com/aws/aws-sdk-go-v2/service/internal/s3shared v1.19.14 // indirect
39+
github.com/aws/aws-sdk-go-v2/service/signin v1.0.1 // indirect
40+
github.com/aws/aws-sdk-go-v2/service/sso v1.30.4 // indirect
41+
github.com/aws/aws-sdk-go-v2/service/ssooidc v1.35.9 // indirect
42+
github.com/aws/smithy-go v1.23.2 // indirect
43+
github.com/clipperhouse/stringish v0.1.1 // indirect
44+
github.com/clipperhouse/uax29/v2 v2.3.0 // indirect
45+
github.com/go-logr/logr v1.4.3 // indirect
4246
github.com/go-task/slim-sprig/v3 v3.0.0 // indirect
4347
github.com/google/go-cmp v0.7.0 // indirect
44-
github.com/google/pprof v0.0.0-20241210010833-40e02aabc2ad // indirect
48+
github.com/google/pprof v0.0.0-20251114195745-4902fdda35c8 // indirect
4549
github.com/kr/pretty v0.3.1 // indirect
4650
github.com/mattn/go-colorable v0.1.14 // indirect
4751
github.com/mattn/go-isatty v0.0.20 // indirect
48-
github.com/mattn/go-runewidth v0.0.16 // indirect
52+
github.com/mattn/go-runewidth v0.0.19 // indirect
4953
github.com/onsi/ginkgo v1.2.1-0.20170102031522-a23f924ce96d // indirect
5054
github.com/rivo/uniseg v0.4.7 // indirect
51-
golang.org/x/mod v0.26.0 // indirect
52-
golang.org/x/net v0.42.0 // indirect
53-
golang.org/x/sync v0.16.0 // indirect
54-
golang.org/x/sys v0.34.0 // indirect
55-
golang.org/x/text v0.27.0 // indirect
56-
golang.org/x/tools v0.35.0 // indirect
55+
go.yaml.in/yaml/v3 v3.0.4 // indirect
56+
golang.org/x/mod v0.30.0 // indirect
57+
golang.org/x/net v0.47.0 // indirect
58+
golang.org/x/sync v0.18.0 // indirect
59+
golang.org/x/sys v0.38.0 // indirect
60+
golang.org/x/text v0.31.0 // indirect
61+
golang.org/x/tools v0.39.0 // indirect
5762
gopkg.in/yaml.v3 v3.0.1 // indirect
5863
)

0 commit comments

Comments
 (0)