-
Notifications
You must be signed in to change notification settings - Fork 15
/
Copy pathCHANGELOG
313 lines (275 loc) · 10.4 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
Version 1.7.1 (2024-04-26)
--------------------------
Bump sbt-snowplow-release to 0.3.2
Repeater: PubSub ack extensions should match backoff delay (#373)
Version 1.7.0 (2023-11-20)
--------------------------
Set GCP user agent header for BQ and Pubsub (#363)
Version 1.6.8 (2023-10-13)
--------------------------
Create SizeViolation bad row for oversized messages sent to Pubsub (#361)
Bump sbt-snowplow-release to 0.3.1 (#353)
Bump netty to 4.1.100.Final (#362)
Bump org.json to 20231013 (#362)
Version 1.6.7 (2023-08-31)
--------------------------
Bump analytics-sdk to 3.1.0 (#356)
Bump google-cloud-bigquery version (#358)
Version 1.6.6 (2023-08-25)
--------------------------
Ensure docker image has latest openssl version (#351)
Version 1.6.5 (2023-04-03)
--------------------------
Scan Docker images with Snyk in github action (#346)
Streamloader: Ack pubsub messages in parallel (#344)
Stream loader: retry failed insert jobs (#343)
Version 1.6.4 (2023-01-27)
--------------------------
Bump http4s to 0.23.18 (#337)
Remove dropwizard from the config (#341)
Remove loadMode from the config (#339)
Fix benchmarks (#336)
Version 1.6.3 (2023-01-13)
--------------------------
Update copyright notice to 2023 (#333)
Bump sbt-snowplow-release to 0.2.1 (#332)
Bump protobuf-java to 3.21.12 (#331)
Bump netty to 4.1.86.Final (#330)
Remove support for dataflow variant of BigQuery loader (#329)
Bump jackson to 2.14.1 (#328)
Bump http4s to 0.23.17 (#327)
Version 1.6.2 (2022-12-23)
--------------------------
Bump sbt-snowplow-release to 0.2.0 (#325)
Explicitly use UTF-8 charset (#325)
Version 1.6.1 (2022-12-07)
--------------------------
Use sbt-snowplow-release plugin to build docker images (#322)
Repeater: Retry on errors writing to storage (#301)
Streamloader: Retry stopped valid inserts from a failed batch (#320)
Version 1.6.0 (2022-11-28)
--------------------------
Cache Field (#316)
Version 1.5.2 (2022-11-01)
--------------------------
Ensure docker images have latest libexpat version (#314)
Version 1.5.1 (2022-10-04)
--------------------------
Bump scala version to 2.13.9 (#311)
Version 1.5.0 (2022-09-26)
--------------------------
Stream Loader: Add Flow Control (#307)
Version 1.4.3 (2022-09-20)
--------------------------
Bump snakeyaml to 1.32 (#305)
Version 1.4.2 (2022-08-23)
--------------------------
Stream loader: Fix metrics when an insert has no successful rows (#302)
Stream loader: Fix shutdown so it does not hang on exit (#303)
Version 1.4.1 (2022-07-19)
--------------------------
Fix metrics when inserts has some failed rows (#296)
Streamloader: add latency to stdout metrics reporter (#297)
Ensure docker image has latest openssl and libfreetype6 versions (#295)
Version 1.4.0 (2022-06-22)
--------------------------
Bump google-cloud-storage to 2.7.2 (#293)
Bump google-cloud-pubsub to 1.119.0 (#292)
Bump google-cloud-bigquery to 2.13.0 (#291)
Use the http4s iglu registry lookup (#230)
Bump cats effect to 3.3.12 (#290)
Support config files passed on the command line (#282)
Version 1.3.2 (2022-06-13)
--------------------------
Mutator: remove concurrency on table updates (#287)
Version 1.3.1 (2022-06-10)
--------------------------
Pass projectId to BigQuery client (#261)
Loader: Downgrade Guava to 29.0-jre (#286)
Exclude beam-sdks-java-extensions-sql from scio-core and scio-google-cloud-platform (#284)
Exclude jackson-mapper-asl from scio-core and scio-google-cloud-platform (#283)
Version 1.3.0 (2022-05-10)
--------------------------
Bump google-oauth-client to 1.33.3 (#281)
Fix graceful shutdown (#260)
Publish distroless docker images (#279)
Bump sbt-native-packager to 1.9.9 (#278)
Bump jackson-databind to 2.13.2.2 (#275)
Remove explicit version overrides of gson and fast-json (#280)
Bump netty codec to 4.1.76.Final (#271)
Bump scio to 0.11.7 (#270)
Bump google-cloud-bigquery for beam to 2.9.4 (#269)
Bump beam to 2.38.0 (#268)
Bump dropwizard metrics to 4.1.31 (#267)
Bump http4s-async-http-client to 0.22.12 (#266)
Bump google-cloud-storage to 2.6.1 (#265)
Bump google-cloud-pubsub to 1.116.4 (#264)
Bump google-cloud-bigquery to 2.10.10 (#263)
Version 1.2.0 (2022-02-25)
--------------------------
Streamloader: add retrySettings to BigQuery client (#248)
Streamloader: add graceful shutdown (#249)
Change docker base image to eclipse/temurin:11-jre-focal (#251)
Bump scio-core to 0.11.4 (#252)
Bump specs2-core to 4.13.2 (#254)
Bump fs2-google-pubsub-grpc to 0.18.1 (#255)
Bump log4cats-slf4j to 1.5.1 (#256)
Bump schema-ddl to 0.14.4 (#253)
Version 1.1.0 (2022-01-11)
--------------------------
Implement new metrics reporter for stdout (#238)
Repeater: move statistics logs under metrics (#239)
Stream Loader: integrate Sentry (#240)
Repeater: integrate Sentry (#241)
Mutator: integrate Sentry (#242)
Bump log4cats to 1.4.0 (#246)
Mutator: use logger instead of println (#244)
Stream Loader: use logger instead of println (#245)
Extend copyright to 2022 (#243)
Version 1.0.2 (2021-12-17)
--------------------------
Bump scio to 0.11.1 and beam to 2.33.0 (#232)
Bump gson to 2.8.9 (#234)
Beam loader: Pin bigquery sdk to 1.135.3 (#236)
Bump google sdks using google-cloud-bom 0.163.0 (#235)
Version 1.0.1 (2021-10-29)
--------------------------
Use sbt-dynver plugin (#227)
Repeater: change filename logging level to info (#222)
Repeater: fix typos in cli options' help text (#221)
Add monitoring defaults to application.conf (#220)
Bump fs2-google-cloud-pubsub to 0.18.0 (#226)
Bump google-cloud-pubsub to 1.114.3 (#225)
Bump google-cloud-storage to 2.1.1 (#224)
Bump google-cloud-bigquery to 2.1.6 (#223)
Version 1.0.0 (2021-10-06)
--------------------------
Switch from JSON to HOCON in config file (#186)
Make the --config flag optional (#214)
Add load_tstamp field (#140)
Add metrics in StreamLoader and Repeater (#165)
StreamLoader: drop intermediary queue for writing out observed types (#183)
StreamLoader: batch events in BigQuery write request (#192)
Mutator: add table partitioning to create command (#113)
Repeater: fix logging of number of inserted records (#143)
Repeater: remove PayloadParser (#215)
Repeater: make EventContainer codecs isomorphic (#141)
Loader: drop waitUntilDone from runner (#145)
Forwarder: remove from working tree (#121)
Bump schema-ddl to 0.14.2 (#197)
Bump netty-codec version to 4.1.48.Final (#198)
Bump metrics-core to 4.1.25 (#199)
Bump slf4j-simple to 1.7.32 (#200)
Bump cats-core to 2.6.1 (#201)
Bump cats-effect to 2.5.4 (#202)
Bump circe to 0.14.1 (#203)
Bump decline to 1.4.0 (#204)
Bump fs2-core to 2.5.9 (#205)
Bump netty-codec-http version to 4.1.61.Final (#206)
Bump http4s-async-http-client to 0.22.5 (#207)
Bump snowplow-badrows to 2.1.1 (#208)
Bump iglu-scala-client to 1.1.1 (#209)
Bump iglu-core-circe to 1.0.1 (#210)
Bump specs2-core to 4.12.12 (#212)
Bump sbt to 1.5.5 (#213)
Remove scalacheck dependency (#211)
Change base image to adoptopenjdk:8-jre-hotspot-focal (#188)
Publish arm64 and amd64 docker images (#193)
Github action to scan docker image with lacework (#195)
Version 0.6.4 (2021-04-28)
--------------------------
Bump schema-ddl to 0.13.0 (#176)
Bump sbt to 1.5.0 (#175)
Version 0.6.3 (2021-04-01)
--------------------------
Loader: use optimizedWrites (#172)
Add TransformJsonBenchmark, FromEventBenchmark and GroupContextsBenchmark (#162)
Bump iglu-scala-client to 1.0.2 (#163)
Use snowplow/base-debian image from Docker Hub (#164)
Version 0.6.2 (2021-01-27)
--------------------------
Add benchmark module (#148)
Migrate from Travis to Github Actions (#149)
Bump snowplow-scala-analytics-sdk to 2.1.0 (#150)
Bump scio-core to 0.9.6 (#151)
Bump metrics-core to 4.1.17 (#152)
Bump cats-effect to 2.3.1 (#153)
Bump fs2-core to 2.5.0 (#154)
Bump http4s-async-http-client to 0.21.15 (#155)
Extend copyright to 2021 (#158)
Version 0.6.1 (2020-10-08)
--------------------------
Common: do not drop contexts when creating TableRow from enriched event (#136)
Version 0.6.0 (2020-09-28)
--------------------------
Add Snowplow BigQuery StreamLoader (#116)
Fix ignored project id from the config (#104)
Bump Scala to 2.13 (#115)
Bump scio-core to 0.9.4 (#114)
Integrate Snyk (#117)
Common: fix jackson-databind version to 2.9.10.6 (#128)
Common: fix netty-codec version to 4.1.46.Final (#129)
Common: fix netty-codec-http version to 4.1.44.Final (#130)
Common: fix fastjson version to 1.2.69 (#131)
Common: fix google-oauth-client version to 1.31.0 (#132)
Version 0.5.1 (2020-06-08)
--------------------------
Remove LoaderCache.scala (#107)
Version 0.5.0 (2020-05-19)
--------------------------
Loader: replace Scio metrics with Dropwizard metrics (#82)
Remove the launch parameter used to set up GCP labels (#83)
Cache Field.build result (#64)
Repeater: mention life span in statistics logs (#47)
Forwarder: deprecate (#74)
Use sbt-scalafmt plugin (#66)
Re-order dependencies (#69)
Add projectSettings for each module (#70)
Bump sbt to 1.3.10 (#68)
Bump google-cloud-bigquery to 1.111.0 (#92)
Bump slf4j-simple to 1.7.30 (#93)
Bump http4s-async-http-client to 0.20.23 (#94)
Bump snowplow-scala-analytics-sdk to 1.0.0 (#96)
Bump snowplow-badrows to 1.0.0 (#97)
Bump snowplow-processing-manifest to 0.2.0 (#98)
Bump schema-ddl to 0.10.0 (#99)
Bump specs2 to 4.8.0 (#100)
Common: link docs.snowplowanalytics.com website in README (#60)
Version 0.4.2 (2020-04-27)
--------------------------
Repeater: do not set ACL for GCS files (#89)
Version 0.4.1 (2020-04-14)
--------------------------
Repeater: change log messages ERROR level to INFO (#77)
Repeater: improve CPU utilization (#78)
Bump fs2-google-pubsub-http to 0.14.0 (#79)
Version 0.4.0 (2020-03-09)
--------------------------
Loader: add a custom metric to track latency distribution (#55)
Mutator: replace decorateAsJava with JavaConverters in TableReference.scala (#51)
Common: make pattern match in `Adapter.adaptType()` exhaustive (#59)
Bump scio-core to 0.8.2 (#57)
Bump Scala to 2.12.10 (#58)
Version 0.3.0 (2020-02-20)
--------------------------
Add support for GCP labels in dataflow launcher docker image (#41)
Switch Forwarder to using subscription (#15)
Use SerializeJsonRow as FormatFunction in Forwarder (#16)
Bump cats-core to 1.6.1 (#49)
Bump cats-effect to 1.4.0 (#50)
Bump fs2-core to 1.0.5 (#52)
Update README (#43)
Version 0.2.0 (2020-02-11)
--------------------------
Add Snowplow BigQuery Repeater (#20)
Use snowplow-badrows (#33)
Bump Schema DDL to 0.9.0 (#18)
Bump Scala Analytics SDK to 0.4.2 (#21)
Bump Iglu Client to 0.6.2 (#34)
Bump Scio to 0.8.1 (#29)
Bump Scala to 2.12.8 (#35)
Change Travis distribution to Trusty (#37)
Extend copyright to 2020 (#42)
Version 0.1.0 (2018-12-03)
--------------------------
Initial release