forked from snowplow/stream-collector
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathCHANGELOG
309 lines (283 loc) · 16 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
Release 2.3.1 (2021-08-12)
--------------------------
Bump pubsub to 2.113.7 (#158)
Bump jackson-databind to 2.10.5.1 on nsq module (#157)
Add cn-northwest-1 to list of custom endpoints (#152)
Bump jackson-dataformat-cbor to 2.11.4 (#155)
Bump snowplow-badrows to 2.1.1 (#154)
Bump libthrift to 0.14.1 (#153)
Release 2.3.0 (2021-05-25)
--------------------------
Add outage protection features to Kinesis, SQS and Pubsub sinks (#132)
Pass Kinesis partitioning key as SQS message attribute (#146)
Fix typo in PubSub sink useragent string (#147)
Use base image from DockerHub (#107)
Attach jar files to Github releases (#108)
Remove Bintray from resolutionRepos (#144)
Bump scopt to 4.0.1 (#143)
Bump pureconfig to 0.15.0 (#142)
Bump jackson-databind to 2.9.10.8 (#141)
Bump json4s-jackson to 3.6.11 (#140)
Bump specs2-core to 4.11.0 (#139)
Bump sbt-scalafmt to 2.4.2 (#138)
Bump sbt-tpolecat to 0.1.17 (#137)
Bump sbt-buildinfo to 0.10.0 (#136)
Bump sbt-assembly to 0.15.0 (#135)
Bump sbt to 1.5.1 (#134)
Add link to Snowplow's public roadmap in README (#145)
Release 2.2.1 (2021-03-26)
--------------------------
Respect SQS batch request limit (#125)
Set network_userid to empty UUID in anonymous mode to prevent collector_payload_format_violation (#126)
Release 2.2.0 (2021-03-08)
--------------------------
Add SQS collector module (#120)
Serve robots.txt file (#109)
Release 2.1.2 (2021-02-18)
--------------------------
Prevent network_userid being captured when SP-Anonymous header is set (#117)
Release 2.1.1 (2021-01-28)
--------------------------
Emit valid bad rows for size violation and generic error (#113)
Extend copyright to 2021 (#114)
Release 2.1.0 (2020-12-11)
--------------------------
Do not set cookie if request has SP-Anonymous header (#90)
Generate BadRow if querystring cannot be parsed (#73)
Don't crash but warn if Kinesis stream and SQS queue don't exist (#100)
Bump sbt to 1.4.4 (#105)
Bump specs2-core to 4.10.5 (#106)
Migrate from Travis to GH actions (#91)
Bump to JDK 11 (#92)
Bump base-debian to 0.2.1 (#72)
Integrate coursier cache action (#93)
Fix assembly merge strategy (#97)
Reorganise imports (#104)
Update copyright to 2020 (#95)
Release 2.0.1 (2020-11-19)
--------------------------
Increase number of Kinesis put retries when surge protection is on (#75)
Bump scalafmt to 2.3.2 (#87)
Bump akka to 2.5.32 (#86)
Bump akka-http to 10.1.12 (#85)
Bump prometheus-simpleclient to 0.9.0 (#82)
Bump config to 1.4.1 (#81)
Bump slf4j to 1.7.30 (#80)
Bump joda-time to 2.10.8 (#79)
Remove scalaz7 dependency (#84)
Remove softwaremill-retry dependency (#83)
Release 2.0.0 (2020-09-15)
--------------------------
Disable default redirect (#64)
Bump vulnerable libs (#56)
Implement surge protection (#57)
Add test for extracting a URL-encoded schema from the querystring (#60)
Add snyk monitor (#52)
Add DockerHub credentials to .travis.yml (#49)
Add travis integration (#59)
Release 1.0.1 (snowplow/snowplow: 119 Tycho Magnetic Anomaly Two) (2020-04-30)
------------------------------------------------------------------------------
Bump to 1.0.1 (snowplow/snowplow#4338)
Add Snowplow Bintray to resolvers (snowplow/snowplow#4326)
Publish Docker image for stdout via Travis (snowplow/snowplow#4333)
Fix config example (snowplow/snowplow#4332)
Fix incompatible jackson dependencies to enable CBOR (snowplow/snowplow#4266)
Release 1.0.0 (snowplow/snowplow: 118 Morgantina) (2020-01-16)
--------------------------------------------------------------
Extend copyright notice to 2020 (snowplow/snowplow#4261)
Bump to 1.0.0 (snowplow/snowplow#4193)
Introduce sbt-scalafmt (snowplow/snowplow#4192)
Bump sbt-buildinfo to 0.9.0 (snowplow/snowplow#4191)
Use sbt-tpolecat (snowplow/snowplow#4190)
Bump sbt-assembly to 0.14.9 (snowplow/snowplow#4189)
Bump specs2 to 4.5.1 (snowplow/snowplow#4188)
Bump pureconfig to 0.11.1 (snowplow/snowplow#4187)
Bump akka to 2.5.19 (snowplow/snowplow#4186)
Bump prometheus-simpleclient to 0.6.0 (snowplow/snowplow#4184)
Bump config to 1.3.4 (snowplow/snowplow#4183)
Bump slf4j to 1.7.26 (snowplow/snowplow#4182)
Bump joda-time to 2.10.2 (snowplow/snowplow#4181)
Bump kafka-clients to 2.2.1 (snowplow/snowplow#4180)
Bump google-cloud-pubsub to 1.78.0 (snowplow/snowplow#4179)
Bump aws-java-sdk to 1.11.573 (snowplow/snowplow#4178)
Integrate the size violation bad row type (snowplow/snowplow#4177)
Bump SBT to 1.3.3 (snowplow/snowplow#4176)
Bump Scala to 2.12.10 (snowplow/snowplow#4175)
Release 0.17.0 (snowplow/snowplow: 117 Biskupin) (2019-12-03)
-------------------------------------------------------------
Publish docker images for scala-stream-collector to DockerHub (#4237)
Allow users to disable the default redirect endpoint (snowplow/snowplow#4211)
Bump Scala version to 2.11.12 (snowplow/snowplow#4206)
Bump akka-http to 10.1.10 (snowplow/snowplow#4185)
Add support for TLS port binding and certificate (snowplow/snowplow#4085)
Remove duplicate section in example hocon config file (snowplow/snowplow#4210)
Bump to 0.17.0 (snowplow/snowplow#4208)
Release 0.16.0 (snowplow/snowplow: 116 Madara Rider) (2019-09-12)
-----------------------------------------------------------------
Add options to configure secure, same-site and http-only for the cookie (snowplow/snowplow#3753)
Allow multiple cookie domains to be used (snowplow/snowplow#3994)
Provide a way to specify custom path mappings (snowplow/snowplow#4087)
Send back a Cache-Control header (snowplow/snowplow#4017)
Add sbt-native-packager and Docker config (snowplow/snowplow#4128)
Bump Akka HTTP to 10.0.15 (snowplow/snowplow#4131)
Bump version to 0.16.0 (snowplow/snowplow#4134)
Release 0.15.0 (snowplow/snowplow: 113 Filitosa) (2019-02-27)
-------------------------------------------------------------
Expose Prometheus metrics (snowplow/snowplow#3421)
Bump kafka client to 2.1.1 (snowplow/snowplow#3981)
Provide a way to add arbitrary Kafka configuration settings (snowplow/snowplow#3968)
Add support for an Access-Control-Max-Age header (snowplow/snowplow#3904)
Allow for the do not track cookie value configuration to be a regex (snowplow/snowplow#3966)
Showcase the usage of env variables in the configuration example (snowplow/snowplow#3971)
Extend copyright notice to 2019 (snowplow/snowplow#3997)
Release 0.14.0 (snowplow/snowplow: 109 Lambaesis) (2018-08-21)
--------------------------------------------------------------
Respect a do not track cookie (snowplow/snowplow#3825)
Add a way to customize the response from the root path (snowplow/snowplow#3670)
Support HEAD requests (snowplow/snowplow#3827)
Allow for multiple domains in crossdomain.xml (snowplow/snowplow#3740)
Allow overriding of the kinesis endpoint url in the configuration (snowplow/snowplow#3846)
Turn BufferConfig's byteLimit and recordLimit into longs (snowplow/snowplow#3807)
Release 0.13.0 (snowplow/snowplow: 101 Neapolis) (2018-03-21)
-------------------------------------------------------------
Add Google Cloud PubSub sink (snowplow/snowplow#3047)
Split into multiple artifacts according to targeted platform (snowplow/snowplow#3621)
Expose number of requests over JMX (snowplow/snowplow#3637)
Move cross domain configuration to enabled-style (snowplow/snowplow#3556)
Truncate events exceeding the configured maximum size into a BadRow (snowplow/snowplow#3587)
Remove string interpolation false positive warnings (snowplow/snowplow#3623)
Update config.hocon.sample to support Google Cloud PubSub (snowplow/snowplow#3049)
Customize useragent for GCP API calls (snowplow/snowplow#3658)
Bump kafka-clients to 1.0.1 (snowplow/snowplow#3660)
Bump aws-java-sdk to 1.11.290 (snowplow/snowplow#3665)
Bump scala-common-enrich to 0.31.0 (snowplow/snowplow#3666)
Bump SBT to 1.1.1 (snowplow/snowplow#3629)
Bump sbt-assembly to 0.14.6 (snowplow/snowplow#3667)
Use sbt-buildinfo (snowplow/snowplow#3626)
Extend copyright notice to 2018 (snowplow/snowplow#3687)
Release 0.12.0 (snowplow/snowplow: 98 Argentomagus) (2018-01-05)
----------------------------------------------------------------
Make Flash access domains and secure configurable (snowplow/snowplow#2915)
Add URL redirect replacement macro (snowplow/snowplow#3491)
Allow use of the originating scheme during cookie bounce (snowplow/snowplow#3512)
Replace Location header with RawHeader to preserve double encoding (snowplow/snowplow#3546)
Bump nsq-java-client to 1.2.0 (snowplow/snowplow#3519)
Document the stdout sink better (snowplow/snowplow#3515)
Fix stdout sink configuration (snowplow/snowplow#3550)
Fix scaladoc for 'ipAndPartitionKey' (snowplow/snowplow#3513)
Release 0.11.0 (snowplow/snowplow: 96 Zeugma) (2017-11-21)
----------------------------------------------------------
Update config.hocon.sample to support NSQ (snowplow/snowplow#3294)
Add NSQ sink (snowplow/snowplow#2093)
Make Kinesis, Kafka and NSQ config a coproduct (snowplow/snowplow#3449)
Keep sending records when the Kinesis stream is resharding (snowplow/snowplow#3453)
Release 0.10.0 (snowplow/snowplow: 93 Virunum) (2017-10-03)
-----------------------------------------------------------
Replace spray by akka-http (snowplow/snowplow#3299)
Replace argot by scopt (snowplow/snowplow#3298)
Add support for cookie bounce (snowplow/snowplow#2697)
Allow raw query params (snowplow/snowplow#3273)
Add support for the Chinese Kinesis endpoint (snowplow/snowplow#3335)
Use the DefaultAWSCredentialsProviderChain for Kinesis Sink (snowplow/snowplow#3245)
Use Kafka callback based API to detect failures to send messages (snowplow/snowplow#3317)
Make Kafka sink more fault tolerant by allowing retries (snowplow/snowplow#3367)
Fix incorrect property used for kafkaProducer.batch.size (snowplow/snowplow#3173)
Configuration decoding with pureconfig (snowplow/snowplow#3318)
Stop making the assembly jar executable (snowplow/snowplow#3410)
Add config dependency (snowplow/snowplow#3326)
Upgrade to Java 8 (snowplow/snowplow#3328)
Bump Scala version to 2.11 (snowplow/snowplow#3311)
Bump SBT to 0.13.16 (snowplow/snowplow#3312)
Bump sbt-assembly to 0.14.5 (snowplow/snowplow#3329)
Bump aws-java-sdk-kinesis to 1.11 (snowplow/snowplow#3310)
Bump kafka-clients to 0.10.2.1 (snowplow/snowplow#3325)
Bump scala-common-enrich to 0.26.0 (snowplow/snowplow#3305)
Bump iglu-scala-client to 0.5.0 (snowplow/snowplow#3309)
Bump specs2-core to 3.9.4 (snowplow/snowplow#3308)
Bump scalaz-core to 7.0.9 (snowplow/snowplow#3307)
Bump joda-time to 2.9 (snowplow/snowplow#3323)
Remove commons-codec dependency (snowplow/snowplow#3324)
Remove snowplow-thrift-raw-event dependency (snowplow/snowplow#3306)
Remove joda-convert dependency (snowplow/snowplow#3304)
Remove mimepull dependency (snowplow/snowplow#3302)
Remove scalazon dependency (snowplow/snowplow#3300)
Run the unit tests systematically in Travis (snowplow/snowplow#3409)
Release 0.9.0 (snowplow/snowplow: 85 Metamorphosis) (2016-11-15)
----------------------------------------------------------------
Add Kafka sink (snowplow/snowplow#2937)
Update config.hocon.sample to support Kafka (snowplow/snowplow#2943)
Move sink.kinesis.buffer to sink.buffer in config.hocon.sample (snowplow/snowplow#2938)
Release 0.8.0 (snowplow/snowplow: 84 Steller's Sea Eagle) (2016-10-07)
----------------------------------------------------------------------
Add scala_ into artifact filename in Bintray (snowplow/snowplow#2843)
Use nuid query parameter value to set the 3rd party network id cookie (snowplow/snowplow#2512)
Configurable cookie path (snowplow/snowplow#2528)
Call Config.resolve() to resolve environment variables in hocon (snowplow/snowplow#2879)
Release 0.7.0 (snowplow/snowplow: 80 Southern Cassowary) (2016-05-30)
---------------------------------------------------------------------
Increase tolerance of timings in tests (snowplow/snowplow#2614)
Send nonempty response to POST requests (snowplow/snowplow#2606)
Crash when unable to find stream instead of hanging (snowplow/snowplow#2583)
Stop using deprecated Config.getMilliseconds method (snowplow/snowplow#2570)
Move example configuration file to examples folder (snowplow/snowplow#2566)
Upgrade the log level for reports of stream nonexistence from INFO to ERROR (snowplow/snowplow#2384)
Crash rather than hanging when unable to bind to the supplied port (snowplow/snowplow#2551)
Bump Spray version to 1.3.3 (snowplow/snowplow#2522)
Bump Scala version to 2.10.5 (snowplow/snowplow#2565)
Fix omitted string interpolation (snowplow/snowplow#2561)
Release 0.6.0 (snowplow/snowplow: 78 Great Hornbill) (2016-03-15)
-----------------------------------------------------------------
Added Scala Common Enrich as a library dependency (snowplow/snowplow#2153)
Added click redirect mode (snowplow/snowplow#549)
Configured the ability to use IP address as partition key (snowplow/snowplow#2331)
Converted bad rows to new format (snowplow/snowplow#2006)
Shared a single thread pool for all writes to Kinesis (snowplow/snowplow#2369)
Specified UTF-8 encoding everywhere (snowplow/snowplow#2147)
Made cookie name customizable, thanks @kazjote! (snowplow/snowplow#2474)
Added boolean collector.cookie.enabled setting (snowplow/snowplow#2488)
Made backoffPolicy fields macros (snowplow/snowplow#2518)
Updated AWS credentials to support iam/env/default not cpf (snowplow/snowplow#1518)
Release 0.5.0 (snowplow/snowplow: 67 Bohemian Waxwing) (2015-07-13)
-------------------------------------------------------------------
Stdout bad sink now prints to stderr (snowplow/snowplow#1799)
Added splitter for large event arrays (snowplow/snowplow#941)
Increased maximum record size from 50kB to 1MB (snowplow/snowplow#1753)
Added tests for splitting large requests (snowplow/snowplow#1683)
Updated bad rows to include timestamp (snowplow/snowplow#1681)
Handled case where IP is not present (snowplow/snowplow#1680)
Did some reorganisation and refactoring of the project (snowplow/snowplow#1678)
Added json4s dependency (snowplow/snowplow#1673)
Added bad stream (snowplow/snowplow#1502)
Release 0.4.0 (snowplow/snowplow: 65 Scarlet Rosefinch) (2015-05-08)
--------------------------------------------------------------------
Bumped Scalazon to 0.11 (snowplow/snowplow#1504)
Added support for PutRecords API (snowplow/snowplow#1227)
Added CORS support (snowplow/snowplow#1165)
Added CORS-style support for ActionScript3 Tracker (snowplow/snowplow#1331)
Added ability to disable third-party cookies (snowplow/snowplow#1363)
Removed automatic creation of stream (snowplow/snowplow#1464)
Added macros to config.hocon.sample (snowplow/snowplow#1471)
Logged the name of the stream to which records are written (snowplow/snowplow#1503)
Added shutdown hook to send stored events (snowplow/snowplow#1535)
Added configurable exponential backoff with jitter (snowplow/snowplow#1592)
Release 0.3.0 (snowplow/snowplow: 60 Bee Hummingbird) (2015-02-03)
------------------------------------------------------------------
Started sending CollectorPayloads instead of SnowplowRawEvents (snowplow/snowplow#1226)
Added support for POST requests (snowplow/snowplow#187)
Added support for any {api-vendor}/{api-version} for GET and POST (snowplow/snowplow#652)
Stopped decoding URLs (snowplow/snowplow#1217)
Changed 1x1 pixel response to use a stable GIF (snowplow/snowplow#1260)
Renamed default.conf to config.hocon.sample (snowplow/snowplow#1243)
Started using ThreadLocal to handle Thrift serialization, thanks @denismo and @pkallos! (snowplow/snowplow#1254)
Added healthcheck for load balancers, thanks @duncan! (snowplow/snowplow#1360)
Release 0.2.0 (snowplow/snowplow: 0.9.12) (2014-11-26)
------------------------------------------------------
Changed organization to "com.snowplowanalytics" (snowplow/snowplow#1168)
Made the --config option mandatory (snowplow/snowplow#1128)
Added ability to set AWS credentials from environment variables (snowplow/snowplow#1116)
Now enforcing Java 7 for compilation (snowplow/snowplow#1068)
Increased request character limit to 32768 (snowplow/snowplow#987)
Improved performance by using Future, thanks @pkallos! (snowplow/snowplow#580)
Scala Stream Collector, Scala Kinesis Enrich: made endpoint configurable, thanks @sambo1972! (snowplow/snowplow#978)
Scala Stream Collector, Scala Kinesis Enrich: added support for IAM roles, thanks @pkallos! (snowplow/snowplow#534)
Scala Stream Collector, Scala Kinesis Enrich: replaced stream list with describe to tighten permissions, thanks @pkallos! (snowplow/snowplow#535)