Browsertrix Cloud 1.8.0 Beta 0

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.8.0-beta.0/browsertrix-cloud-v1.8.0-beta.0.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Use org slug in place of UUIDs in app URLs by @SuaYoo in #1277
• User refactor + remove fastapi_users dependency + update fastapi by @ikreymer in #1290
• Make URLs in the settings viewer clickable, removes deeplinked titles by @Shrinks99 in #1247
• avoid exception if 'errors' key doesn't exist by @ikreymer in #1301
• Update README features link to new landing site by @tw4l in #1302
• Update user names in crawls and workflows after username update by @tw4l in #1299
• Prevent user from logging in after 5 consecutive failed login attempts until pw is reset by @tw4l in #1281
• Update tag spacing and styling for remove button by @Shrinks99 in #1283
• Display crawl time usage history table by @SuaYoo in #1304
• Provide full resources in archived items finished webhooks by @tw4l in #1308

Full Changelog: v1.7.0...v1.8.0-beta.0

Browsertrix Cloud v1.7.1

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.7.1/browsertrix-cloud-v1.7.1.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• avoid exception if 'errors' key doesn't exist (for 1.7.1 release) by @ikreymer in #1300

Full Changelog: v1.7.0...v1.7.1

Browsertrix Cloud v1.7.0

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.7.0/browsertrix-cloud-v1.7.0.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Add and enforce org maxPagesPerCrawl quota by @tw4l in #1044
• ingress: minor tweaks to ingress to update to latest spec: by @ikreymer in #1096
• Use Shared Services for Crawling, Redis, Profile Browsers by @ikreymer in #1088
• feat: implement collections array with names for archived item details by @Chickensoupwithrice in #1098
• 1.6.3 Fixes - Fix sort order for Latest Crawl + 'Remove From Collection' action menu on archived items in collections by @ikreymer in #1113
• Add max crawl size option to backend and frontend by @tw4l in #1045
• dev: GitHub Issue form update: updates "user story" title by @Shrinks99 in #1112
• Add support for collectionIds to archived item PATCH endpoints by @tw4l in #1121
• publish helm chart on release (fixes #1114) (#1117) by @ikreymer in #1123
• Fix unsetting all collections via PATCH update by @tw4l in #1126
• Add event webhook notifications system to backend by @tw4l in #1061
• fix: Terminology unification "crawls" & "archive data" → "items" by @Shrinks99 in #1127
• fix: add "v" to helm chart release filename by @Chickensoupwithrice in #1141
• feat: init k3s ansible playbook by @Chickensoupwithrice in #1071
• Manage collection from archived item details by @SuaYoo in #1085
• supports overriding the replayweb.page version without having to be r… by @ikreymer in #1122
• Use base10 for sizes in frontend by @tw4l in #1133
• Fix too many request errors in UI by @SuaYoo in #1130
• null check: check before accessing config in 'get_all_crawl_search_values' by @ikreymer in #1144
• fix: "crawls" → "items" in collection add component by @Shrinks99 in #1145
• Better Resource settings per number of browsers by @ikreymer in #1103
• chart: move minio credentials to separate secret by @ikreymer in #1143
• Print crawl log to operator log (mostly for testing) by @ikreymer in #1148
• Add operator logs to nightly tests by @tw4l in #1150
• Add and enforce org storage quota by @tw4l in #1106
• ingress: simplify ingress config: (fixes #1135) by @ikreymer in #1146
• Fix 0015 migration by @ikreymer in #1154
• feat: add SMTP {port, use_tls} config by @Chickensoupwithrice in #1142
• Operator refactor to control pods + pvcs directly instead of statefulsets by @ikreymer in #1149
• Issue all non-upload storage-quota-update events from LiteElement by @tw4l in #1151
• Scheduled Crawl Refactor: Handle via Operator + Add Skipped Crawls on Quota Reached by @ikreymer in #1162
• Expect that crawl deleted response is bool, not int by @tw4l in #1170
• Add event webhook tests by @tw4l in #1155
• Make improvements to reset command by @tw4l in #1160
• type fix: ensure max crawl size and max crawl timeout values are set to 0 instead of null by @ikreymer in #1167
• Fix crawl scope help text by @SuaYoo in #1169
• Refactor / Cleanup: move ops functions back into classes by @ikreymer in #1171
• Improved type checking for backend with mypy by @ikreymer in #1174
• Increase wait to 30 seconds to ensure webhooks are sent by @tw4l in #1173
• Rename "Production" to "Remote" by @Chickensoupwithrice in #1105
• Enable saving individual collection form sections by @SuaYoo in #1166
• Implement sync streaming for finished crawl logs by @tw4l in #1168
• Reset crawl state to running when any crawlers are running (after post-process states) by @ikreymer in #1179
• version: bump RWP version to 1.8.12 by @ikreymer in #1181
• Remove config from list endpoints to speed up responses by @tw4l in #1193
• Call runNow when editing a crawlConfig by @Chickensoupwithrice in #1200
• Add org metrics API endpoint by @tw4l in #1196
• Separate "run now" switch from scheduling options by @SuaYoo in #1175
• New org home page dashboard by @SuaYoo in #1201
• Always display Download Logs button in crawl Logs tab by @tw4l in #1209
• Track bytes stored per file type and include in org metrics by @tw4l in #1207
• Small Microk8s Ansible Fixes by @Chickensoupwithrice in #1189
• default page limit: set limit to 50k pages by default by @ikreymer in #1211
• Limit Exclusion Matching to first page, add pagination by @ikreymer in #1214
• Show org storage quotas in dashboard by @SuaYoo in #1210
• Move DO ansible playbook to new format by @Chickensoupwithrice in #1159
• Remove username lookups for crawls and workflows by storing usernames in db by @tw4l in #1199
• Passthrough x-forwarded-proto header in frontend nginx by @vnznznz in #1226
• Recalculate Organization.storedBytes in migration 0017 by @tw4l in #1220
• migration improvements: by @ikreymer in #1228
• fix: Right Align Copy Buttons & <btrix-desc-list> vertical width: 100% by @Shrinks99 in #1177
• Disable smtp_use_tls with false instead of empty string by @vnznznz in #1184
• optimization: convert all uses of 'async for' to use iterator directly by @ikreymer in #1229
• improvements to redis pod: by @ikreymer in #1219
• Fix: Stream log downloading from WACZ by @Chickensoupwithrice in #1225
• "Add new" dialog for all resources by @SuaYoo in #1202
• Fix: Make Collections Public on Creation by @Chickensoupwithrice in #1213
• Separate seeds into a new endpoints by @SuaYoo in #1217
• Show storage meter even with no quota by @SuaYoo in #1240
• feat: use is_bool to check EMAIL_SMTP_USE_TLS by @Chickensoupwithrice in #1231
• Show running workflow error logs by @SuaYoo in #1224
• API delete endpoint improvements by @tw4l in #1232
• Update local dev docs by @SuaYoo in #1246
• Add --failOnFailedSeed checkbox to URL list workflows by @tw4l in #1236
• Require that all passwords are between 8 and 64 characters by @tw4l in #1239
• Browser Profile Warning & Dialog Style Updates by @Shrinks99 in https...

Browsertrix Cloud v1.7.0 Beta 3

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.7.0-beta.3/browsertrix-cloud-v1.7.0-beta.3.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Compute crawl execution time in operator by @ikreymer in #1256
• Storage Ops Refactor by @ikreymer in #1257
• Add slugs to org backend by @tw4l in #1250
• Allow users to change display name and email by @SuaYoo in #1265
• Storage ops followup type checking by @ikreymer in #1274
• Refactor microk8s playbook to follow "new" structure by @Chickensoupwithrice in #1264
• Enforce strong passwords in UI by @SuaYoo in #1266
• Show storage values for each item type when no quota by @SuaYoo in #1260
• Minor Workflow Creator UX Changes by @Shrinks99 in #1267
• Allow org admins to update slug by @SuaYoo in #1276
• Add id-slug lookup and restrict slugs endpoints to superadmins by @tw4l in #1279
• Add down command to uninstall and delete data by @tw4l in #1285
• Set log download attachment name to crawl_id-logs.jsonl by @tw4l in #1280
• Disable collection share button actions for viewer users by @Shrinks99 in #1282
• webhook tweak: pass oid to crawl finished and upload finished webhooks by @ikreymer in #1287
• optimization: avoid updating whole org when only need to set one field by @ikreymer in #1288

Full Changelog: v1.7.0-beta.2...v1.7.0-beta.3

Browsertrix Cloud 1.7.0 Beta 2

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.7.0-beta.2/browsertrix-cloud-v1.7.0-beta.2.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Track pod resource usage, detect OOM crashes, handle auto-scaling by @ikreymer in #1235
• Fix regression with adding crawl to workflow by @tw4l in #1254

Full Changelog: v1.7.0-beta.1...v1.7.0-beta.2

Browsertrix Cloud v1.7.0 Beta 1

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.7.0-beta.1/browsertrix-cloud-v1.7.0-beta.1.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Remove config from list endpoints to speed up responses by @tw4l in #1193
• Call runNow when editing a crawlConfig by @Chickensoupwithrice in #1200
• Add org metrics API endpoint by @tw4l in #1196
• Separate "run now" switch from scheduling options by @SuaYoo in #1175
• New org home page dashboard by @SuaYoo in #1201
• Always display Download Logs button in crawl Logs tab by @tw4l in #1209
• Track bytes stored per file type and include in org metrics by @tw4l in #1207
• Small Microk8s Ansible Fixes by @Chickensoupwithrice in #1189
• default page limit: set limit to 50k pages by default by @ikreymer in #1211
• Limit Exclusion Matching to first page, add pagination by @ikreymer in #1214
• Show org storage quotas in dashboard by @SuaYoo in #1210
• Move DO ansible playbook to new format by @Chickensoupwithrice in #1159
• Remove username lookups for crawls and workflows by storing usernames in db by @tw4l in #1199
• Passthrough x-forwarded-proto header in frontend nginx by @vnznznz in #1226
• Recalculate Organization.storedBytes in migration 0017 by @tw4l in #1220
• migration improvements: by @ikreymer in #1228
• fix: Right Align Copy Buttons & <btrix-desc-list> vertical width: 100% by @Shrinks99 in #1177
• Disable smtp_use_tls with false instead of empty string by @vnznznz in #1184
• optimization: convert all uses of 'async for' to use iterator directly by @ikreymer in #1229
• improvements to redis pod: by @ikreymer in #1219
• Fix: Stream log downloading from WACZ by @Chickensoupwithrice in #1225
• "Add new" dialog for all resources by @SuaYoo in #1202
• Fix: Make Collections Public on Creation by @Chickensoupwithrice in #1213
• Separate seeds into a new endpoints by @SuaYoo in #1217
• Show storage meter even with no quota by @SuaYoo in #1240
• feat: use is_bool to check EMAIL_SMTP_USE_TLS by @Chickensoupwithrice in #1231
• Show running workflow error logs by @SuaYoo in #1224
• API delete endpoint improvements by @tw4l in #1232
• Update local dev docs by @SuaYoo in #1246
• Add --failOnFailedSeed checkbox to URL list workflows by @tw4l in #1236
• Require that all passwords are between 8 and 64 characters by @tw4l in #1239
• Browser Profile Warning & Dialog Style Updates by @Shrinks99 in #1243
• Limit URL list entry to maximum URLs by @SuaYoo in #1242
• Fix frontend not redirecting on 401 by @SuaYoo in #1244

Full Changelog: v1.7.0-beta.0...v1.7.0-beta.1

Browsertrix Cloud 1.7.0 Beta 0

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.7.0-beta.0/browsertrix-cloud-v1.7.0-beta.0.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Add and enforce org maxPagesPerCrawl quota by @tw4l in #1044
• ingress: minor tweaks to ingress to update to latest spec: by @ikreymer in #1096
• Use Shared Services for Crawling, Redis, Profile Browsers by @ikreymer in #1088
• feat: implement collections array with names for archived item details by @Chickensoupwithrice in #1098
• 1.6.3 Fixes - Fix sort order for Latest Crawl + 'Remove From Collection' action menu on archived items in collections by @ikreymer in #1113
• Add max crawl size option to backend and frontend by @tw4l in #1045
• dev: GitHub Issue form update: updates "user story" title by @Shrinks99 in #1112
• Add support for collectionIds to archived item PATCH endpoints by @tw4l in #1121
• publish helm chart on release (fixes #1114) (#1117) by @ikreymer in #1123
• Fix unsetting all collections via PATCH update by @tw4l in #1126
• Add event webhook notifications system to backend by @tw4l in #1061
• fix: Terminology unification "crawls" & "archive data" → "items" by @Shrinks99 in #1127
• fix: add "v" to helm chart release filename by @Chickensoupwithrice in #1141
• feat: init k3s ansible playbook by @Chickensoupwithrice in #1071
• Manage collection from archived item details by @SuaYoo in #1085
• supports overriding the replayweb.page version without having to be r… by @ikreymer in #1122
• Use base10 for sizes in frontend by @tw4l in #1133
• Fix too many request errors in UI by @SuaYoo in #1130
• null check: check before accessing config in 'get_all_crawl_search_values' by @ikreymer in #1144
• fix: "crawls" → "items" in collection add component by @Shrinks99 in #1145
• Better Resource settings per number of browsers by @ikreymer in #1103
• chart: move minio credentials to separate secret by @ikreymer in #1143
• Print crawl log to operator log (mostly for testing) by @ikreymer in #1148
• Add operator logs to nightly tests by @tw4l in #1150
• Add and enforce org storage quota by @tw4l in #1106
• ingress: simplify ingress config: (fixes #1135) by @ikreymer in #1146
• Fix 0015 migration by @ikreymer in #1154
• feat: add SMTP {port, use_tls} config by @Chickensoupwithrice in #1142
• Operator refactor to control pods + pvcs directly instead of statefulsets by @ikreymer in #1149
• Issue all non-upload storage-quota-update events from LiteElement by @tw4l in #1151
• Scheduled Crawl Refactor: Handle via Operator + Add Skipped Crawls on Quota Reached by @ikreymer in #1162
• Expect that crawl deleted response is bool, not int by @tw4l in #1170
• Add event webhook tests by @tw4l in #1155
• Make improvements to reset command by @tw4l in #1160
• type fix: ensure max crawl size and max crawl timeout values are set to 0 instead of null by @ikreymer in #1167
• Fix crawl scope help text by @SuaYoo in #1169
• Refactor / Cleanup: move ops functions back into classes by @ikreymer in #1171
• Improved type checking for backend with mypy by @ikreymer in #1174
• Increase wait to 30 seconds to ensure webhooks are sent by @tw4l in #1173
• Rename "Production" to "Remote" by @Chickensoupwithrice in #1105
• Enable saving individual collection form sections by @SuaYoo in #1166
• Implement sync streaming for finished crawl logs by @tw4l in #1168
• Reset crawl state to running when any crawlers are running (after post-process states) by @ikreymer in #1179
• version: bump RWP version to 1.8.12 by @ikreymer in #1181

Full Changelog: v1.6.2...v1.7.0-beta.0

Browsertrix Cloud 1.6.4

Helm charts now published for each release starting with 1.6.4

What's Changed

• publish helm chart on release (fixes #1114) by @ikreymer in #1117

Full Changelog: v1.6.3...v1.6.4

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.6.4/browsertrix-cloud-v1.6.4.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

Browsertrix Cloud 1.6.4 Beta 0

Test publishing helm chart as part of release

What's Changed

• publish helm chart on release (fixes #1114) by @ikreymer in #1117

Full Changelog: v1.6.3...v1.6.4-beta.0

Browsertrix Cloud 1.6.3

Bug fix release

What's Changed

• Fix sorting by 'Latest Crawl': by @ikreymer in #1109
• Fix missing menu for archived items in collection, add 'Remove Collection' by @SuaYoo in #1110

Full Changelog: v1.6.2...v1.6.3