Browsertrix Cloud v1.7.0

Deployment

This release can be deployed with Helm by running:

helm upgrade --install btrix https://github.com/webrecorder/browsertrix-cloud/releases/download/v1.7.0/browsertrix-cloud-v1.7.0.tgz

See the development guide for more info how to deploy Browsertrix Cloud.

What's Changed

• Add and enforce org maxPagesPerCrawl quota by @tw4l in #1044
• ingress: minor tweaks to ingress to update to latest spec: by @ikreymer in #1096
• Use Shared Services for Crawling, Redis, Profile Browsers by @ikreymer in #1088
• feat: implement collections array with names for archived item details by @Chickensoupwithrice in #1098
• 1.6.3 Fixes - Fix sort order for Latest Crawl + 'Remove From Collection' action menu on archived items in collections by @ikreymer in #1113
• Add max crawl size option to backend and frontend by @tw4l in #1045
• dev: GitHub Issue form update: updates "user story" title by @Shrinks99 in #1112
• Add support for collectionIds to archived item PATCH endpoints by @tw4l in #1121
• publish helm chart on release (fixes #1114) (#1117) by @ikreymer in #1123
• Fix unsetting all collections via PATCH update by @tw4l in #1126
• Add event webhook notifications system to backend by @tw4l in #1061
• fix: Terminology unification "crawls" & "archive data" → "items" by @Shrinks99 in #1127
• fix: add "v" to helm chart release filename by @Chickensoupwithrice in #1141
• feat: init k3s ansible playbook by @Chickensoupwithrice in #1071
• Manage collection from archived item details by @SuaYoo in #1085
• supports overriding the replayweb.page version without having to be r… by @ikreymer in #1122
• Use base10 for sizes in frontend by @tw4l in #1133
• Fix too many request errors in UI by @SuaYoo in #1130
• null check: check before accessing config in 'get_all_crawl_search_values' by @ikreymer in #1144
• fix: "crawls" → "items" in collection add component by @Shrinks99 in #1145
• Better Resource settings per number of browsers by @ikreymer in #1103
• chart: move minio credentials to separate secret by @ikreymer in #1143
• Print crawl log to operator log (mostly for testing) by @ikreymer in #1148
• Add operator logs to nightly tests by @tw4l in #1150
• Add and enforce org storage quota by @tw4l in #1106
• ingress: simplify ingress config: (fixes #1135) by @ikreymer in #1146
• Fix 0015 migration by @ikreymer in #1154
• feat: add SMTP {port, use_tls} config by @Chickensoupwithrice in #1142
• Operator refactor to control pods + pvcs directly instead of statefulsets by @ikreymer in #1149
• Issue all non-upload storage-quota-update events from LiteElement by @tw4l in #1151
• Scheduled Crawl Refactor: Handle via Operator + Add Skipped Crawls on Quota Reached by @ikreymer in #1162
• Expect that crawl deleted response is bool, not int by @tw4l in #1170
• Add event webhook tests by @tw4l in #1155
• Make improvements to reset command by @tw4l in #1160
• type fix: ensure max crawl size and max crawl timeout values are set to 0 instead of null by @ikreymer in #1167
• Fix crawl scope help text by @SuaYoo in #1169
• Refactor / Cleanup: move ops functions back into classes by @ikreymer in #1171
• Improved type checking for backend with mypy by @ikreymer in #1174
• Increase wait to 30 seconds to ensure webhooks are sent by @tw4l in #1173
• Rename "Production" to "Remote" by @Chickensoupwithrice in #1105
• Enable saving individual collection form sections by @SuaYoo in #1166
• Implement sync streaming for finished crawl logs by @tw4l in #1168
• Reset crawl state to running when any crawlers are running (after post-process states) by @ikreymer in #1179
• version: bump RWP version to 1.8.12 by @ikreymer in #1181
• Remove config from list endpoints to speed up responses by @tw4l in #1193
• Call runNow when editing a crawlConfig by @Chickensoupwithrice in #1200
• Add org metrics API endpoint by @tw4l in #1196
• Separate "run now" switch from scheduling options by @SuaYoo in #1175
• New org home page dashboard by @SuaYoo in #1201
• Always display Download Logs button in crawl Logs tab by @tw4l in #1209
• Track bytes stored per file type and include in org metrics by @tw4l in #1207
• Small Microk8s Ansible Fixes by @Chickensoupwithrice in #1189
• default page limit: set limit to 50k pages by default by @ikreymer in #1211
• Limit Exclusion Matching to first page, add pagination by @ikreymer in #1214
• Show org storage quotas in dashboard by @SuaYoo in #1210
• Move DO ansible playbook to new format by @Chickensoupwithrice in #1159
• Remove username lookups for crawls and workflows by storing usernames in db by @tw4l in #1199
• Passthrough x-forwarded-proto header in frontend nginx by @vnznznz in #1226
• Recalculate Organization.storedBytes in migration 0017 by @tw4l in #1220
• migration improvements: by @ikreymer in #1228
• fix: Right Align Copy Buttons & <btrix-desc-list> vertical width: 100% by @Shrinks99 in #1177
• Disable smtp_use_tls with false instead of empty string by @vnznznz in #1184
• optimization: convert all uses of 'async for' to use iterator directly by @ikreymer in #1229
• improvements to redis pod: by @ikreymer in #1219
• Fix: Stream log downloading from WACZ by @Chickensoupwithrice in #1225
• "Add new" dialog for all resources by @SuaYoo in #1202
• Fix: Make Collections Public on Creation by @Chickensoupwithrice in #1213
• Separate seeds into a new endpoints by @SuaYoo in #1217
• Show storage meter even with no quota by @SuaYoo in #1240
• feat: use is_bool to check EMAIL_SMTP_USE_TLS by @Chickensoupwithrice in #1231
• Show running workflow error logs by @SuaYoo in #1224
• API delete endpoint improvements by @tw4l in #1232
• Update local dev docs by @SuaYoo in #1246
• Add --failOnFailedSeed checkbox to URL list workflows by @tw4l in #1236
• Require that all passwords are between 8 and 64 characters by @tw4l in #1239
• Browser Profile Warning & Dialog Style Updates by @Shrinks99 in #1243
• Limit URL list entry to maximum URLs by @SuaYoo in #1242
• Fix frontend not redirecting on 401 by @SuaYoo in #1244
• Track pod resource usage, detect OOM crashes, handle auto-scaling by @ikreymer in #1235
• Fix regression with adding crawl to workflow by @tw4l in #1254
• Compute crawl execution time in operator by @ikreymer in #1256
• Storage Ops Refactor by @ikreymer in #1257
• Add slugs to org backend by @tw4l in #1250
• Allow users to change display name and email by @SuaYoo in #1265
• Storage ops followup type checking by @ikreymer in #1274
• Refactor microk8s playbook to follow "new" structure by @Chickensoupwithrice in #1264
• Enforce strong passwords in UI by @SuaYoo in #1266
• Show storage values for each item type when no quota by @SuaYoo in #1260
• Minor Workflow Creator UX Changes by @Shrinks99 in #1267
• Allow org admins to update slug by @SuaYoo in #1276
• Add id-slug lookup and restrict slugs endpoints to superadmins by @tw4l in #1279
• Add down command to uninstall and delete data by @tw4l in #1285
• Set log download attachment name to crawl_id-logs.jsonl by @tw4l in #1280
• Disable collection share button actions for viewer users by @Shrinks99 in #1282
• webhook tweak: pass oid to crawl finished and upload finished webhooks by @ikreymer in #1287
• optimization: avoid updating whole org when only need to set one field by @ikreymer in #1288
• operator status typo fix: by @ikreymer in #1293
• Update org custom URL label by @SuaYoo in #1292
• ansible microk8s additional cleanup by @ikreymer in #1295
• Adds missing user documentation for launch! by @Shrinks99 in #1286

Full Changelog: v1.6.4...v1.7.0