Add and update MEI_time_series_visualization script #4197
Community-TC Integration / bugbug http service tests
succeeded
May 25, 2024 in 5m 19s
Community-TC (pull_request)
bugbug http service tests
Details
View task in Taskcluster
View logs in Taskcluster
Preparing metadata (setup.py) ... -� �done
Collecting Flask==3.0.3 (from bugbug-http-service==0.0.545)
Downloading flask-3.0.3-py3-none-any.whl.metadata (3.2 kB)
Collecting apispec-webframeworks==1.1.0 (from bugbug-http-service==0.0.545)
Downloading apispec_webframeworks-1.1.0-py3-none-any.whl.metadata (4.7 kB)
Collecting apispec==6.6.1 (from apispec[yaml]==6.6.1->bugbug-http-service==0.0.545)
Downloading apispec-6.6.1-py3-none-any.whl.metadata (10 kB)
Collecting cerberus==1.3.5 (from bugbug-http-service==0.0.545)
Downloading Cerberus-1.3.5-py3-none-any.whl.metadata (6.0 kB)
Collecting flask-apispec==0.11.4 (from bugbug-http-service==0.0.545)
Downloading flask_apispec-0.11.4-py2.py3-none-any.whl.metadata (4.3 kB)
Collecting flask-cors==4.0.1 (from bugbug-http-service==0.0.545)
Downloading Flask_Cors-4.0.1-py2.py3-none-any.whl.metadata (5.5 kB)
Collecting gunicorn==22.0.0 (from bugbug-http-service==0.0.545)
Downloading gunicorn-22.0.0-py3-none-any.whl.metadata (4.4 kB)
Collecting kombu==5.3.7 (from bugbug-http-service==0.0.545)
Downloading kombu-5.3.7-py3-none-any.whl.metadata (3.1 kB)
Collecting marshmallow==3.21.2 (from bugbug-http-service==0.0.545)
Downloading marshmallow-3.21.2-py3-none-any.whl.metadata (7.1 kB)
Requirement already satisfied: requests==2.32.0 in /usr/local/lib/python3.12/site-packages (from bugbug-http-service==0.0.545) (2.32.0)
Collecting rq-dashboard==0.7.0.2 (from bugbug-http-service==0.0.545)
Downloading rq_dashboard-0.7.0.2-py2.py3-none-any.whl.metadata (7.6 kB)
Collecting rq==1.16.2 (from bugbug-http-service==0.0.545)
Downloading rq-1.16.2-py3-none-any.whl.metadata (5.7 kB)
Collecting sentry-sdk==2.2.1 (from sentry-sdk[flask]==2.2.1->bugbug-http-service==0.0.545)
Downloading sentry_sdk-2.2.1-py2.py3-none-any.whl.metadata (10 kB)
Requirement already satisfied: packaging>=21.3 in /usr/local/lib/python3.12/site-packages (from apispec==6.6.1->apispec[yaml]==6.6.1->bugbug-http-service==0.0.545) (24.0)
Requirement already satisfied: PyYAML>=3.10 in /usr/local/lib/python3.12/site-packages (from apispec[yaml]==6.6.1->bugbug-http-service==0.0.545) (6.0.1)
Collecting Werkzeug>=3.0.0 (from Flask==3.0.3->bugbug-http-service==0.0.545)
Downloading werkzeug-3.0.3-py3-none-any.whl.metadata (3.7 kB)
Collecting Jinja2>=3.1.2 (from Flask==3.0.3->bugbug-http-service==0.0.545)
Downloading jinja2-3.1.4-py3-none-any.whl.metadata (2.6 kB)
Collecting itsdangerous>=2.1.2 (from Flask==3.0.3->bugbug-http-service==0.0.545)
Downloading itsdangerous-2.2.0-py3-none-any.whl.metadata (1.9 kB)
Collecting click>=8.1.3 (from Flask==3.0.3->bugbug-http-service==0.0.545)
Downloading click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting blinker>=1.6.2 (from Flask==3.0.3->bugbug-http-service==0.0.545)
Downloading blinker-1.8.2-py3-none-any.whl.metadata (1.6 kB)
Collecting webargs>=6.0.0 (from flask-apispec==0.11.4->bugbug-http-service==0.0.545)
Downloading webargs-8.4.0-py3-none-any.whl.metadata (8.0 kB)
Requirement already satisfied: amqp<6.0.0,>=5.1.1 in /usr/local/lib/python3.12/site-packages (from kombu==5.3.7->bugbug-http-service==0.0.545) (5.2.0)
Requirement already satisfied: vine in /usr/local/lib/python3.12/site-packages (from kombu==5.3.7->bugbug-http-service==0.0.545) (5.1.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.12/site-packages (from requests==2.32.0->bugbug-http-service==0.0.545) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.12/site-packages (from requests==2.32.0->bugbug-http-service==0.0.545) (3.7)
Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.12/site-packages (from requests==2.32.0->bugbug-http-service==0.0.545) (2.2.1)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.12/site-packages (from requests==2.32.0->bugbug-http-service==0.0.545) (2024.2.2)
Collecting redis>=3.5 (from rq==1.16.2->bugbug-http-service==0.0.545)
Downloading redis-5.0.4-py3-none-any.whl.metadata (9.3 kB)
Requirement already satisfied: arrow in /usr/local/lib/python3.12/site-packages (from rq-dashboard==0.7.0.2->bugbug-http-service==0.0.545) (1.3.0)
Collecting redis-sentinel-url (from rq-dashboard==0.7.0.2->bugbug-http-service==0.0.545)
Downloading Redis_Sentinel_Url-1.0.1-py2.py3-none-any.whl.metadata (1.0 kB)
Collecting markupsafe (from sentry-sdk[flask]==2.2.1->bugbug-http-service==0.0.545)
Downloading MarkupSafe-2.1.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.0 kB)
Requirement already satisfied: python-dateutil>=2.7.0 in /usr/local/lib/python3.12/site-packages (from arrow->rq-dashboard==0.7.0.2->bugbug-http-service==0.0.545) (2.9.0.post0)
Requirement already satisfied: types-python-dateutil>=2.8.10 in /usr/local/lib/python3.12/site-packages (from arrow->rq-dashboard==0.7.0.2->bugbug-http-service==0.0.545) (2.9.0.20240316)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.12/site-packages (from python-dateutil>=2.7.0->arrow->rq-dashboard==0.7.0.2->bugbug-http-service==0.0.545) (1.16.0)
Downloading apispec-6.6.1-py3-none-any.whl (30 kB)
Downloading apispec_webframeworks-1.1.0-py3-none-any.whl (9.1 kB)
Downloading Cerberus-1.3.5-py3-none-any.whl (30 kB)
Downloading flask-3.0.3-py3-none-any.whl (101 kB)
Downloading flask_apispec-0.11.4-py2.py3-none-any.whl (2.4 MB)
Downloading Flask_Cors-4.0.1-py2.py3-none-any.whl (14 kB)
Downloading gunicorn-22.0.0-py3-none-any.whl (84 kB)
Downloading kombu-5.3.7-py3-none-any.whl (200 kB)
Downloading marshmallow-3.21.2-py3-none-any.whl (49 kB)
Downloading rq-1.16.2-py3-none-any.whl (90 kB)
Downloading rq_dashboard-0.7.0.2-py2.py3-none-any.whl (209 kB)
Downloading sentry_sdk-2.2.1-py2.py3-none-any.whl (281 kB)
Downloading blinker-1.8.2-py3-none-any.whl (9.5 kB)
Downloading click-8.1.7-py3-none-any.whl (97 kB)
Downloading itsdangerous-2.2.0-py3-none-any.whl (16 kB)
Downloading jinja2-3.1.4-py3-none-any.whl (133 kB)
Downloading MarkupSafe-2.1.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (28 kB)
Downloading redis-5.0.4-py3-none-any.whl (251 kB)
Downloading webargs-8.4.0-py3-none-any.whl (31 kB)
Downloading werkzeug-3.0.3-py3-none-any.whl (227 kB)
Downloading Redis_Sentinel_Url-1.0.1-py2.py3-none-any.whl (4.7 kB)
Building wheels for collected packages: bugbug-http-service
Building wheel for bugbug-http-service (setup.py) ... -� �\� �done
Created wheel for bugbug-http-service: filename=bugbug_http_service-0.0.545-py3-none-any.whl size=31666 sha256=d7ba5fcd6da7eafd4de12b15c86ae900e631f136e1ccc0534852329b8c97ba11
Stored in directory: /tmp/pip-ephem-wheel-cache-4v3c463j/wheels/95/f3/17/087a179ea056096ae433a20934a06ba3620178dfafa8d0c733
Successfully built bugbug-http-service
Installing collected packages: cerberus, sentry-sdk, redis, marshmallow, markupsafe, itsdangerous, gunicorn, click, blinker, apispec, Werkzeug, webargs, rq, redis-sentinel-url, kombu, Jinja2, Flask, apispec-webframeworks, rq-dashboard, flask-cors, flask-apispec, bugbug-http-service
Successfully installed Flask-3.0.3 Jinja2-3.1.4 Werkzeug-3.0.3 apispec-6.6.1 apispec-webframeworks-1.1.0 blinker-1.8.2 bugbug-http-service-0.0.545 cerberus-1.3.5 click-8.1.7 flask-apispec-0.11.4 flask-cors-4.0.1 gunicorn-22.0.0 itsdangerous-2.2.0 kombu-5.3.7 markupsafe-2.1.5 marshmallow-3.21.2 redis-5.0.4 redis-sentinel-url-1.0.1 rq-1.16.2 rq-dashboard-0.7.0.2 sentry-sdk-2.2.1 webargs-8.4.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
+ hg clone -r 7436689a409528730ee6a7a2a5e763c9fb821a8f https://hg.mozilla.org/hgcustom/version-control-tools /version-control-tools/
*** failed to import extension "robustcheckout" from /version-control-tools/hgext/robustcheckout/__init__.py: [Errno 2] No such file or directory: '/version-control-tools/hgext/robustcheckout/__init__.py'
*** failed to import extension "hgmo" from /version-control-tools/hgext/hgmo: [Errno 2] No such file or directory: '/version-control-tools/hgext/hgmo'
*** failed to import extension "pushlog" from /version-control-tools/hgext/pushlog: [Errno 2] No such file or directory: '/version-control-tools/hgext/pushlog'
*** failed to import extension "mozext" from /version-control-tools/hgext/mozext: [Errno 2] No such file or directory: '/version-control-tools/hgext/mozext'
adding changesets
adding manifests
adding file changes
files [===================================================> ] 2754/2970 01s
files [======================================================> ] 2916/2970 01s
added 7960 changesets with 19190 changes to 2970 files
new changesets 8277a178b3cb:7436689a4095
updating to branch default
1304 files updated, 0 files merged, 0 files removed, 0 files unresolved
+ pytest --cov=http_service http_service/tests/ -vvv
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-8.2.1, pluggy-1.5.0 -- /usr/local/bin/python
cachedir: .pytest_cache
hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase(PosixPath('/bugbug/.hypothesis/examples'))
rootdir: /bugbug/http_service/tests
configfile: pytest.ini
plugins: responses-0.5.1, cov-5.0.0, hypothesis-6.102.4
collecting ...
collected 22 items
http_service/tests/test_bug_classification.py::test_model_predict_id PASSED [ 4%]
http_service/tests/test_bug_classification.py::test_model_predict_id_github PASSED [ 9%]
http_service/tests/test_bug_classification.py::test_model_predict_batch PASSED [ 13%]
http_service/tests/test_bug_classification.py::test_model_predict_batch_broken_site_reports PASSED [ 18%]
http_service/tests/test_bug_classification.py::test_for_missing_bugs PASSED [ 22%]
http_service/tests/test_bug_classification.py::test_empty_batch PASSED [ 27%]
http_service/tests/test_bug_classification.py::test_non_int_batch PASSED [ 31%]
http_service/tests/test_bug_classification.py::test_unknown_model PASSED [ 36%]
http_service/tests/test_bug_classification.py::test_no_api_key PASSED [ 40%]
http_service/tests/test_get_config_specific_groups.py::test_get_config_specific_groups PASSED [ 45%]
http_service/tests/test_push_schedules.py::test_queue_job_valid PASSED [ 50%]
http_service/tests/test_push_schedules.py::test_no_api_key PASSED [ 54%]
http_service/tests/test_readthrough_cache.py::test_doesnt_cache_unless_accessed_within_ttl PASSED [ 59%]
http_service/tests/test_readthrough_cache.py::test_cache_purges_after_ttl PASSED [ 63%]
http_service/tests/test_readthrough_cache.py::test_cache_ttl_refreshes_after_get PASSED [ 68%]
http_service/tests/test_readthrough_cache.py::test_force_store PASSED [ 72%]
http_service/tests/test_readthrough_cache.py::test_cache_thread PASSED [ 77%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose0-groups_to_choose0-reduced_labels0-config_groups0] PASSED [ 81%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose1-groups_to_choose1-reduced_labels1-config_groups1] PASSED [ 86%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose2-groups_to_choose2-reduced_labels2-config_groups2] PASSED [ 90%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose3-groups_to_choose3-reduced_labels3-config_groups3] PASSED [ 95%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose4-groups_to_choose4-reduced_labels4-config_groups4] PASSED [100%]
=============================== warnings summary ===============================
../usr/local/lib/python3.12/site-packages/bugbug/__init__.py:5
/usr/local/lib/python3.12/site-packages/bugbug/__init__.py:5: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
http_service/bugbug_http/readthrough_cache.py:73
test_readthrough_cache.py::test_cache_thread
/bugbug/http_service/bugbug_http/readthrough_cache.py:73: DeprecationWarning: setDaemon() is deprecated, set the daemon attribute instead
thread.setDaemon(True)
../usr/local/lib/python3.12/site-packages/marshmallow/fields.py:1182
/usr/local/lib/python3.12/site-packages/marshmallow/fields.py:1182: RemovedInMarshmallow4Warning: Passing field metadata as keyword arguments is deprecated. Use the explicit `metadata=...` argument instead. Additional metadata: {'enum': [False]}
super().__init__(**kwargs)
http_service/bugbug_http/app.py:112
/bugbug/http_service/bugbug_http/app.py:112: RemovedInMarshmallow4Warning: Passing field metadata as keyword arguments is deprecated. Use the explicit `metadata=...` argument instead. Additional metadata: {'enum': ['defectenhancementtask', 'component', 'invalidcompatibilityreport', 'needsdiagnosis', 'regression', 'stepstoreproduce', 'spambug', 'testlabelselect', 'testgroupselect', 'accessibility', 'performancebug', 'worksforme', 'fenixcomponent'], 'example': 'component'}
model_name = fields.Str(enum=MODELS_NAMES, example="component")
http_service/bugbug_http/app.py:116
/bugbug/http_service/bugbug_http/app.py:116: RemovedInMarshmallow4Warning: The 'default' argument to fields is deprecated. Use 'dump_default' instead.
message = fields.Str(default="Error, missing X-API-KEY")
http_service/bugbug_http/app.py:120
/bugbug/http_service/bugbug_http/app.py:120: RemovedInMarshmallow4Warning: Passing field metadata as keyword arguments is deprecated. Use the explicit `metadata=...` argument instead. Additional metadata: {'example': 'autoland'}
branch = fields.Str(example="autoland")
test_bug_classification.py::test_model_predict_batch
test_bug_classification.py::test_model_predict_batch_broken_site_reports
/bugbug/http_service/bugbug_http/app.py:308: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
utcnow = datetime.utcnow()
test_schedule_tests.py: 10 warnings
/usr/local/lib/python3.12/site-packages/bugbug/repository.py:898: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
pushdate = datetime.utcnow()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
---------- coverage: platform linux, python 3.12.3-final-0 -----------
Name Stmts Miss Cover
---------------------------------------------------------------------------
http_service/bugbug_http/__init__.py 4 0 100%
http_service/bugbug_http/app.py 366 44 88%
http_service/bugbug_http/boot.py 123 123 0%
http_service/bugbug_http/download_models.py 18 18 0%
http_service/bugbug_http/listener.py 60 60 0%
http_service/bugbug_http/models.py 154 82 47%
http_service/bugbug_http/readthrough_cache.py 44 0 100%
http_service/bugbug_http/sentry.py 7 2 71%
http_service/bugbug_http/worker.py 21 21 0%
http_service/setup.py 10 10 0%
http_service/tests/__init__.py 0 0 100%
http_service/tests/conftest.py 235 9 96%
http_service/tests/test_bug_classification.py 115 1 99%
http_service/tests/test_get_config_specific_groups.py 10 0 100%
http_service/tests/test_integration.py 38 28 26%
http_service/tests/test_push_schedules.py 24 1 96%
http_service/tests/test_readthrough_cache.py 113 6 95%
http_service/tests/test_schedule_tests.py 30 0 100%
---------------------------------------------------------------------------
TOTAL 1372 405 70%
======================= 22 passed, 19 warnings in 41.06s =======================
+ bash /dev/fd/63
++ curl -s https://codecov.io/bash
_____ _
/ ____| | |
| | ___ __| | ___ ___ _____ __
| | / _ \ / _` |/ _ \/ __/ _ \ \ / /
| |___| (_) | (_| | __/ (_| (_) \ V /
\_____\___/ \__,_|\___|\___\___/ \_/
Bash-1.0.6
==> git version 2.39.2 found
==> curl 7.88.1 (x86_64-pc-linux-gnu) libcurl/7.88.1 OpenSSL/3.0.11 zlib/1.2.13 brotli/1.0.9 zstd/1.5.4 libidn2/2.3.3 libpsl/0.21.2 (+libidn2/2.3.3) libssh2/1.10.0 nghttp2/1.52.0 librtmp/2.3 OpenLDAP/2.5.13
Release-Date: 2023-02-20, security patched: 7.88.1-10+deb12u5
Protocols: dict file ftp ftps gopher gophers http https imap imaps ldap ldaps mqtt pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp
Features: alt-svc AsynchDNS brotli GSS-API HSTS HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL threadsafe TLS-SRP UnixSockets zstd
x> No CI provider detected.
Testing inside Docker? http://docs.codecov.io/docs/testing-with-docker
Testing with Tox? https://docs.codecov.io/docs/python#section-testing-with-tox
current dir: /bugbug
project root: .
--> token set from env
Yaml found at: .codecov.yml
==> Running gcov in . (disable via -X gcov)
==> Python coveragepy exists disable via -X coveragepy
-> Running coverage xml
==> Searching for coverage reports in:
+ .
-> Found 1 reports
==> Detecting git/mercurial file structure
==> Reading reports
+ ./coverage.xml bytes=53019
==> Appending adjustments
https://docs.codecov.io/docs/fixing-reports
-> No adjustments found
==> Gzipping contents
8.0K /tmp/codecov.UgL0NG.gz
==> Uploading reports
url: https://codecov.io
query: branch=&commit=9dce609abdb3799479229f52beaf86f99b7bf2cb&build=&build_url=&name=&tag=&slug=&service=&flags=&pr=&job=&cmd_args=
-> Pinging Codecov
https://codecov.io/upload/v4?package=bash-1.0.6&token=<hidden>&package=bash-1.0.6&token=66162f89-a4d9-420c-84bd-d10f12a428d9&branch=&commit=9dce609abdb3799479229f52beaf86f99b7bf2cb&build=&build_url=&name=&tag=&slug=&service=&flags=&pr=&job=&cmd_args=
-> Uploading to
https://storage.googleapis.com/codecov/v4/raw/2024-05-25/03D1CA636477FE87A865820EBDD81459/9dce609abdb3799479229f52beaf86f99b7bf2cb/f0312667-551d-47bc-ad01-252855d3a650.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EJOGFN2JQ4OCTGA2MU5AEIT7OT5Z7HTFOAN2SPG4NWSN2UJYOY5U6LZQ%2F20240525%2Fus-west2%2Fs3%2Faws4_request&X-Amz-Date=20240525T063709Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=6f2daac86d8a4a3f017f4130530c2485da3ad575ca2cf1c53539c18aa5735e41
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 5487 0 0 100 5487 0 30532 --:--:-- --:--:-- --:--:-- 30653
-> Reports have been successfully queued for processing at https://app.codecov.io/github/mozilla/bugbug/commit/9dce609abdb3799479229f52beaf86f99b7bf2cb
[taskcluster 2024-05-25T06:37:10.301Z] Exit Code: 0
[taskcluster 2024-05-25T06:37:10.301Z] User Time: 27.001627s
[taskcluster 2024-05-25T06:37:10.301Z] Kernel Time: 4.319669s
[taskcluster 2024-05-25T06:37:10.301Z] Wall Time: 3m23.878950231s
[taskcluster 2024-05-25T06:37:10.301Z] Result: SUCCEEDED
[taskcluster 2024-05-25T06:37:10.301Z] === Task Finished ===
[taskcluster 2024-05-25T06:37:10.301Z] Task Duration: 3m23.879411733s
[taskcluster 2024-05-25T06:37:10.396Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-05-25T07:31:52.207Z
Loading