Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add and update MEI_time_series_visualization script #4197

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Add and update MEI_time_series_visualization script

9dce609
Select commit
Loading
Failed to load commit list.
Open

Add and update MEI_time_series_visualization script #4197

Add and update MEI_time_series_visualization script
9dce609
Select commit
Loading
Failed to load commit list.
Community-TC Integration / bugbug http service tests succeeded May 25, 2024 in 5m 19s

Community-TC (pull_request)

bugbug http service tests

Details

View task in Taskcluster
View logs in Taskcluster


  Preparing metadata (setup.py) ... -� �done
Collecting Flask==3.0.3 (from bugbug-http-service==0.0.545)
  Downloading flask-3.0.3-py3-none-any.whl.metadata (3.2 kB)
Collecting apispec-webframeworks==1.1.0 (from bugbug-http-service==0.0.545)
  Downloading apispec_webframeworks-1.1.0-py3-none-any.whl.metadata (4.7 kB)
Collecting apispec==6.6.1 (from apispec[yaml]==6.6.1->bugbug-http-service==0.0.545)
  Downloading apispec-6.6.1-py3-none-any.whl.metadata (10 kB)
Collecting cerberus==1.3.5 (from bugbug-http-service==0.0.545)
  Downloading Cerberus-1.3.5-py3-none-any.whl.metadata (6.0 kB)
Collecting flask-apispec==0.11.4 (from bugbug-http-service==0.0.545)
  Downloading flask_apispec-0.11.4-py2.py3-none-any.whl.metadata (4.3 kB)
Collecting flask-cors==4.0.1 (from bugbug-http-service==0.0.545)
  Downloading Flask_Cors-4.0.1-py2.py3-none-any.whl.metadata (5.5 kB)
Collecting gunicorn==22.0.0 (from bugbug-http-service==0.0.545)
  Downloading gunicorn-22.0.0-py3-none-any.whl.metadata (4.4 kB)
Collecting kombu==5.3.7 (from bugbug-http-service==0.0.545)
  Downloading kombu-5.3.7-py3-none-any.whl.metadata (3.1 kB)
Collecting marshmallow==3.21.2 (from bugbug-http-service==0.0.545)
  Downloading marshmallow-3.21.2-py3-none-any.whl.metadata (7.1 kB)
Requirement already satisfied: requests==2.32.0 in /usr/local/lib/python3.12/site-packages (from bugbug-http-service==0.0.545) (2.32.0)
Collecting rq-dashboard==0.7.0.2 (from bugbug-http-service==0.0.545)
  Downloading rq_dashboard-0.7.0.2-py2.py3-none-any.whl.metadata (7.6 kB)
Collecting rq==1.16.2 (from bugbug-http-service==0.0.545)
  Downloading rq-1.16.2-py3-none-any.whl.metadata (5.7 kB)
Collecting sentry-sdk==2.2.1 (from sentry-sdk[flask]==2.2.1->bugbug-http-service==0.0.545)
  Downloading sentry_sdk-2.2.1-py2.py3-none-any.whl.metadata (10 kB)
Requirement already satisfied: packaging>=21.3 in /usr/local/lib/python3.12/site-packages (from apispec==6.6.1->apispec[yaml]==6.6.1->bugbug-http-service==0.0.545) (24.0)
Requirement already satisfied: PyYAML>=3.10 in /usr/local/lib/python3.12/site-packages (from apispec[yaml]==6.6.1->bugbug-http-service==0.0.545) (6.0.1)
Collecting Werkzeug>=3.0.0 (from Flask==3.0.3->bugbug-http-service==0.0.545)
  Downloading werkzeug-3.0.3-py3-none-any.whl.metadata (3.7 kB)
Collecting Jinja2>=3.1.2 (from Flask==3.0.3->bugbug-http-service==0.0.545)
  Downloading jinja2-3.1.4-py3-none-any.whl.metadata (2.6 kB)
Collecting itsdangerous>=2.1.2 (from Flask==3.0.3->bugbug-http-service==0.0.545)
  Downloading itsdangerous-2.2.0-py3-none-any.whl.metadata (1.9 kB)
Collecting click>=8.1.3 (from Flask==3.0.3->bugbug-http-service==0.0.545)
  Downloading click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting blinker>=1.6.2 (from Flask==3.0.3->bugbug-http-service==0.0.545)
  Downloading blinker-1.8.2-py3-none-any.whl.metadata (1.6 kB)
Collecting webargs>=6.0.0 (from flask-apispec==0.11.4->bugbug-http-service==0.0.545)
  Downloading webargs-8.4.0-py3-none-any.whl.metadata (8.0 kB)
Requirement already satisfied: amqp<6.0.0,>=5.1.1 in /usr/local/lib/python3.12/site-packages (from kombu==5.3.7->bugbug-http-service==0.0.545) (5.2.0)
Requirement already satisfied: vine in /usr/local/lib/python3.12/site-packages (from kombu==5.3.7->bugbug-http-service==0.0.545) (5.1.0)
Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.12/site-packages (from requests==2.32.0->bugbug-http-service==0.0.545) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.12/site-packages (from requests==2.32.0->bugbug-http-service==0.0.545) (3.7)
Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.12/site-packages (from requests==2.32.0->bugbug-http-service==0.0.545) (2.2.1)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.12/site-packages (from requests==2.32.0->bugbug-http-service==0.0.545) (2024.2.2)
Collecting redis>=3.5 (from rq==1.16.2->bugbug-http-service==0.0.545)
  Downloading redis-5.0.4-py3-none-any.whl.metadata (9.3 kB)
Requirement already satisfied: arrow in /usr/local/lib/python3.12/site-packages (from rq-dashboard==0.7.0.2->bugbug-http-service==0.0.545) (1.3.0)
Collecting redis-sentinel-url (from rq-dashboard==0.7.0.2->bugbug-http-service==0.0.545)
  Downloading Redis_Sentinel_Url-1.0.1-py2.py3-none-any.whl.metadata (1.0 kB)
Collecting markupsafe (from sentry-sdk[flask]==2.2.1->bugbug-http-service==0.0.545)
  Downloading MarkupSafe-2.1.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.0 kB)
Requirement already satisfied: python-dateutil>=2.7.0 in /usr/local/lib/python3.12/site-packages (from arrow->rq-dashboard==0.7.0.2->bugbug-http-service==0.0.545) (2.9.0.post0)
Requirement already satisfied: types-python-dateutil>=2.8.10 in /usr/local/lib/python3.12/site-packages (from arrow->rq-dashboard==0.7.0.2->bugbug-http-service==0.0.545) (2.9.0.20240316)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.12/site-packages (from python-dateutil>=2.7.0->arrow->rq-dashboard==0.7.0.2->bugbug-http-service==0.0.545) (1.16.0)
Downloading apispec-6.6.1-py3-none-any.whl (30 kB)
Downloading apispec_webframeworks-1.1.0-py3-none-any.whl (9.1 kB)
Downloading Cerberus-1.3.5-py3-none-any.whl (30 kB)
Downloading flask-3.0.3-py3-none-any.whl (101 kB)
Downloading flask_apispec-0.11.4-py2.py3-none-any.whl (2.4 MB)
Downloading Flask_Cors-4.0.1-py2.py3-none-any.whl (14 kB)
Downloading gunicorn-22.0.0-py3-none-any.whl (84 kB)
Downloading kombu-5.3.7-py3-none-any.whl (200 kB)
Downloading marshmallow-3.21.2-py3-none-any.whl (49 kB)
Downloading rq-1.16.2-py3-none-any.whl (90 kB)
Downloading rq_dashboard-0.7.0.2-py2.py3-none-any.whl (209 kB)
Downloading sentry_sdk-2.2.1-py2.py3-none-any.whl (281 kB)
Downloading blinker-1.8.2-py3-none-any.whl (9.5 kB)
Downloading click-8.1.7-py3-none-any.whl (97 kB)
Downloading itsdangerous-2.2.0-py3-none-any.whl (16 kB)
Downloading jinja2-3.1.4-py3-none-any.whl (133 kB)
Downloading MarkupSafe-2.1.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (28 kB)
Downloading redis-5.0.4-py3-none-any.whl (251 kB)
Downloading webargs-8.4.0-py3-none-any.whl (31 kB)
Downloading werkzeug-3.0.3-py3-none-any.whl (227 kB)
Downloading Redis_Sentinel_Url-1.0.1-py2.py3-none-any.whl (4.7 kB)
Building wheels for collected packages: bugbug-http-service
  Building wheel for bugbug-http-service (setup.py) ... -� �\� �done
  Created wheel for bugbug-http-service: filename=bugbug_http_service-0.0.545-py3-none-any.whl size=31666 sha256=d7ba5fcd6da7eafd4de12b15c86ae900e631f136e1ccc0534852329b8c97ba11
  Stored in directory: /tmp/pip-ephem-wheel-cache-4v3c463j/wheels/95/f3/17/087a179ea056096ae433a20934a06ba3620178dfafa8d0c733
Successfully built bugbug-http-service
Installing collected packages: cerberus, sentry-sdk, redis, marshmallow, markupsafe, itsdangerous, gunicorn, click, blinker, apispec, Werkzeug, webargs, rq, redis-sentinel-url, kombu, Jinja2, Flask, apispec-webframeworks, rq-dashboard, flask-cors, flask-apispec, bugbug-http-service
Successfully installed Flask-3.0.3 Jinja2-3.1.4 Werkzeug-3.0.3 apispec-6.6.1 apispec-webframeworks-1.1.0 blinker-1.8.2 bugbug-http-service-0.0.545 cerberus-1.3.5 click-8.1.7 flask-apispec-0.11.4 flask-cors-4.0.1 gunicorn-22.0.0 itsdangerous-2.2.0 kombu-5.3.7 markupsafe-2.1.5 marshmallow-3.21.2 redis-5.0.4 redis-sentinel-url-1.0.1 rq-1.16.2 rq-dashboard-0.7.0.2 sentry-sdk-2.2.1 webargs-8.4.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
+ hg clone -r 7436689a409528730ee6a7a2a5e763c9fb821a8f https://hg.mozilla.org/hgcustom/version-control-tools /version-control-tools/
*** failed to import extension "robustcheckout" from /version-control-tools/hgext/robustcheckout/__init__.py: [Errno 2] No such file or directory: '/version-control-tools/hgext/robustcheckout/__init__.py'
*** failed to import extension "hgmo" from /version-control-tools/hgext/hgmo: [Errno 2] No such file or directory: '/version-control-tools/hgext/hgmo'
*** failed to import extension "pushlog" from /version-control-tools/hgext/pushlog: [Errno 2] No such file or directory: '/version-control-tools/hgext/pushlog'
*** failed to import extension "mozext" from /version-control-tools/hgext/mozext: [Errno 2] No such file or directory: '/version-control-tools/hgext/mozext'
adding changesets
adding manifests
adding file changes

files [===================================================>     ] 2754/2970 01s
files [======================================================>  ] 2916/2970 01s
                                                                                
added 7960 changesets with 19190 changes to 2970 files
new changesets 8277a178b3cb:7436689a4095
updating to branch default
1304 files updated, 0 files merged, 0 files removed, 0 files unresolved
+ pytest --cov=http_service http_service/tests/ -vvv
============================= test session starts ==============================
platform linux -- Python 3.12.3, pytest-8.2.1, pluggy-1.5.0 -- /usr/local/bin/python
cachedir: .pytest_cache
hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase(PosixPath('/bugbug/.hypothesis/examples'))
rootdir: /bugbug/http_service/tests
configfile: pytest.ini
plugins: responses-0.5.1, cov-5.0.0, hypothesis-6.102.4
collecting ... 
collected 22 items                                                             

http_service/tests/test_bug_classification.py::test_model_predict_id PASSED [  4%]
http_service/tests/test_bug_classification.py::test_model_predict_id_github PASSED [  9%]
http_service/tests/test_bug_classification.py::test_model_predict_batch PASSED [ 13%]
http_service/tests/test_bug_classification.py::test_model_predict_batch_broken_site_reports PASSED [ 18%]
http_service/tests/test_bug_classification.py::test_for_missing_bugs PASSED [ 22%]
http_service/tests/test_bug_classification.py::test_empty_batch PASSED   [ 27%]
http_service/tests/test_bug_classification.py::test_non_int_batch PASSED [ 31%]
http_service/tests/test_bug_classification.py::test_unknown_model PASSED [ 36%]
http_service/tests/test_bug_classification.py::test_no_api_key PASSED    [ 40%]
http_service/tests/test_get_config_specific_groups.py::test_get_config_specific_groups PASSED [ 45%]
http_service/tests/test_push_schedules.py::test_queue_job_valid PASSED   [ 50%]
http_service/tests/test_push_schedules.py::test_no_api_key PASSED        [ 54%]
http_service/tests/test_readthrough_cache.py::test_doesnt_cache_unless_accessed_within_ttl PASSED [ 59%]
http_service/tests/test_readthrough_cache.py::test_cache_purges_after_ttl PASSED [ 63%]
http_service/tests/test_readthrough_cache.py::test_cache_ttl_refreshes_after_get PASSED [ 68%]
http_service/tests/test_readthrough_cache.py::test_force_store PASSED    [ 72%]
http_service/tests/test_readthrough_cache.py::test_cache_thread PASSED   [ 77%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose0-groups_to_choose0-reduced_labels0-config_groups0] PASSED [ 81%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose1-groups_to_choose1-reduced_labels1-config_groups1] PASSED [ 86%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose2-groups_to_choose2-reduced_labels2-config_groups2] PASSED [ 90%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose3-groups_to_choose3-reduced_labels3-config_groups3] PASSED [ 95%]
http_service/tests/test_schedule_tests.py::test_simple_schedule[labels_to_choose4-groups_to_choose4-reduced_labels4-config_groups4] PASSED [100%]

=============================== warnings summary ===============================
../usr/local/lib/python3.12/site-packages/bugbug/__init__.py:5
  /usr/local/lib/python3.12/site-packages/bugbug/__init__.py:5: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

http_service/bugbug_http/readthrough_cache.py:73
test_readthrough_cache.py::test_cache_thread
  /bugbug/http_service/bugbug_http/readthrough_cache.py:73: DeprecationWarning: setDaemon() is deprecated, set the daemon attribute instead
    thread.setDaemon(True)

../usr/local/lib/python3.12/site-packages/marshmallow/fields.py:1182
  /usr/local/lib/python3.12/site-packages/marshmallow/fields.py:1182: RemovedInMarshmallow4Warning: Passing field metadata as keyword arguments is deprecated. Use the explicit `metadata=...` argument instead. Additional metadata: {'enum': [False]}
    super().__init__(**kwargs)

http_service/bugbug_http/app.py:112
  /bugbug/http_service/bugbug_http/app.py:112: RemovedInMarshmallow4Warning: Passing field metadata as keyword arguments is deprecated. Use the explicit `metadata=...` argument instead. Additional metadata: {'enum': ['defectenhancementtask', 'component', 'invalidcompatibilityreport', 'needsdiagnosis', 'regression', 'stepstoreproduce', 'spambug', 'testlabelselect', 'testgroupselect', 'accessibility', 'performancebug', 'worksforme', 'fenixcomponent'], 'example': 'component'}
    model_name = fields.Str(enum=MODELS_NAMES, example="component")

http_service/bugbug_http/app.py:116
  /bugbug/http_service/bugbug_http/app.py:116: RemovedInMarshmallow4Warning: The 'default' argument to fields is deprecated. Use 'dump_default' instead.
    message = fields.Str(default="Error, missing X-API-KEY")

http_service/bugbug_http/app.py:120
  /bugbug/http_service/bugbug_http/app.py:120: RemovedInMarshmallow4Warning: Passing field metadata as keyword arguments is deprecated. Use the explicit `metadata=...` argument instead. Additional metadata: {'example': 'autoland'}
    branch = fields.Str(example="autoland")

test_bug_classification.py::test_model_predict_batch
test_bug_classification.py::test_model_predict_batch_broken_site_reports
  /bugbug/http_service/bugbug_http/app.py:308: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
    utcnow = datetime.utcnow()

test_schedule_tests.py: 10 warnings
  /usr/local/lib/python3.12/site-packages/bugbug/repository.py:898: DeprecationWarning: datetime.datetime.utcnow() is deprecated and scheduled for removal in a future version. Use timezone-aware objects to represent datetimes in UTC: datetime.datetime.now(datetime.UTC).
    pushdate = datetime.utcnow()

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

---------- coverage: platform linux, python 3.12.3-final-0 -----------
Name                                                    Stmts   Miss  Cover
---------------------------------------------------------------------------
http_service/bugbug_http/__init__.py                        4      0   100%
http_service/bugbug_http/app.py                           366     44    88%
http_service/bugbug_http/boot.py                          123    123     0%
http_service/bugbug_http/download_models.py                18     18     0%
http_service/bugbug_http/listener.py                       60     60     0%
http_service/bugbug_http/models.py                        154     82    47%
http_service/bugbug_http/readthrough_cache.py              44      0   100%
http_service/bugbug_http/sentry.py                          7      2    71%
http_service/bugbug_http/worker.py                         21     21     0%
http_service/setup.py                                      10     10     0%
http_service/tests/__init__.py                              0      0   100%
http_service/tests/conftest.py                            235      9    96%
http_service/tests/test_bug_classification.py             115      1    99%
http_service/tests/test_get_config_specific_groups.py      10      0   100%
http_service/tests/test_integration.py                     38     28    26%
http_service/tests/test_push_schedules.py                  24      1    96%
http_service/tests/test_readthrough_cache.py              113      6    95%
http_service/tests/test_schedule_tests.py                  30      0   100%
---------------------------------------------------------------------------
TOTAL                                                    1372    405    70%

======================= 22 passed, 19 warnings in 41.06s =======================
+ bash /dev/fd/63
++ curl -s https://codecov.io/bash

  _____          _
 / ____|        | |
| |     ___   __| | ___  ___ _____   __
| |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
| |___| (_) | (_| |  __/ (_| (_) \ V /
 \_____\___/ \__,_|\___|\___\___/ \_/
                              Bash-1.0.6


==> git version 2.39.2 found
==> curl 7.88.1 (x86_64-pc-linux-gnu) libcurl/7.88.1 OpenSSL/3.0.11 zlib/1.2.13 brotli/1.0.9 zstd/1.5.4 libidn2/2.3.3 libpsl/0.21.2 (+libidn2/2.3.3) libssh2/1.10.0 nghttp2/1.52.0 librtmp/2.3 OpenLDAP/2.5.13
Release-Date: 2023-02-20, security patched: 7.88.1-10+deb12u5
Protocols: dict file ftp ftps gopher gophers http https imap imaps ldap ldaps mqtt pop3 pop3s rtmp rtsp scp sftp smb smbs smtp smtps telnet tftp
Features: alt-svc AsynchDNS brotli GSS-API HSTS HTTP2 HTTPS-proxy IDN IPv6 Kerberos Largefile libz NTLM NTLM_WB PSL SPNEGO SSL threadsafe TLS-SRP UnixSockets zstd
x> No CI provider detected.
    Testing inside Docker? http://docs.codecov.io/docs/testing-with-docker
    Testing with Tox? https://docs.codecov.io/docs/python#section-testing-with-tox
    current dir:  /bugbug
    project root: .
--> token set from env
    Yaml found at: .codecov.yml
==> Running gcov in . (disable via -X gcov)
==> Python coveragepy exists disable via -X coveragepy
    -> Running coverage xml
==> Searching for coverage reports in:
    + .
    -> Found 1 reports
==> Detecting git/mercurial file structure
==> Reading reports
    + ./coverage.xml bytes=53019
==> Appending adjustments
    https://docs.codecov.io/docs/fixing-reports
    -> No adjustments found
==> Gzipping contents
        8.0K	/tmp/codecov.UgL0NG.gz
==> Uploading reports
    url: https://codecov.io
    query: branch=&commit=9dce609abdb3799479229f52beaf86f99b7bf2cb&build=&build_url=&name=&tag=&slug=&service=&flags=&pr=&job=&cmd_args=
->  Pinging Codecov
https://codecov.io/upload/v4?package=bash-1.0.6&token=<hidden>&package=bash-1.0.6&token=66162f89-a4d9-420c-84bd-d10f12a428d9&branch=&commit=9dce609abdb3799479229f52beaf86f99b7bf2cb&build=&build_url=&name=&tag=&slug=&service=&flags=&pr=&job=&cmd_args=
->  Uploading to
https://storage.googleapis.com/codecov/v4/raw/2024-05-25/03D1CA636477FE87A865820EBDD81459/9dce609abdb3799479229f52beaf86f99b7bf2cb/f0312667-551d-47bc-ad01-252855d3a650.txt?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GOOG1EJOGFN2JQ4OCTGA2MU5AEIT7OT5Z7HTFOAN2SPG4NWSN2UJYOY5U6LZQ%2F20240525%2Fus-west2%2Fs3%2Faws4_request&X-Amz-Date=20240525T063709Z&X-Amz-Expires=10&X-Amz-SignedHeaders=host&X-Amz-Signature=6f2daac86d8a4a3f017f4130530c2485da3ad575ca2cf1c53539c18aa5735e41
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  5487    0     0  100  5487      0  30532 --:--:-- --:--:-- --:--:-- 30653
    -> Reports have been successfully queued for processing at https://app.codecov.io/github/mozilla/bugbug/commit/9dce609abdb3799479229f52beaf86f99b7bf2cb
[taskcluster 2024-05-25T06:37:10.301Z]    Exit Code: 0
[taskcluster 2024-05-25T06:37:10.301Z]    User Time: 27.001627s
[taskcluster 2024-05-25T06:37:10.301Z]  Kernel Time: 4.319669s
[taskcluster 2024-05-25T06:37:10.301Z]    Wall Time: 3m23.878950231s
[taskcluster 2024-05-25T06:37:10.301Z]       Result: SUCCEEDED
[taskcluster 2024-05-25T06:37:10.301Z] === Task Finished ===
[taskcluster 2024-05-25T06:37:10.301Z] Task Duration: 3m23.879411733s
[taskcluster 2024-05-25T06:37:10.396Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2025-05-25T07:31:52.207Z