Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✨Adding dynamic services monitoring dashboard (⚠️devops) #6784

Merged
Changes from 1 commit
Commits
Show all changes
149 commits
Select commit Hold shift + click to select a range
d2d81c0
⬆️ Upgrade models-library (pydantic v2) (#6333)
giancarloromeo Sep 18, 2024
19e3923
♻️ Add common library (#6495)
giancarloromeo Oct 7, 2024
1d92881
⬆️ Upgrade libraries (pydantic v2) (#6366)
giancarloromeo Oct 9, 2024
329b00d
Upgrade agent service (Pydantic v2) (#6508)
giancarloromeo Oct 10, 2024
6786b92
Upgrade EFS guardian service (Pydantic v2) (#6516)
giancarloromeo Oct 11, 2024
bbe92a2
Upgrade invitations service (Pydantic v2) (#6513)
giancarloromeo Oct 11, 2024
42c0a68
Upgrade clusters keeper service (Pydantic v2) (#6519)
giancarloromeo Oct 14, 2024
1c833e0
Merge remote-tracking branch 'origin/master' into pydantic_v2_migrati…
sanderegg Oct 22, 2024
cac8134
♻️Pydantic V2 upgrade: autoscaling (#6535)
sanderegg Oct 15, 2024
e97258e
🎨 pydantic2 migration: fixed unit-tests for dynamic-sidecar (#6534)
GitHK Oct 18, 2024
463488b
🎨 pydantic2 migration: fixed unit-tests for dynamic-scheduler (#6547)
GitHK Oct 18, 2024
c2b4983
🎨 pydantic2 migration: fixed unit-tests for agent (#6546)
GitHK Oct 18, 2024
64293f0
🎨 pydantic2 migration: fixed unit-tests for payments (#6553)
GitHK Oct 18, 2024
cf5546b
Upgrade resource usage tracker (Pydantic v2) (#6517)
giancarloromeo Oct 21, 2024
3b188f5
Merge remote-tracking branch 'origin/master' into pydantic_v2_migrati…
sanderegg Oct 22, 2024
4716e55
Merge remote-tracking branch 'origin/master' into pydantic_v2_migrati…
sanderegg Oct 22, 2024
84f1e51
missing file from re-creating branch
sanderegg Oct 22, 2024
cf95d81
restored from old pydanitc_v2_migration branch
sanderegg Oct 22, 2024
7be9541
fixes after merge
sanderegg Oct 22, 2024
6199ed6
⬆️Dask sidecar: migration to v2 (#6591)
sanderegg Oct 24, 2024
cd6f545
♻️Use correct import (#6597)
sanderegg Oct 24, 2024
3cf68ba
⬆️Datcore adapter: migration (#6594)
sanderegg Oct 24, 2024
fb48eb1
Merge remote-tracking branch 'upstream/master' into update-branch
sanderegg Oct 25, 2024
82c69d0
Merge pull request #6600 from sanderegg/update-branch
sanderegg Oct 25, 2024
7410516
⬆️Migration: Storage (#6599)
sanderegg Oct 25, 2024
39aed6a
⬆️ Upgrade API Server service (Pydantic v2) (#6580)
giancarloromeo Oct 25, 2024
e38cf4e
♻️Fix settings library tests (#6605)
sanderegg Oct 28, 2024
00f8674
Merge remote-tracking branch 'upstream/master' into update-branch2
sanderegg Oct 28, 2024
06df37d
Merge pull request #6609 from sanderegg/update-branch2
sanderegg Oct 28, 2024
3195f1e
Merge remote-tracking branch 'upstream/master' into upgrade-master-3
sanderegg Oct 29, 2024
7033151
Merge remote-tracking branch 'upstream/master' into upgrade-master-3
sanderegg Oct 29, 2024
4fd252f
Merge pull request #6626 from sanderegg/upgrade-master-3
sanderegg Oct 29, 2024
afa0b3c
⬆️ upgrades `iter_model_examples_in_module` to enable all example te…
pcrespov Oct 29, 2024
9e76d4f
⬆️Pydantic V2: Diverse fixes after merges from master (#6627)
sanderegg Oct 29, 2024
fefd1b9
Merge remote-tracking branch 'upstream/master' into upgrade-master-5
sanderegg Oct 29, 2024
05cff9e
Merge pull request #6637 from sanderegg/upgrade-master-5
sanderegg Oct 29, 2024
34c9f3e
⬆️ pydantic migration catalog (#6629)
pcrespov Oct 31, 2024
ee66b3d
Merge remote-tracking branch 'upstream/master' into update-master-6
sanderegg Nov 1, 2024
01769ac
Merge pull request #6645 from sanderegg/update-master-6
sanderegg Nov 1, 2024
2486b38
♻️Pydantic V2 migration: various fixes (#6647)
sanderegg Nov 1, 2024
add4b61
Merge remote-tracking branch 'upstream/master' into update-master-7
sanderegg Nov 1, 2024
1fe311d
Merge pull request #6650 from sanderegg/update-master-7
sanderegg Nov 1, 2024
24218c1
⬆️ Pydantic V2: after upstream merge -> fixes (#6651)
sanderegg Nov 1, 2024
b01c4a7
⬆️ Fix custom settings class with `pydantic-settings~=2.6` (#6644)
pcrespov Nov 5, 2024
8402270
⬆️ Upgrade Web Server service (Pydantic v2) (#6584)
giancarloromeo Nov 6, 2024
0527b1e
🐛 pydantic v2 fixed broken unit tests (#6649)
GitHK Nov 6, 2024
7d0fbdb
Merge remote-tracking branch 'upstream/master' into update-from-maste…
sanderegg Nov 8, 2024
c106d0a
Merge pull request #6689 from sanderegg/update-from-master-10
sanderegg Nov 8, 2024
60fe257
🎨 Add examples to pydantic response models (#6658)
bisgaard-itis Nov 8, 2024
f07afbf
🐛 Fixed packages mypy, pylint and tests (#6678)
GitHK Nov 11, 2024
a00d55f
pydantic2 making ported services green (#6701)
GitHK Nov 13, 2024
f335bca
WIP: ⬆️ Upgrade Director v2 service (Pydantic v2) (#6619)
giancarloromeo Nov 14, 2024
db084cd
Merge remote-tracking branch 'upstream/master' into update-master-20
sanderegg Nov 14, 2024
44bc9f7
Merge pull request #6724 from sanderegg/update-master-20
sanderegg Nov 15, 2024
a2d3742
♻️ Fix unit tests after master merge (#6727)
giancarloromeo Nov 15, 2024
327beab
⬆️ Align versions for pydantic/fastapi (#6730)
giancarloromeo Nov 15, 2024
84c4c85
♻️Fixed Unit test director v2 (#6733)
sanderegg Nov 15, 2024
8eac56b
♻️ Fix deprecated stuff (Pydantic v2) (#6732)
giancarloromeo Nov 18, 2024
65665ec
♻️ Migrate scripts (Pydantic v2) (#6741)
giancarloromeo Nov 18, 2024
57058f9
Merge remote-tracking branch 'upstream/master' into update-from-maste…
sanderegg Nov 18, 2024
44f85bf
Merge pull request #6744 from sanderegg/update-from-master-XXX
sanderegg Nov 18, 2024
fa57c9e
pydantic2 migration made integration tests green (#6719)
GitHK Nov 18, 2024
a6802c9
⬆️✅ Fixes settings tests (#6753)
pcrespov Nov 18, 2024
75f06e4
🐛 Fixed webserver API endpoints (#6751)
GitHK Nov 19, 2024
aa756f0
Merge remote-tracking branch 'upstream/master' into update-master-XXX
sanderegg Nov 19, 2024
bcf3327
Merge remote-tracking branch 'upstream/master' into update-master-XXX
sanderegg Nov 19, 2024
373c314
Merge pull request #6754 from sanderegg/update-master-XXX
sanderegg Nov 19, 2024
c0a13ac
added fastUI
Nov 19, 2024
fa69117
fixed imports
Nov 19, 2024
08f1881
fixed broken import
Nov 19, 2024
f442e63
⬆️Pydantic V2: Migrate director v0 + some fixes from query PR (#6755)
sanderegg Nov 19, 2024
c10d7d0
⬆️♻️ Fix/test models (#6758)
pcrespov Nov 19, 2024
3250e5d
♻️ Greenify pylint (after Pydantic v2 migration) (#6747)
giancarloromeo Nov 19, 2024
f6d392c
moved healthcheck form root to it's own path
Nov 19, 2024
ed24e0d
moved health endpoint
Nov 19, 2024
ee2d339
added base FastUi app
Nov 19, 2024
dcdc863
🎨 Ensure profiling middleware is compatible with fastapi (#6760)
bisgaard-itis Nov 19, 2024
21eb313
Merge remote-tracking branch 'upstream/pydantic_v2_migration_do_not_s…
Nov 19, 2024
c7b2444
base SSE render demo
Nov 19, 2024
2d454e9
added app to sse endpoint
Nov 19, 2024
3a77ff5
renaming and adding prefix
Nov 19, 2024
c50d79c
♻️Pydantic V2: Unify errors dv 2 (#6763)
sanderegg Nov 19, 2024
0aea337
Uses typing_extensions.TypedDict in all instances used in pydantic mo…
pcrespov Nov 19, 2024
d973a81
Merge remote-tracking branch 'upstream/pydantic_v2_migration_do_not_s…
Nov 20, 2024
c49f421
♻️ Cleanup network AnyHttpUrlLegacy and HttpUrlLegacy (#6767)
giancarloromeo Nov 20, 2024
a0b8a2f
All errors in dynamic-sidecar inherit from `OsparcErrorMixin` (#6764)
GitHK Nov 20, 2024
dc32c96
Merge remote-tracking branch 'upstream/pydantic_v2_migration_do_not_s…
Nov 20, 2024
66a492f
♻️ Fix agent tests (#6772)
giancarloromeo Nov 20, 2024
ccc3ea7
Merge remote-tracking branch 'upstream/pydantic_v2_migration_do_not_s…
Nov 20, 2024
c38b064
Fixes [unit] webserver 03 and [unit] settings-library (both mypy and …
pcrespov Nov 20, 2024
150b17a
Merge remote-tracking branch 'upstream/master' into update-master-XXXXX
sanderegg Nov 20, 2024
17d1702
Merge pull request #6780 from sanderegg/update-master-XXXXX
sanderegg Nov 20, 2024
47e3570
⬆️Pydantic V2: missing import in director-v0 (#6781)
sanderegg Nov 20, 2024
6f63769
added reusable sse utils
Nov 21, 2024
3b6ee6f
Merge remote-tracking branch 'upstream/pydantic_v2_migration_do_not_s…
Nov 21, 2024
e6f5a5f
added base example to render service status
Nov 21, 2024
8108f9f
refactor toutes
Nov 21, 2024
3ebc16e
added some docstring
Nov 21, 2024
4e8bce9
propagate dataset as soon as possible
Nov 21, 2024
dc60766
renaming
Nov 21, 2024
928570d
added mock data provider
Nov 21, 2024
1ad36bf
docstrings
Nov 21, 2024
e2e75c2
Merge remote-tracking branch 'upstream/master' into pr-osparc-add-dyb…
Nov 21, 2024
891efb7
very rough first draft
Nov 21, 2024
40d2966
enhanced hashing
Nov 21, 2024
32f1044
added service details
Nov 21, 2024
78debb9
Merge remote-tracking branch 'upstream/master' into pr-osparc-add-dyb…
Nov 21, 2024
3f8115c
current WIP version with FastUI
Nov 22, 2024
5b0a357
replaced ui engine
Nov 25, 2024
8fb09d1
refactored UI first version
Nov 25, 2024
ef70773
refactor
Nov 25, 2024
7890cfc
Merge remote-tracking branch 'upstream/master' into pr-osparc-add-dyb…
Nov 25, 2024
4e4d014
sticky tarcking
Nov 26, 2024
a47c732
fixed update interval in UI and extended capability
Nov 26, 2024
76802fe
refactor
Nov 26, 2024
db61f1f
Merge remote-tracking branch 'upstream/master' into pr-osparc-add-dyb…
Nov 26, 2024
63b8f1e
remove stickyness
Nov 26, 2024
c74a2bb
rename
Nov 26, 2024
12fa00a
rename restructure
Nov 26, 2024
b2ffc56
ui touches
Nov 26, 2024
0613b9f
revert
Nov 26, 2024
ba618d2
Merge remote-tracking branch 'upstream/master' into pr-osparc-add-dyb…
Nov 26, 2024
73db351
added new makefile entry
Nov 26, 2024
6fbd1eb
added service count
Nov 26, 2024
209303e
typo
Nov 26, 2024
b7b1b44
remove note and fixed for pydantic2
Nov 26, 2024
1aae2e4
extended description
Nov 26, 2024
9a4dbfd
enhanced texts
Nov 26, 2024
25a9b95
feedback
Nov 26, 2024
de0db8c
fixed previously failing test
Nov 26, 2024
b183aff
using secret string
Nov 26, 2024
64c21dd
Merge remote-tracking branch 'upstream/master' into pr-osparc-add-dyb…
Nov 27, 2024
9d8ab8e
added back nicegui dependencies after merge
Nov 27, 2024
665c70d
fixed broken unit tests
Nov 27, 2024
1a3bdba
Merge remote-tracking branch 'upstream/master' into pr-osparc-add-dyb…
Nov 27, 2024
926d88d
added tests for index page to see if it renders as expected
Nov 27, 2024
da197d4
refactor stop dialog
Nov 27, 2024
46fb5d0
rename
Nov 27, 2024
696ff79
added base tests with playwright
Dec 2, 2024
179ac90
fixed test
Dec 2, 2024
c19c878
Merge remote-tracking branch 'upstream/master' into pr-osparc-add-dyb…
Dec 2, 2024
5fb1314
added tests for service details
Dec 2, 2024
1db89fe
fixed interface rendering
Dec 2, 2024
d65d155
refactor
Dec 2, 2024
10dafbd
refactor page rendering
Dec 2, 2024
f98a96d
added 404 test
Dec 2, 2024
1d488c8
fixed broken tests
Dec 3, 2024
0f3374e
Merge remote-tracking branch 'upstream/master' into pr-osparc-add-dyb…
Dec 3, 2024
e79e6af
Merge branch 'master' into pr-osparc-add-dybamic-services-monitor-das…
GitHK Dec 4, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'origin/master' into pydantic_v2_migrati…
…on_do_not_squash_updates
sanderegg committed Oct 22, 2024
commit 1c833e012323b6f4dbfe576ef41ad6e395aeecf6
28 changes: 24 additions & 4 deletions .env-devel
Original file line number Diff line number Diff line change
@@ -25,6 +25,8 @@ TRAEFIK_API_SERVER_INFLIGHTREQ_AMOUNT=25

AUTOSCALING_DASK=null
AUTOSCALING_DRAIN_NODES_WITH_LABELS=False
AUTOSCALING_DOCKER_JOIN_DRAINED=True
AUTOSCALING_WAIT_FOR_CLOUD_INIT_BEFORE_WARM_BUFFER_ACTIVATION=False
AUTOSCALING_EC2_ACCESS=null
AUTOSCALING_EC2_INSTANCES=null
AUTOSCALING_LOGLEVEL=WARNING
@@ -48,6 +50,7 @@ CLUSTERS_KEEPER_COMPUTATIONAL_BACKEND_DOCKER_IMAGE_TAG=master-github-latest
CLUSTERS_KEEPER_DASK_NTHREADS=0
CLUSTERS_KEEPER_DASK_WORKER_SATURATION=inf
CLUSTERS_KEEPER_EC2_ACCESS=null
CLUSTERS_KEEPER_SSM_ACCESS=null
CLUSTERS_KEEPER_EC2_INSTANCES_PREFIX=""
CLUSTERS_KEEPER_LOGLEVEL=WARNING
CLUSTERS_KEEPER_MAX_MISSED_HEARTBEATS_BEFORE_CLUSTER_TERMINATION=5
@@ -101,8 +104,9 @@ DYNAMIC_SIDECAR_IMAGE=${DOCKER_REGISTRY:-itisfoundation}/dynamic-sidecar:${DOCKE
DYNAMIC_SIDECAR_LOG_LEVEL=DEBUG
DYNAMIC_SIDECAR_PROMETHEUS_MONITORING_NETWORKS=[]
DYNAMIC_SIDECAR_PROMETHEUS_SERVICE_LABELS={}
DYNAMIC_SIDECAR_API_SAVE_RESTORE_STATE_TIMEOUT=3600
# DIRECTOR_V2 ----

DYNAMIC_SCHEDULER_LOGLEVEL=DEBUG
DYNAMIC_SCHEDULER_PROFILING=1
DYNAMIC_SCHEDULER_STOP_SERVICE_TIMEOUT=3600

@@ -149,6 +153,10 @@ POSTGRES_PASSWORD=adminadmin
POSTGRES_PORT=5432
POSTGRES_USER=scu

POSTGRES_READONLY_PASSWORD=readonly
POSTGRES_READONLY_USER=postgres_readonly


RABBIT_HOST=rabbit
RABBIT_PASSWORD=adminadmin
RABBIT_PORT=5672
@@ -158,6 +166,8 @@ RABBIT_USER=admin
REDIS_HOST=redis
REDIS_PORT=6379
REDIS_PASSWORD=adminadmin
REDIS_SECURE=false
REDIS_USER=null

REGISTRY_AUTH=True
REGISTRY_PW=adminadminadmin
@@ -211,6 +221,13 @@ STORAGE_PROFILING=1

SWARM_STACK_NAME=master-simcore

## VENDOR DEVELOPMENT SERVICES ---
VENDOR_DEV_MANUAL_IMAGE=containous/whoami
VENDOR_DEV_MANUAL_REPLICAS=1
VENDOR_DEV_MANUAL_SUBDOMAIN=manual

## VENDOR DEVELOPMENT SERVICES ---

WB_API_WEBSERVER_HOST=wb-api-server
WB_API_WEBSERVER_PORT=8080

@@ -282,6 +299,7 @@ WB_DB_EL_WALLETS=0

# WEBSERVER ----
AIODEBUG_SLOW_DURATION_SECS=0
DIAGNOSTICS_HEALTHCHECK_ENABLED=False
DIAGNOSTICS_MAX_AVG_LATENCY=10
DIAGNOSTICS_MAX_TASK_DELAY=30
DIAGNOSTICS_SLOW_DURATION_SECS=1
@@ -303,9 +321,11 @@ SESSION_COOKIE_SECURE=False
SIMCORE_VCS_RELEASE_TAG=latest
STUDIES_ACCESS_ANONYMOUS_ALLOWED=0
STUDIES_DEFAULT_SERVICE_THUMBNAIL=https://via.placeholder.com/170x120.png
TRACING_ENABLED=1
TRACING_THRIFT_COMPACT_ENDPOINT=http://jaeger:5775
TRACING_ZIPKIN_ENDPOINT=http://jaeger:9411
TRACING_OPENTELEMETRY_COLLECTOR_BATCH_SIZE=2
TRACING_OPENTELEMETRY_COLLECTOR_PORT=4318
TRACING_OPENTELEMETRY_COLLECTOR_ENDPOINT=http://opentelemetry-collector
TRACING_OPENTELEMETRY_COLLECTOR_SAMPLING_PERCENTAGE=100
TRACING_OPENTELEMETRY_COLLECTOR_EXPORTER_ENDPOINT=http://jaeger:4318
TRAEFIK_SIMCORE_ZONE=internal_simcore_stack
TWILIO_ACCOUNT_SID=DUMMY
TWILIO_AUTH_TOKEN=DUMMY
6 changes: 0 additions & 6 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
@@ -12,9 +12,6 @@ updates:
assignees:
- pcrespov
ignore:
- dependency-name: aiozipkin
versions:
- ">= 1.a, < 2"
- dependency-name: docker-compose
versions:
- 1.28.2
@@ -41,9 +38,6 @@ updates:
assignees:
- pcrespov
ignore:
- dependency-name: aiozipkin
versions:
- ">= 1.a, < 2"
- dependency-name: openapi-core
versions:
- "> 0.12.0, < 1"
Loading
You are viewing a condensed version of this merge commit. You can view the full changes here.