Python: Add Azure DB for PostgreSQL vector store

[lossyrob]

Motivation and Context

This adds a VectorStore for Azure DB for PostgreSQL.

Currently, the only additional functionality this provides over the PostgresVectorStore is to easily connect to the database using Entra authentication. In the future, we will add capability to leverage the new DiskANN indexing.

Description

• Leverage the ability to pass in a custom AsyncConnection class to psycopg_pool's AsyncConnectionPool. The custom AsyncEntraConnection class will identify if a azure.core.credentials TokenCredential or AsyncTokenCredential has been passed as a 'credential' connection argument, or supply the DefaultAzureCredentials if no user or password has been set. This will be used to set the username and password for the Entra user for each new connection the pool creates.
• The AzureDBForPosgresSettings overrides methods from PostgresSettings to provide Entra authentication, allowing the user and password to not be set and generating the connection pool with AsyncEntraConnection
• The tutorial was updated to allow the user to choose either AzureDBForPostgres or Postgres as the vector store.

TODO:

• Unit tests
• Integration tests

Contribution Checklist

• The code builds clean without any errors or warnings
• The PR follows the SK Contribution Guidelines and the pre-submission formatting script raises no violations
• All unit tests pass, and I have added new tests where possible
• I didn't break anyone 😄

[markwallace-microsoft]

Python Unit Test Overview

Tests	Skipped	Failures	Errors	Time
2659	4 💤	0 ❌	0 🔥	1m 22s ⏱️

[moonbox3]

Hi @lossyrob, is this PR ready for a review?

[markwallace-microsoft]

Python Test Coverage Report •

File	Stmts	Miss	Cover	Missing
semantic_kernel/connectors/memory/azure_db_for_postgres
__init__.py	4	4	0%	3–11
azure_db_for_postgres_collection.py	13	13	0%	2–50
azure_db_for_postgres_settings.py	40	40	0%	2–99
azure_db_for_postgres_store.py	3	3	0%	3–9
constants.py	3	3	0%	3–6
entra_connection.py	48	48	0%	2–81
TOTAL	16860	1880	89%

Python Unit Test Overview

Tests	Skipped	Failures	Errors	Time
2995	4 💤	0 ❌	0 🔥	1m 11s ⏱️

[lossyrob]

@moonbox3 sorry for the late reply, I'm just getting back from parental leave. This is ready for review, but I'm still working on testing. I don't see a good way to unit test this code, as it really only adds the ability to create a custom psycopg connection class that uses Entra auth, which is hard to mock and have substantial tests around. I need to create integration tests, which will be more substantial. This will require a PostgreSQL flex server that uses Entra authentication, along with a service principal available to the integration test runner to utilize during the integration tests. Is a service principal already available in that environment? Would it be possible to get a small Azure DB for PostgreSQL flex server with entra auth enabled and the proper IAM roles assigned in the integration test environment?

[moonbox3]

@moonbox3 sorry for the late reply, I'm just getting back from parental leave. This is ready for review, but I'm still working on testing. I don't see a good way to unit test this code, as it really only adds the ability to create a custom psycopg connection class that uses Entra auth, which is hard to mock and have substantial tests around. I need to create integration tests, which will be more substantial. This will require a PostgreSQL flex server that uses Entra authentication, along with a service principal available to the integration test runner to utilize during the integration tests. Is a service principal already available in that environment? Would it be possible to get a small Azure DB for PostgreSQL flex server with entra auth enabled and the proper IAM roles assigned in the integration test environment?

Thanks for your reply, @lossyrob. Let me check on this for you and I'll get back to you soon.