dbt debug connection error with OAuth AAD Service Principal

[turagittech]

Describe the bug

dbt debug connection error with OAuth AAD Service Principal

Steps To Reproduce

I have a VM as an Azure DevOps build server. Databricks is fully secured with no public endpoints. I cannot successfully connect dbt with OAuth from VM even though the VM can connect to Databricks through the web UI in a browser and to the server via Databricks CLI using the Oauth credentials which are failing when using dbt.

Expected behavior

dbt debug to run and connect successfully

Screenshots and log output

System information

The output of dbt --version:

WARNING:thrift.transport.sslcompat:using legacy validation callback
/mnt/c/apps/agent/_work/r6/a/SEMPHN_Migrations_dbt/semphn/dbtenv/lib/python3.12/site-packages/pydantic/_internal/_config.py:373: UserWarning: Valid config keys have changed in V2:
* 'allow_population_by_field_name' has been renamed to 'validate_by_name'
  warnings.warn(message, UserWarning)
Core:
  - installed: 1.9.4
  - latest:    1.9.4 - Up to date!

Plugins:
  - databricks: 1.10.0 - Up to date!
  - spark:      1.9.2  - Up to date!

The operating system you're using:
Windows Subsystem for Linux Distributions:
Ubuntu-24.04 (Default)
on Windows Server 2022
The output of python --version:
WARNING:thrift.transport.sslcompat:using legacy validation callback
/mnt/c/apps/agent/_work/r6/a/SEMPHN_Migrations_dbt/semphn/dbtenv/lib/python3.12/site-packages/pydantic/_internal/_config.py:373: UserWarning: Valid config keys have changed in V2:

• 'allow_population_by_field_name' has been renamed to 'validate_by_name'
  warnings.warn(message, UserWarning)
  Core:
  • installed: 1.9.4
  • latest: 1.9.4 - Up to date!

Plugins:

• databricks: 1.10.0 - Up to date!
• spark: 1.9.2 - Up to date!

Additional context

Nothing here

[benc-db]

@eric-wang-1990 do you have any ideas what may be the issue?