Help running call automation python sample

[oradcliffe]

Has anyone successfully run the call automation sample? I am getting an error "DefaultAzureCredential failed to retrieve a token from the included credentials. Attempted credentials: EnvironmentCredential: EnvironmentCredential authentication unavailable. Environment variables are not fully configured."

As far as I can tell, my environmental variables are configured. Everything else seems to work, dev tunnel is up, app runs, event grid hands call off to the (local) app, but have an issue connecting to openAI realtime model.

If there are any gotchas that aren't called out in the docs I might be missing, I would love to hear about it.

[moonbox3]

Hi @oradcliffe, are you trying to use the DefaultAzureCredential for authentication? Can you give more details on which exact sample you're trying to run? OpenAI or Azure OpenAI? A more complete stack trace? Thanks.

[oradcliffe]

Hi @moonbox3 - I am trying to run the call automation sample, found here. I'm using Azure Open AI with a realtime model deployed.

Here's what I am seeing most recently - previously I was getting a message that I didn't have environmental credentials but after throwing everything away and starting fresh, I am seeing this:

[2025-03-27 16:36:55,387] INFO in call_automation: incoming call handler caller id: +14061234567
[2025-03-27 16:36:55,387] INFO in call_automation: callback url: https://XXXXXX-8080.use.devtunnels.ms/api/callbacks/2fe6b126-2717-41b3-91ac-1588695a66be?callerId=%2B14061234567
[2025-03-27 16:36:55,387] INFO in call_automation: websocket url: wss://XXXXXX-8080.use.devtunnels.ms/ws
[2025-03-27 16:36:57,438] INFO in call_automation: Answered call for connection id: 21005880-e012-4fb9-85c5-7915e7319bfb
[2025-03-27 16:36:57 +0000] [8004] [INFO] 127.0.0.1:45576 POST /api/incomingCall 1.1 200 - 2056148
[2025-03-27 16:36:58,836] INFO in call_automation: Client connected to WebSocket
[2025-03-27 16:37:00,433] ERROR in app: Exception on websocket /ws
Traceback (most recent call last):
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/quart/app.py", line 1476, in handle_websocket
return await self.full_dispatch_websocket(websocket_context)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/quart/app.py", line 1525, in full_dispatch_websocket
result = await self.handle_user_exception(error)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/quart/app.py", line 1059, in handle_user_exception
raise error
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/quart/app.py", line 1523, in full_dispatch_websocket
result = await self.dispatch_websocket(websocket_context)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/quart/app.py", line 1613, in dispatch_websocket
return await self.ensure_async(handler)(**websocket_.view_args) # type: ignore[return-value]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/workspaces/semantic-kernel/python/samples/demos/call_automation/call_automation.py", line 181, in ws
async with client(settings=settings, create_response=True, kernel=kernel):
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/semantic_kernel/connectors/ai/realtime_client_base.py", line 127, in aenter
await self.create_session(self._chat_history, self._settings)
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/semantic_kernel/connectors/ai/open_ai/services/_open_ai_realtime.py", line 889, in create_session
self.connection = await self.client.beta.realtime.connect(model=self.ai_model_id).enter()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/openai/resources/beta/realtime/realtime.py", line 379, in aenter
await connect(
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/websockets/asyncio/client.py", line 446, in await_impl
await self.connection.handshake(*self.handshake_args)
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/websockets/asyncio/client.py", line 104, in handshake
raise self.protocol.handshake_exc
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/websockets/client.py", line 340, in parse
self.process_response(response)
File "/home/codespace/.cache/uv/environments-v2/call-automation-535d4a790269f4c3/lib/python3.12/site-packages/websockets/client.py", line 151, in process_response
raise InvalidStatus(response)
websockets.exceptions.InvalidStatus: server rejected WebSocket connection: HTTP 404
[2025-03-27 16:37:00 +0000] [8004] [INFO] 127.0.0.1:45576 GET /ws 1.1 500 265 1608268
[2025-03-27 16:37:03,018] INFO in call_automation: Received Event:-> Microsoft.Communication.ParticipantsUpdated, Correlation Id:-> 1b07f579-df00-470e-ac73-4281ed03f4ef, CallConnectionId:-> 21005880-e012-4fb9-85c5-7915e7319bfb
[2025-03-27 16:37:03 +0000] [8004] [INFO] 127.0.0.1:34124 POST /api/callbacks/2fe6b126-2717-41b3-91ac-1588695a66be 1.1 200 - 1652
[2025-03-27 16:37:04,196] INFO in call_automation: Received Event:-> Microsoft.Communication.CallConnected, Correlation Id:-> 1b07f579-df00-470e-ac73-4281ed03f4ef, CallConnectionId:-> 21005880-e012-4fb9-85c5-7915e7319bfb
[2025-03-27 16:37:04,283] INFO in call_automation: MediaStreamingSubscription:--> {'additional_properties': {}, 'id': '5cfaaf6b-4675-4f82-8502-221c50cd4711', 'state': 'inactive', 'subscribed_content_types': ['audio']}
[2025-03-27 16:37:04,283] INFO in call_automation: Received CallConnected event for connection id: 21005880-e012-4fb9-85c5-7915e7319bfb
[2025-03-27 16:37:04,283] INFO in call_automation: CORRELATION ID:--> 1b07f579-df00-470e-ac73-4281ed03f4ef
[2025-03-27 16:37:04,283] INFO in call_automation: CALL CONNECTION ID:--> 21005880-e012-4fb9-85c5-7915e7319bfb
[2025-03-27 16:37:04 +0000] [8004] [INFO] 127.0.0.1:34140 POST /api/callbacks/2fe6b126-2717-41b3-91ac-1588695a66be 1.1 200 - 88002
[2025-03-27 16:37:04,655] INFO in call_automation: Received Event:-> Microsoft.Communication.MediaStreamingFailed, Correlation Id:-> 1b07f579-df00-470e-ac73-4281ed03f4ef, CallConnectionId:-> 21005880-e012-4fb9-85c5-7915e7319bfb
[2025-03-27 16:37:04,655] INFO in call_automation: Code:->400, Subcode:-> 8581
[2025-03-27 16:37:04,656] INFO in call_automation: Message:->Action failed, Transport url is not valid or web socket server is not operational.

[oradcliffe]

For what it's worth, I've had to do a lot of trial and error to get this far. Here are my notes from a second go:

Re-cloned repo
Opened in dev container
Install python, python debugger extensions
Open Bash
Install UV
- curl -LsSf https://astral.sh/uv/install.sh | sh

/home/codespace/bin/devtunnel user login
/home/codespace/bin/devtunnel create --allow-anonymous
/home/codespace/bin/devtunnel port create -p 8080
/home/codespace/bin/devtunnel host

Take note of 'connect via browser'
e.g. https://XXXXXX-8080.use.devtunnels.ms

Open second terminal (leave dev tunnel running)
cd python/samples/demos/call_automation/

Rename .env.example to .env
- Fill in variables
- Need a realtime model
- API version '2025-03-01-preview'

uv run --env-file .env call_automation.py

Update event grid with tunnel URL (/api/incomingCall)
e.g. https://XXXXXX-8080.use.devtunnels.ms/api/incomingCall

[moonbox3]

Thanks for the extra context, @oradcliffe. I created an issue (#11237) to better track this. Please follow along there for any further updates.