TimeoutError: timed out during opening handshake

[yukixoma]

I'm just follow the guide at https://visionagents.ai/introduction/voice-agents and this error occurred.
I've checked my Google's Generative Language API Key and it's just working normally.

INFO:stream-test123.dispatcher:🚀 Starting Stream Agents dispatcher...
INFO:vision_agents.core.events.manager:Handler _on_track_published from vision_agents.plugins.getstream.stream_edge_transport registered for event stream.video.sfu.event.TrackPublished
INFO:vision_agents.core.events.manager:Handler _on_track_removed from vision_agents.plugins.getstream.stream_edge_transport registered for event stream.video.sfu.event.ParticipantLeft
INFO:vision_agents.core.events.manager:Handler _on_track_removed from vision_agents.plugins.getstream.stream_edge_transport registered for event stream.video.sfu.event.TrackUnpublished
INFO:Agent[agent]:Registered plugin <vision_agents.plugins.gemini.gemini_realtime.Realtime object at 0x000001E157A11710>
INFO:Agent[agent]:Registered plugin <vision_agents.plugins.getstream.stream_edge_transport.StreamEdge object at 0x000001E157A11A10>
INFO:vision_agents.core.events.manager:Handler _handle_after_response from vision_agents.core.agents.agents registered for event plugin.llm_response_completed
INFO:vision_agents.core.events.manager:Handler _handle_output_text_delta from vision_agents.core.agents.agents registered for event plugin.llm_response_chunk
INFO:vision_agents.core.events.manager:Event <class 'vision_agents.core.vad.events.VADAudioEvent'> - plugin.vad_audio is not registered – skipping handler _on_vad_audio from vision_agents.core.agents.agents.
INFO:vision_agents.core.events.manager:Handler _on_agent_say from vision_agents.core.agents.agents registered for event agent.say
INFO:Agent[agent]:🎵 Using Realtime provider output track for audio
INFO:httpx:HTTP Request: POST https://chat.stream-io-api.com/api/v2/users?api_key=***"HTTP/1.1 201 Created"
INFO:httpx:HTTP Request: POST https://chat.stream-io-api.com/api/v2/users?api_key=***"HTTP/1.1 201 Created"
INFO:httpx:HTTP Request: POST https://chat.stream-io-api.com/api/v2/chat/channels/messaging/566a41e5-0f40-443d-ba6c-2632c8cb1593/query?api_key=bfrgus8xcu9c "HTTP/1.1 201 Created"
🌐 Opening browser to: https://getstream.io/video/demos/join/566a41e5-0f40-443d-ba6c-2632c8cb1593?api_key=***&token=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpYXQiOjE3NjA3MTY4MjMsInVzZXJfaWQiOiJ1c2VyLWRlbW8tYWdlbnQiLCJleHAiOjE3NjA3MjA0MjN9.KhzfpUn18DV6ejP-pw3W9CQmynkf8OPTShiqpmI4ttk&skip_lobby=true&user_name=Human+User&video_encoder=vp8&bitrate=12000000&w=1920&h=1080&channel_type=messaging
✅ Browser opened successfully!
INFO:httpx:[call:566a41e5-0f40-443d-ba6c-2632c8cb1593] HTTP Request: POST https://chat.stream-io-api.com/api/v2/chat/channels/messaging/566a41e5-0f40-443d-ba6c-2632c8cb1593/query?api_key=***"HTTP/1.1 201 Created"
INFO:vision_agents.plugins.getstream.stream_conversation:[call:566a41e5-0f40-443d-ba6c-2632c8cb1593] Started API worker thread for channel 566a41e5-0f40-443d-ba6c-2632c8cb1593
INFO:vision_agents.core.events.manager:[call:566a41e5-0f40-443d-ba6c-2632c8cb1593] Event <class 'vision_agents.core.stt.events.STTTranscriptEvent'> - plugin.stt_transcript is not registered – skipping handler _on_transcript from vision_agents.core.agents.agents.
INFO:vision_agents.core.events.manager:[call:566a41e5-0f40-443d-ba6c-2632c8cb1593] Handler _on_transcript from vision_agents.core.agents.agents registered for event plugin.realtime_transcript
INFO:vision_agents.core.events.manager:[call:566a41e5-0f40-443d-ba6c-2632c8cb1593] Event <class 'vision_agents.core.stt.events.STTPartialTranscriptEvent'> - plugin.stt_partial_transcript is not registered – skipping handler _on_partial_transcript from vision_agents.core.agents.agents.
INFO:vision_agents.core.events.manager:[call:566a41e5-0f40-443d-ba6c-2632c8cb1593] Handler _on_partial_transcript from vision_agents.core.agents.agents registered for event plugin.realtime_partial_transcript
INFO:Agent[agent]:[call:566a41e5-0f40-443d-ba6c-2632c8cb1593] 🤖 Agent joining call: 566a41e5-0f40-443d-ba6c-2632c8cb1593
INFO:vision_agents.plugins.gemini.gemini_realtime:[call:566a41e5-0f40-443d-ba6c-2632c8cb1593] Connecting to gemini live, config set to {'response_modalities': [<Modality.AUDIO: 'AUDIO'>], 'input_audio_transcription': {}, 'output_audio_transcription': {}, 'speech_config': {'voice_config': {'prebuilt_voice_config': {'voice_name': 'Leda'}}, 'language_code': 'en-US'}, 'realtime_input_config': {'turn_coverage': <TurnCoverage.TURN_INCLUDES_ONLY_ACTIVITY: 'TURN_INCLUDES_ONLY_ACTIVITY'>}, 'enable_affective_dialog': False, 'context_window_compression': {'trigger_tokens': 25600, 'sliding_window': {'target_tokens': 12800}}}
Traceback (most recent call last):
  File "C:\Users\yukix\Desktop\getstream-vision-agents\.venv\Lib\site-packages\websockets\asyncio\client.py", line 541, in __await_impl__
    self.connection = await self.create_connection()
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\yukix\Desktop\getstream-vision-agents\.venv\Lib\site-packages\websockets\asyncio\client.py", line 467, in create_connection
    _, connection = await loop.create_connection(factory, **kwargs)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\Python311\Lib\asyncio\base_events.py", line 1070, in create_connection
    sock = await self._connect_sock(
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\Python311\Lib\asyncio\base_events.py", line 974, in _connect_sock
    await self.sock_connect(sock, address)
  File "C:\Program Files\Python311\Lib\asyncio\proactor_events.py", line 726, in sock_connect
    return await self._proactor.connect(sock, address)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "C:\Users\yukix\Desktop\getstream-vision-agents\.venv\Lib\site-packages\websockets\asyncio\client.py", line 539, in __await_impl__
    async with asyncio_timeout(self.open_timeout):
  File "C:\Program Files\Python311\Lib\asyncio\timeouts.py", line 115, in __aexit__
    raise TimeoutError from exc_val
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "C:\Users\yukix\Desktop\getstream-vision-agents\main.py", line 48, in <module>
    asyncio.run(cli.start_dispatcher(start_agent))
  File "C:\Program Files\Python311\Lib\asyncio\runners.py", line 190, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "C:\Program Files\Python311\Lib\asyncio\runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\Python311\Lib\asyncio\base_events.py", line 654, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "C:\Users\yukix\Desktop\getstream-vision-agents\.venv\Lib\site-packages\vision_agents\core\cli.py", line 57, in start_dispatcher
    await agent_func()
  File "C:\Users\yukix\Desktop\getstream-vision-agents\main.py", line 37, in start_agent
    with await agent.join(call):
         ^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\yukix\Desktop\getstream-vision-agents\.venv\Lib\site-packages\vision_agents\core\agents\agents.py", line 226, in join
    await self.llm.connect()
  File "C:\Users\yukix\Desktop\getstream-vision-agents\.venv\Lib\site-packages\vision_agents\plugins\gemini\gemini_realtime.py", line 154, in connect
    self._session = await self._session_context.__aenter__()
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Program Files\Python311\Lib\contextlib.py", line 210, in __aenter__
    return await anext(self.gen)
           ^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\yukix\Desktop\getstream-vision-agents\.venv\Lib\site-packages\google\genai\live.py", line 1069, in connect
    async with ws_connect(
  File "C:\Users\yukix\Desktop\getstream-vision-agents\.venv\Lib\site-packages\websockets\asyncio\client.py", line 587, in __aenter__
    return await self
           ^^^^^^^^^^
  File "C:\Users\yukix\Desktop\getstream-vision-agents\.venv\Lib\site-packages\websockets\asyncio\client.py", line 578, in __await_impl__
    raise TimeoutError("timed out during opening handshake") from exc
TimeoutError: timed out during opening handshake

[d3xvn]

Hey @yukixoma 👋

I'd like to understand this issue better.

Could you run the example here and let me know if the same thing happens?

Whether or not the above works, can you send a sample of your code I could use to understand what's going wrong?

Thanks.