AWS Bedrock Nova 2 Sonic, Amazon Kinesis Video Streams with WebRTC, 실시간 오디오/비디오 처리.

표본 해결책 건축술:

♨ 특징

기능

• ** 실시간 WebRTC 통신**: Amazon KVS WebRTC를 이용한 저전력 오디오 스트리밍
• AI-Powered Speech Processing: AWS Bedrock Nova Sonic와의 통합
• Cross-Platform 지원: Windows, macOS 및 Linux에서 원활하게 작동 -Production Ready: 개발 및 생산 환경에 최적화
• Modular Architecture: 플래티넘 백엔드와 React가 유연성을 위해
• Agent Integration: MCP 지원 (모델 콘텍스트 프로토콜) 및 물가 에이전트

시스템 요구 사항

테스트 구성

이 해결책은 뒤에 오는 정확한 버전으로 시험되고 확인되었습니다:

** 코어 의존도 : **

• Python: 3.12.x
• numpy: 1.26.4 (Av 의존성으로 conda를 통해 설치)
• av (PyAV): 11.0.0 (FFmpeg 연결에 대 한 conda를 통해 설치) -aiortc: 1.6.0 (정밀 관리와 pip를 통해 설치)
• ** ffmpeg**: 6.1.2+ ( conda를 통해 설치)

Nova S2S WebRTC Workshop

A comprehensive Speech-to-Speech (S2S) WebRTC solution integrating AWS Bedrock Nova 2 Sonic, Amazon Kinesis Video Streams with WebRTC, and real-time audio/video processing.

The sample solution architecture:

🚀 Features

Capabilities

• Real-time WebRTC Communication: Low-latency audio streaming using Amazon KVS WebRTC
• AI-Powered Speech Processing: Integration with AWS Bedrock Nova Sonic for advanced speech-to-speech capabilities
• Cross-Platform Support: Works seamlessly on Windows, macOS, and Linux
• Production Ready: Optimized for both development and production environments
• Modular Architecture: Separate Python backend and React frontend for flexibility
• Agent Integration: Support for MCP (Model Context Protocol) and Strands agents

📋 System Requirements

Tested Configuration

This solution has been tested and verified with the following exact versions:

Core Dependencies:

• Python: 3.12.x
• numpy: 1.26.4 (installed via conda as av dependency)
• av (PyAV): 11.0.0 (installed via conda for FFmpeg linking)
• aiortc: 1.6.0 (installed via pip with dependency management)
• ffmpeg: 6.1.2+ (installed via conda)

AWS SDK:

• boto3: ≥1.34.0
• aws-sdk-bedrock-runtime: ≥0.0.1
• smithy-aws-core: ≥0.1.0

Agent Integration:

• mcp: ≥1.0.0
• strands-agents: ≥0.1.0

Hardware Requirements

• CPU: Multi-core processor (Intel i5/AMD Ryzen 5 or better recommended)
• RAM: Minimum 4GB, 8GB recommended for optimal performance
• Storage: At least 2GB free space for dependencies and build files
• Network: Stable internet connection with low latency for real-time communication
• Audio: Microphone and speakers/headphones for testing

Software Requirements

Cross-Platform Support

• Windows: Windows 10 or later
• macOS: macOS 10.15 (Catalina) or later (Intel and Apple Silicon)
• Linux: Ubuntu 18.04+, CentOS 7+, or equivalent distributions

Python Backend

• Python: 3.12 (required for AWS Bedrock runtime)
• Conda: Miniconda or Anaconda (required for proper FFmpeg/PyAV linking)
• System Dependencies: ffmpeg, pkg-config (automatically handled by conda)

React Frontend

• Node.js: 16.0 or higher (18.x LTS recommended)
• npm: 8.0 or higher (comes with Node.js)
• Browser: Modern browser with WebRTC support (Chrome 80+, Firefox 75+, Safari 14+, Edge 80+)

AWS Requirements

• AWS Account: Active AWS account with appropriate permissions
• AWS Services Access:
  • Amazon Kinesis Video Streams
  • AWS Bedrock (Nova Sonic model access)
  • IAM permissions for KVS and Bedrock

🏗️ Project Structure

sample-nova-sonic-speech2speech-webrtc/
├── README.md                    # This file
├── start-python-server.sh      # Python server launcher script (cross-platform)