专注于Android开发，分享经验总结，欢迎加入

QQ群

内容比较多，请耐心阅读

1、Google Webrtc介绍

WebRTC（Web Real-Time Communication）实现了基于网页的视频会议，标准是WHATWG 协议，目的是通过浏览器提供简单的javascript就可以达到实时通讯（Real-Time Communications (RTC)）能力。提供了视频会议的核心技术，包括音视频的采集、编解码、网络传输、显示等功能，并且还支持跨平台：windows，linux，mac，android，音视频通讯技术是基于p2p实现的

2、Google Webrtc服务器配置

信令服务器(signaling)，转发服务器(TURN)，穿透服务器(STUN)（自行百度，配置），更详细的介绍请看书籍 WebRtc权威指南

  • 信令服务器(signaling)

    • WebRTC 之间使用PeerConnection交流数据，但还需要一种机制来协调沟通和发送控制消息，这一过程称之为信令传输

  • 转发服务器(TURN) & 穿透服务器(STUN)

    • WebRTC 被设计为点对点工作模式，所以用户之间是尽可能地通过最短路线进行连接，然而在现实世界当中：客户端应用需要穿透 NAT 网关 和防火墙，并且点对点网络需要握手来防止直接连接失败，在这一过程中，WebRTC使用STUN服务器和TURN服务器来获取计算机IP地址来保证点对点连接成功
3、ICE框架

基于信令协议的多媒体传输是一个两段式传输，首先通过信令协议（如WebSocket）建立一个连接，通过该连接，双方交换传输媒体时所必须的信息。基于传输效率的考虑，在完成第一阶段的交互之后，通信双方会建立一条通道来实现媒体传输，以减少传输时延、降低丢包率并减少开销。由于使用新的链路，当传输双方有任意一方位于NAT之后，新的传输链路就需要考虑NAT穿越的问题了通常有四种形式的NAT，每一种NAT都有相应的解决方案，然而在复杂的网络环境中，由于每一种NAT穿越方案都局限于对应的NAT方式，这些方案就给整个系统带来了一定的复杂性。在这种背景下，交互式连通建立方式(Interactive Connectivity Establishment)即ICE解决方案应运而生，ICE能够在不增加整个系统的复杂性和脆弱性的情况下，实现对各种形式的NAT的穿越。

官方提供的实现原理 基于下图

google提供原理图

4、Android Webrtc的配置

客户端和服务端通信 采用WebSocket

摄像头，录音，SD卡读取等其他权限加入，有些需要在运行时调用

4.1 在build.gradle 引入websocket 和 webrtc
dependencies {
	    implementation 'org.webrtc:google-webrtc:1.0.28513'
	    implementation 'org.java-websocket:Java-WebSocket:1.4.0'
	    implementation 'com.google.code.gson:gson:2.8.5'
	}
5、Android Webrtc的使用
5.1 创建websocket
 private void connectionWebsocket() {
        try {
            webSocketClient = new WebSocketClient(URI.create(Constant.URL)) {
                @Override
                public void onOpen(ServerHandshake handshakedata) {
                    setText("已连接");
                    Log.e(TAG, "onOpen == Status == " + handshakedata.getHttpStatus() + " StatusMessage == " + handshakedata.getHttpStatusMessage());
                    Model model = new Model(Constant.REGISTER, getFromName(), getFrom(), getToName(), getTo());
                    webSocketClient.send(new Gson().toJson(model));
                }

                @Override
                public void onMessage(String message) {
                    Log.e(TAG, "onMessage == " + message);
                    if (!TextUtils.isEmpty(message)) {
                        Model model = new Gson().fromJson(message, Model.class);
                        if (model != null) {
                            String id = model.getId();
                            if (!TextUtils.isEmpty(id)) {
                                int isSucceed = model.getIsSucceed();
                                switch (id) {
                                    case Constant.REGISTER_RESPONSE:
                                        if (isSucceed == Constant.RESPONSE_SUCCEED) {
                                            Message msg = new Message();
                                            msg.obj = Constant.OPEN;
                                            handler.sendMessage(msg);
                                            Log.e(TAG, "连接成功");
                                        } else if (isSucceed == Constant.RESPONSE_FAILURE) {
                                            Log.e(TAG, "注册失败，已经注册");
                                        }
                                        break;
                                    case Constant.CALL_RESPONSE:
                                        if (isSucceed == Constant.RESPONSE_SUCCEED) {
                                            Log.e(TAG, "对方在线，创建sdp offer");
                                            createOffer();
                                        } else if (isSucceed == Constant.RESPONSE_FAILURE) {
                                            Log.e(TAG, "对方不在线，连接失败");
                                        }
                                        break;
                                    case Constant.INCALL:
                                        isIncall();
                                        break;
                                    case Constant.INCALL_RESPONSE:
                                        if (isSucceed == Constant.RESPONSE_SUCCEED) {
                                            createOffer();
                                            Log.e(TAG, "对方同意接听");
                                        } else if (isSucceed == Constant.RESPONSE_FAILURE) {
                                            Log.e(TAG, "对方拒绝接听");
                                        }
                                        break;
                                    case Constant.OFFER:
                                        //收到对方offer sdp
                                        SessionDescription sessionDescription1 = model.getSessionDescription();
                                        peerConnection.setRemoteDescription(observer, sessionDescription1);
                                        createAnswer();
                                        break;
                                    case Constant.CANDIDATE:
                                        //服务端 发送 接收方sdpAnswer
                                        IceCandidate iceCandidate = model.getIceCandidate();
                                        if (iceCandidate != null) {
                                            peerConnection.addIceCandidate(iceCandidate);
                                        }
                                        break;
                                }
                            }
                        }
                    }
                }

                @Override
                public void onClose(int code, String reason, boolean remote) {
                    setText("已关闭");
                    Log.e(TAG, "onClose == code " + code + " reason == " + reason + " remote == " + remote);
                }

                @Override
                public void onError(Exception ex) {
                    setText("onError == " + ex.getMessage());
                    Log.e(TAG, "onError== " + ex.getMessage());
                }
            };
            webSocketClient.connect();
        } catch (Exception e) {
            Log.d(TAG, "socket Exception : " + e.getMessage());
        }
    }
5.2 创建websocket成功后开始创建PeerConnection，穿透服务器采用Google提供的(“stun:stun.l.google.com:19302”)
private void createPeerConnection() {
        //Initialising PeerConnectionFactory
        InitializationOptions initializationOptions = InitializationOptions.builder(this)
                .setEnableInternalTracer(true)
                .setFieldTrials("WebRTC-H264HighProfile/Enabled/")
                .createInitializationOptions();
        PeerConnectionFactory.initialize(initializationOptions);
        //创建EglBase对象
        eglBase = EglBase.create();
        PeerConnectionFactory.Options options = new PeerConnectionFactory.Options();
        options.disableEncryption = true;
        options.disableNetworkMonitor = true;
        peerConnectionFactory = PeerConnectionFactory.builder()
                .setVideoDecoderFactory(new DefaultVideoDecoderFactory(eglBase.getEglBaseContext()))
                .setVideoEncoderFactory(new DefaultVideoEncoderFactory(eglBase.getEglBaseContext(), true, true))
                .setOptions(options)
                .createPeerConnectionFactory();
        // 配置STUN穿透服务器  转发服务器
        iceServers = new ArrayList<>();
        PeerConnection.IceServer iceServer = PeerConnection.IceServer.builder(Constant.STUN).createIceServer();
        iceServers.add(iceServer);

        streamList = new ArrayList<>();

        PeerConnection.RTCConfiguration configuration = new PeerConnection.RTCConfiguration(iceServers);

        PeerConnectionObserver connectionObserver = getObserver();
        peerConnection = peerConnectionFactory.createPeerConnection(configuration, connectionObserver);


        /*
        DataChannel.Init 可配参数说明：
        ordered：是否保证顺序传输；
        maxRetransmitTimeMs：重传允许的最长时间；
        maxRetransmits：重传允许的最大次数；
        */
        DataChannel.Init init = new DataChannel.Init();
        if (peerConnection != null) {
            channel = peerConnection.createDataChannel(Constant.CHANNEL, init);
        }
        DateChannelObserver channelObserver = new DateChannelObserver();
        connectionObserver.setObserver(channelObserver);
        initView();
        initObserver();
    }
  • 5.2.1 初始化view
private void initSurfaceview(SurfaceViewRenderer localSurfaceView) {
        localSurfaceView.init(eglBase.getEglBaseContext(), null);
        localSurfaceView.setMirror(true);
        localSurfaceView.setScalingType(RendererCommon.ScalingType.SCALE_ASPECT_FILL);
        localSurfaceView.setKeepScreenOn(true);
        localSurfaceView.setZOrderMediaOverlay(true);
        localSurfaceView.setEnableHardwareScaler(false);
}
  • 5.2.2 初始化音频和视频
/**
 * 创建本地视频
 *
 * @param localSurfaceView
 */
private void startLocalVideoCapture(SurfaceViewRenderer localSurfaceView) {
    VideoSource videoSource = peerConnectionFactory.createVideoSource(true);
    SurfaceTextureHelper surfaceTextureHelper = SurfaceTextureHelper.create(Thread.currentThread().getName(), eglBase.getEglBaseContext());
    VideoCapturer videoCapturer = createVideoCapturer();
    videoCapturer.initialize(surfaceTextureHelper, this, videoSource.getCapturerObserver());
    videoCapturer.startCapture(Constant.VIDEO_RESOLUTION_WIDTH, Constant.VIDEO_RESOLUTION_HEIGHT, Constant.VIDEO_FPS); // width, height, frame per second
    videoTrack = peerConnectionFactory.createVideoTrack(Constant.VIDEO_TRACK_ID, videoSource);
    videoTrack.addSink(localSurfaceView);
    MediaStream localMediaStream = peerConnectionFactory.createLocalMediaStream(Constant.LOCAL_VIDEO_STREAM);
    localMediaStream.addTrack(videoTrack);
    peerConnection.addTrack(videoTrack, streamList);
    peerConnection.addStream(localMediaStream);
}

/**
 * 创建本地音频
 */
private void startLocalAudioCapture() {
    //语音
    MediaConstraints audioConstraints = new MediaConstraints();
    //回声消除
    audioConstraints.mandatory.add(new MediaConstraints.KeyValuePair("googEchoCancellation", "true"));
    //自动增益
    audioConstraints.mandatory.add(new MediaConstraints.KeyValuePair("googAutoGainControl", "true"));
    //高音过滤
    audioConstraints.mandatory.add(new MediaConstraints.KeyValuePair("googHighpassFilter", "true"));
    //噪音处理
    audioConstraints.mandatory.add(new MediaConstraints.KeyValuePair("googNoiseSuppression", "true"));
    AudioSource audioSource = peerConnectionFactory.createAudioSource(audioConstraints);
    audioTrack = peerConnectionFactory.createAudioTrack(Constant.AUDIO_TRACK_ID, audioSource);
    MediaStream localMediaStream = peerConnectionFactory.createLocalMediaStream(Constant.LOCAL_AUDIO_STREAM);
    localMediaStream.addTrack(audioTrack);
    audioTrack.setVolume(Constant.VOLUME);
    peerConnection.addTrack(audioTrack, streamList);
    peerConnection.addStream(localMediaStream);
}
5.3 创建PeerConnection成功后通过信令传输交换各自信息，实现视频通话，调整后的流程如下图

调整后流程

信令

public static final String REGISTER = "register";//注册
public static final String REGISTER_RESPONSE = "register_response";//注册回复
public static final int RESPONSE_SUCCEED = 1;//1成功
public static final int RESPONSE_FAILURE = 2;//2失败
public static final String CALL = "call";//拨打
public static final String CALL_RESPONSE = "call_response";//拨打回复
public static final String INCALL = "incall";//接听
public static final String INCALL_RESPONSE = "incall_response";//接听回复
public static final String OFFER = "offer";//发送sdp信息
public static final String CANDIDATE = "candidate";//ice互传

流程内容： 客户端A，客户端B

  • 5.3.1 -->> A 和 B 都注册成功后，A 发起 call，服务端收到A的指令后转发给B， B接受后发给服务器，服务器转发给A
  • 5.3.2 -->> A createOffer 将自己的SessionDescription 发给服务器，服务器转发给B
  • 5.3.3 -->> B 收到后将A的SessionDescription 设置到自己的setRemoteDescription，同时createAnswer 发给服务器，服务器在转发A
  • 5.3.4 -->> A 收到后将B的SessionDescription 设置到自己的setRemoteDescription
  • 5.3.5 -->> A 在PeerConnectionObserver 的 onIceCandidate方法中，将收到的IceCandidate 发给服务端，服务器转发给B
  • 5.3.6 -->> B 收到后在将IceCandidate 设置到自己的addIceCandidate
  • 5.3.7 -->> B 在PeerConnectionObserver 的 onIceCandidate方法中，将收到的IceCandidate 发给服务端，服务器转发给A
  • 5.3.8 -->> A 收到后在将IceCandidate 设置到自己的addIceCandidate
  • 5.3.9 -->> A 和 B 在PeerConnectionObserver 的 onAddStream方法中，将远端的流媒体加入到本地的View
  • 5.3.10 -->> 交互已经结束，可以正常视频通话

详细的流程，json 格式

isSucceed 1成功 2失败

"from": "11",  "fromName": "王安", "to": "12", "toName": "往事"
	
1.注册 
from 发送服务端：register 
{
"from": "11",
"fromName": "王安",
"id": "register",
"isSucceed": 0
}

from接收：register_response 
{
"id": "register_response",
"isSucceed": 1
}

2.呼叫
from 发送服务端：call 
{
"from": "11",
"fromName": "王安",
"id": "call",
"isSucceed": 0,
"to": "12",
"toName": "往事"
}

2.1服务端做判断

如果不在线 直接返回 "isSucceed": 1
{
"id": "call_response",
"isSucceed": 1
}
 
在线 返回给to做判断

to 接收：incall 
改变本地状态
{
"id": "incall",
"isSucceed": 0
}
	to 发送服务端 拒绝："isSucceed": 2
	{
		"from": "12",
		"fromName": "往事",
		"id": "incall",
		"isSucceed": 2,
		"to": "11",
		"toName": "王安"
	}
		from接收：incall_response
		做拒绝的操作
		{
			"id": "incall_response",
			"from": "12",
			"fromName": "往事",
			"to": "11",
			"toName": "王安",
			"isSucceed": 2
		}
		
-------------------------------------------------
	
	to 发送服务端 同意："isSucceed": 1
	{
		"from": "12",
		"fromName": "往事",
		"id": "incall",
		"isSucceed": 1,
		"to": "11",
		"toName": "王安"
	}
		from接收 同意：incall_response
		  
		{
			"id": "incall_response",
			"from": "12",
			"fromName": "往事",
			"to": "11",
			"toName": "王安",
			"isSucceed": 1
		}

3.to同意后 from发送流
from 发送服务端：offer
{
"from": "11",
"fromName": "王安",
"id": "offer",
"isSucceed": 0,
"sessionDescription": {
"description": "v=0\r\no=- 3285195603599485281 2 IN IP4 127.0.0.1\r\ns=-\r\nt=0 0\r\na=group:BUNDLE video\r\na=msid-semantic: WMS localstream\r\nm=video 9 RTP/AVPF 96 97 98 99 100 101 127 124 125\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:9Jqg\r\na=ice-pwd:lM34EvVxjaPGBislEH9VccVu\r\na=ice-options:trickle renomination\r\na=mid:video\r\na=extmap:14 urn:ietf:params:rtp-hdrext:toffset\r\na=extmap:13 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time\r\na=extmap:3 urn:3gpp:video-orientation\r\na=extmap:2 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01\r\na=extmap:5 http://www.webrtc.org/experiments/rtp-hdrext/playout-delay\r\na=extmap:6 http://www.webrtc.org/experiments/rtp-hdrext/video-content-type\r\na=extmap:7 http://www.webrtc.org/experiments/rtp-hdrext/video-timing\r\na=extmap:8 http://tools.ietf.org/html/draft-ietf-avtext-framemarking-07\r\na=extmap:9 http://www.webrtc.org/experiments/rtp-hdrext/color-space\r\na=sendrecv\r\na=rtcp-mux\r\na=rtcp-rsize\r\na=rtpmap:96 VP8/90000\r\na=rtcp-fb:96 goog-remb\r\na=rtcp-fb:96 transport-cc\r\na=rtcp-fb:96 ccm fir\r\na=rtcp-fb:96 nack\r\na=rtcp-fb:96 nack pli\r\na=rtpmap:97 rtx/90000\r\na=fmtp:97 apt=96\r\na=rtpmap:98 VP9/90000\r\na=rtcp-fb:98 goog-remb\r\na=rtcp-fb:98 transport-cc\r\na=rtcp-fb:98 ccm fir\r\na=rtcp-fb:98 nack\r\na=rtcp-fb:98 nack pli\r\na=rtpmap:99 rtx/90000\r\na=fmtp:99 apt=98\r\na=rtpmap:100 H264/90000\r\na=rtcp-fb:100 goog-remb\r\na=rtcp-fb:100 transport-cc\r\na=rtcp-fb:100 ccm fir\r\na=rtcp-fb:100 nack\r\na=rtcp-fb:100 nack pli\r\na=fmtp:100 level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=42e01f\r\na=rtpmap:101 rtx/90000\r\na=fmtp:101 apt=100\r\na=rtpmap:127 red/90000\r\na=rtpmap:124 rtx/90000\r\na=fmtp:124 apt=127\r\na=rtpmap:125 ulpfec/90000\r\na=ssrc-group:FID 1791802911 305163890\r\na=ssrc:1791802911 cname:8uTWIc2YbUNSY02u\r\na=ssrc:1791802911 msid:localstream videtrack\r\na=ssrc:1791802911 mslabel:localstream\r\na=ssrc:1791802911 label:videtrack\r\na=ssrc:305163890 cname:8uTWIc2YbUNSY02u\r\na=ssrc:305163890 msid:localstream videtrack\r\na=ssrc:305163890 mslabel:localstream\r\na=ssrc:305163890 label:videtrack\r\n",
"type": "OFFER"
},
"to": "12",
"toName": "往事"
}

to接收：offer
{
"id": "offer",
"from": "11",
"fromName": "王安",
"to": "12",
"toName": "往事",
"sessionDescription": {
"type": "OFFER",
"description": "v=0\r\no=- 3285195603599485281 2 IN IP4 127.0.0.1\r\ns=-\r\nt=0 0\r\na=group:BUNDLE video\r\na=msid-semantic: WMS localstream\r\nm=video 9 RTP/AVPF 96 97 98 99 100 101 127 124 125\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:9Jqg\r\na=ice-pwd:lM34EvVxjaPGBislEH9VccVu\r\na=ice-options:trickle renomination\r\na=mid:video\r\na=extmap:14 urn:ietf:params:rtp-hdrext:toffset\r\na=extmap:13 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time\r\na=extmap:3 urn:3gpp:video-orientation\r\na=extmap:2 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01\r\na=extmap:5 http://www.webrtc.org/experiments/rtp-hdrext/playout-delay\r\na=extmap:6 http://www.webrtc.org/experiments/rtp-hdrext/video-content-type\r\na=extmap:7 http://www.webrtc.org/experiments/rtp-hdrext/video-timing\r\na=extmap:8 http://tools.ietf.org/html/draft-ietf-avtext-framemarking-07\r\na=extmap:9 http://www.webrtc.org/experiments/rtp-hdrext/color-space\r\na=sendrecv\r\na=rtcp-mux\r\na=rtcp-rsize\r\na=rtpmap:96 VP8/90000\r\na=rtcp-fb:96 goog-remb\r\na=rtcp-fb:96 transport-cc\r\na=rtcp-fb:96 ccm fir\r\na=rtcp-fb:96 nack\r\na=rtcp-fb:96 nack pli\r\na=rtpmap:97 rtx/90000\r\na=fmtp:97 apt=96\r\na=rtpmap:98 VP9/90000\r\na=rtcp-fb:98 goog-remb\r\na=rtcp-fb:98 transport-cc\r\na=rtcp-fb:98 ccm fir\r\na=rtcp-fb:98 nack\r\na=rtcp-fb:98 nack pli\r\na=rtpmap:99 rtx/90000\r\na=fmtp:99 apt=98\r\na=rtpmap:100 H264/90000\r\na=rtcp-fb:100 goog-remb\r\na=rtcp-fb:100 transport-cc\r\na=rtcp-fb:100 ccm fir\r\na=rtcp-fb:100 nack\r\na=rtcp-fb:100 nack pli\r\na=fmtp:100 level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=42e01f\r\na=rtpmap:101 rtx/90000\r\na=fmtp:101 apt=100\r\na=rtpmap:127 red/90000\r\na=rtpmap:124 rtx/90000\r\na=fmtp:124 apt=127\r\na=rtpmap:125 ulpfec/90000\r\na=ssrc-group:FID 1791802911 305163890\r\na=ssrc:1791802911 cname:8uTWIc2YbUNSY02u\r\na=ssrc:1791802911 msid:localstream videtrack\r\na=ssrc:1791802911 mslabel:localstream\r\na=ssrc:1791802911 label:videtrack\r\na=ssrc:305163890 cname:8uTWIc2YbUNSY02u\r\na=ssrc:305163890 msid:localstream videtrack\r\na=ssrc:305163890 mslabel:localstream\r\na=ssrc:305163890 label:videtrack\r\n"
},
"isSucceed": 0
}

to接收到 offer 创建answer 创建完 to 发送服务端：offer
{
"from": "12",
"fromName": "往事",
"id": "offer",
"isSucceed": 0,
"sessionDescription": {
"description": "v=0\r\no=- 8665372075017263288 2 IN IP4 127.0.0.1\r\ns=-\r\nt=0 0\r\na=group:BUNDLE video\r\na=msid-semantic: WMS localstream\r\nm=video 9 RTP/AVPF 96 97 98 99 100 101 127 124 125\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:zoQn\r\na=ice-pwd:oBePBH1X7SehiT6Tb83SZV2U\r\na=ice-options:trickle renomination\r\na=mid:video\r\na=extmap:14 urn:ietf:params:rtp-hdrext:toffset\r\na=extmap:13 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time\r\na=extmap:3 urn:3gpp:video-orientation\r\na=extmap:2 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01\r\na=extmap:5 http://www.webrtc.org/experiments/rtp-hdrext/playout-delay\r\na=extmap:6 http://www.webrtc.org/experiments/rtp-hdrext/video-content-type\r\na=extmap:7 http://www.webrtc.org/experiments/rtp-hdrext/video-timing\r\na=extmap:8 http://tools.ietf.org/html/draft-ietf-avtext-framemarking-07\r\na=extmap:9 http://www.webrtc.org/experiments/rtp-hdrext/color-space\r\na=sendrecv\r\na=rtcp-mux\r\na=rtcp-rsize\r\na=rtpmap:96 VP8/90000\r\na=rtcp-fb:96 goog-remb\r\na=rtcp-fb:96 transport-cc\r\na=rtcp-fb:96 ccm fir\r\na=rtcp-fb:96 nack\r\na=rtcp-fb:96 nack pli\r\na=rtpmap:97 rtx/90000\r\na=fmtp:97 apt=96\r\na=rtpmap:98 VP9/90000\r\na=rtcp-fb:98 goog-remb\r\na=rtcp-fb:98 transport-cc\r\na=rtcp-fb:98 ccm fir\r\na=rtcp-fb:98 nack\r\na=rtcp-fb:98 nack pli\r\na=rtpmap:99 rtx/90000\r\na=fmtp:99 apt=98\r\na=rtpmap:100 H264/90000\r\na=rtcp-fb:100 goog-remb\r\na=rtcp-fb:100 transport-cc\r\na=rtcp-fb:100 ccm fir\r\na=rtcp-fb:100 nack\r\na=rtcp-fb:100 nack pli\r\na=fmtp:100 level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=42e01f\r\na=rtpmap:101 rtx/90000\r\na=fmtp:101 apt=100\r\na=rtpmap:127 red/90000\r\na=rtpmap:124 rtx/90000\r\na=fmtp:124 apt=127\r\na=rtpmap:125 ulpfec/90000\r\na=ssrc-group:FID 330040035 1917181902\r\na=ssrc:330040035 cname:uxoKaX6C0J4LHdZ2\r\na=ssrc:330040035 msid:localstream videtrack\r\na=ssrc:330040035 mslabel:localstream\r\na=ssrc:330040035 label:videtrack\r\na=ssrc:1917181902 cname:uxoKaX6C0J4LHdZ2\r\na=ssrc:1917181902 msid:localstream videtrack\r\na=ssrc:1917181902 mslabel:localstream\r\na=ssrc:1917181902 label:videtrack\r\n",
"type": "ANSWER"
},
"to": "11",
"toName": "王安"
}

4.ice交换
from 发送服务端：candidate
{
"from": "11",
"fromName": "王安",
"iceCandidate": {
"sdp": "candidate:3575964346 1 udp 2122260223 192.168.0.166 47369 typ host generation 0 ufrag 9Jqg network-id 3 network-cost 10",
"sdpMLineIndex": 0,
"sdpMid": "video",
"serverUrl": ""
},
"id": "candidate",
"isSucceed": 0,
"to": "12",
"toName": "往事"
}

to 接收：candidate

{
"from": "11",
"fromName": "王安",
"iceCandidate": {
"sdp": "candidate:3575964346 1 udp 2122260223 192.168.0.166 47369 typ host generation 0 ufrag 9Jqg network-id 3 network-cost 10",
"sdpMLineIndex": 0,
"sdpMid": "video",
"serverUrl": ""
},
"id": "candidate",
"isSucceed": 0,
"to": "12",
"toName": "往事"
}

to 发送服务端：candidate
{
"from": "12",
"fromName": "往事",
"iceCandidate": {
"sdp": "candidate:559267639 1 udp 2122202367 ::1 55843 typ host generation 0 ufrag zoQn network-id 2",
"sdpMLineIndex": 0,
"sdpMid": "video",
"serverUrl": ""
},
"id": "candidate",
"isSucceed": 0,
"to": "11",
"toName": "王安"
}

from接收：candidate
{
"from": "12",
"fromName": "往事",
"iceCandidate": {
"sdp": "candidate:559267639 1 udp 2122202367 ::1 55843 typ host generation 0 ufrag zoQn network-id 2",
"sdpMLineIndex": 0,
"sdpMid": "video",
"serverUrl": ""
},
"id": "candidate",
"isSucceed": 0,
"to": "11",
"toName": "王安"
}
5.4 实现视频通话，部分截图

在这里插入图片描述

关注下方微信公众号（他晓），回复 webrtc 获取相关demo

公众号

CSDN 下载通道

# webrtc
Logo
即构开发者社区

致力于链接即构和开发者，提供实时互动和元宇宙领域的前沿洞察、技术分享和丰富的开发者活动，共建实时互动世界。

更多推荐

ios视频直播SDK集成指引

此文介绍语音视频云服务商即构科技提供的ios视频直播SDK集成指引。此SDK可实现主播和观众以一对一、一对多、或多对多的关系等，并支持小程序。手动安装目前 ZegoLiveRoom SDK 仅支持手动安装，集成步骤如下。1 准备环境请确保开发环境满足以下技术要求：Apple Xcode 6.0 或以上版本iOS 7.0 或以上版本支持音视频功能的模拟器或真机2 下载...

avatar 即构开发者社区

音视频学习 AudioTrack、OpenSL ES 音频渲染

前言在讲解音频渲染之前，需要对音频的基础知识有所了解，所以该篇分为基础概念和AudioTrack 以及 OpenSL ES Demo 实例讲解，这样有助于更好的理解 Android 中音频渲染。音频的基础概念涉及的知识点比较多，该篇文章的上半部分会详细的介绍，后续文章基本上都会涉及音频的开发，有了基础对于后面的内容就更容易上手了。音频的基础知识播放器入门到提高快速掌握音视频开发基础知识声音的物理性

avatar 即构开发者社区

语音呼叫sdk_企业业务的十大聊天，音频和视频呼叫API和SDK提供程序

语音呼叫sdkWith the growing trend of digitalization, most enterprises have transformed their communication methodology from mainstream to digital. In order to keep up with competitors, companies regular..

avatar 即构开发者社区