rtsp推流问题

chien126

你好
  使用core-1126-JD4+配套底板开发时，遇到流媒体推流问题，麻烦看下，谢谢
现象：

  在使用core-1126-JD4推流时，用VLC能够打开流媒体，但是流媒体卡在第一张画面上，后面视频看不到
硬件接线：
1、使用一路网口接海康网络摄影头
2、使用另一路网口推流
软件流程：
1、获取rtsp流(使用ffrtsp库)->decode->encode->rtsp推流
测试log：

1. [root@RV1126_RV1109:/userdata/data/wdg]# ./rtsp_vdec_rga_venc
   
2. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libffrtsp.so)
   
3. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libffrtsp.so)
   
4. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libffrtsp.so)
   
5. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face_engine.so)
   
6. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face_engine.so)
   
7. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face_engine.so)
   
8. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face_engine.so)
   
9. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face.so)
   
10. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face.so)
    
11. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face.so)
    
12. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face.so)
    
13. ./rtsp_vdec_rga_venc: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face.so)
    
14. media get entity by name: rkcif-lvds-subdev is null
    
15. media get entity by name: rkcif-lite-lvds-subdev is null
    
16. media get entity by name: rkisp-mpfbc-subdev is null
    
17. media get entity by name: rkisp_dmapath is null
    
18. media get entity by name: rockchip-mipi-dphy-rx is null
    
19. Rga built version:1.04 cb973b1+2021-06-01 11:34:20
    
20. [INFO  rtsp_demo.c:281:rtsp_new_demo] rtsp server demo starting on port 8554
    
21. [DEBUG rtsp_demo.c:481:rtsp_new_session] add session path: /live/main_stream
    
22. ##RKMEDIA Log level: 2
    
23. [RKMEDIA][SYS][Info]:text is all=2
    
24. [RKMEDIA][SYS][Info]:module is all, log_level is 2
    
25. [RKMEDIA][SYS][Info]:RK_MPI_VDEC_CreateChn: Enable VDEC[0] Start...
    
26. mpp[2248]: mpp_info: mpp version: 92a7c2a4 author: daijh         2021-04-21 debian: fix patch not found bug
    
27. [RKMEDIA][VDEC][Info]:mpi control MPP_DEC_SET_PARSER_SPLIT_MODE ret = 0
    
28. mpp[2248]: mpp_rt: NOT found ion allocator
    
29. mpp[2248]: mpp_rt: found drm allocator
    
30. [RKMEDIA][VDEC][Info]:mpi set group limit = 16
    
31. [RKMEDIA][SYS][Info]:RK_MPI_VDEC_CreateChn: Enable VDEC[0] End!
    
32. [RKMEDIA][SYS][Info]:RK_MPI_VENC_CreateChn: Enable VENC[0], Type:6 Start...
    
33. mpp[2248]: mpp_info: mpp version: 92a7c2a4 author: daijh         2021-04-21 debian: fix patch not found bug
    
34. [RKMEDIA][VENC][Info]:MPP Encoder: MPPConfig: cfg init sucess!
    
35. [RKMEDIA][VENC][Info]:MPP Encoder: qpMaxi use default value:48
    
36. [RKMEDIA][VENC][Info]:MPP Encoder: qpMini use default value:8
    
37. [RKMEDIA][VENC][Info]:MPP Encoder: qpMax use default value:48
    
38. [RKMEDIA][VENC][Info]:MPP Encoder: qpMin use default value:8
    
39. [RKMEDIA][VENC][Info]:MPP Encoder: qpInit use default value:-1
    
40. [RKMEDIA][VENC][Info]:MPP Encoder: qpStep use default value:2
    
41. [RKMEDIA][VENC][Info]:MPP Encoder: rotaion = 0
    
42. [RKMEDIA][VENC][Info]:MPP Encoder: automatically calculate bsp with bps_max
    
43. [RKMEDIA][VENC][Info]:MPP Encoder: Set output block mode.
    
44. [RKMEDIA][VENC][Info]:MPP Encoder: Set input block mode.
    
45. [RKMEDIA][VENC][Info]:MPP Encoder: bps:[4147200,3732480,1036800] fps: [25/1]->[25/1], gop:25 qpInit:-1, qpMin:8, qpMax:48, qpMinI:8, qpMaxI:48.
    
46. [RKMEDIA][VENC][Info]:MPP Encoder: H264 profile use defalut value: 100[RKMEDIA][VENC][Info]:MPP Encoder: AVC: encode profile 100 level 0
    
47. mpp[2248]: mpp_enc: MPP_ENC_SET_RC_CFG bps 3732480 [1036800 : 4147200] fps [25:25] gop 25
    
48. mpp[2248]: h264e_api_v2: MPP_ENC_SET_PREP_CFG w:h [1920:1080] stride [1920:1088]
    
49. mpp[2248]: mpp_enc: send header for set cfg change input/format
    
50. [RKMEDIA][VENC][Info]:MPP Encoder: w x h(1920[1920] x 1080[1088])
    
51. mpp[2248]: mpp_enc: mode cbr bps [1036800:3732480:4147200] fps fix [25/1] -> fix [25/1] gop i [25] v [0]
    
52. [RKMEDIA][SYS][Info]:RK_MPI_VENC_CreateChn: Enable VENC[0], Type:6 End...
    
53. [RKMEDIA][SYS][Info]:RK_MPI_RGA_CreateChn: Enable RGA[0], Rect<0,0,1920,1080> Start...
    
54. [RKMEDIA][SYS][Info]:FilterFlow:rkrga: Enable BufferPool! memtype:hw_mem, memcnt:12
    
55. [RKMEDIA][SYS][Info]:Opened DRM device /dev/dri/card0: driver rockchip version 2.0.0.
    
56. [RKMEDIA][SYS][Info]:RK_MPI_RGA_CreateChn: Enable RGA[0], Rect<0,0,1920,1080> End...
    
57. [RKMEDIA][SYS][Info]:RK_MPI_SYS_Bind: Bind Mode[VDEC]:Chn[0] to Mode[RGA]:Chn[0]...
    
58. [RKMEDIA][SYS][Info]:RK_MPI_SYS_Bind: Bind Mode[VDEC]:Chn[0] to Mode[VENC]:Chn[0]...
    
59. Created new TCP socket 41 for connection
    
60. Connecting to 192.168.1.5, port 554 on socket 41...
    
61. ...remote connection opened
    
62. Sending request: DESCRIBE rtsp://admin:zd123456@192.168.1.5 RTSP/1.0
    
63. CSeq: 2
    
64. User-Agent: ffrtspGet (LIVE555 Streaming Media v2017.10.28)
    
65. Accept: application/sdp
    
66. 
    
67. 
    
68. Received 184 new bytes of response data.
    
69. Received a complete DESCRIBE response:
    
70. RTSP/1.0 401 Unauthorized
    
71. CSeq: 2
    
72. WWW-Authenticate: Digest realm="IP Camera(F3061)", nonce="cdad57661c65aa2e1ea2d78f3351752a", stale="FALSE"
    
73. Date:  Mon, Dec 06 2021 22:04:14 GMT
    
74. 
    
75. 
    
76. Resending...
    
77. Sending request: DESCRIBE rtsp://admin:zd123456@192.168.1.5 RTSP/1.0
    
78. CSeq: 3
    
79. Authorization: Digest username="admin", realm="IP Camera(F3061)", nonce="cdad57661c65aa2e1ea2d78f3351752a", uri="rtsp://admin:zd123456@192.168.1.5", response="6d2d88caa84c04e93e30b7cbf7ee7c25"
    
80. User-Agent: ffrtspGet (LIVE555 Streaming Media v2017.10.28)
    
81. Accept: application/sdp
    
82. 
    
83. 
    
84. Received 702 new bytes of response data.
    
85. Received a complete DESCRIBE response:
    
86. RTSP/1.0 200 OK
    
87. CSeq: 3
    
88. Content-Type: application/sdp
    
89. Content-Base: rtsp://admin:zd123456@192.168.1.5/
    
90. Content-Length: 572
    
91. 
    
92. v=0
    
93. o=- 1638828254932574 1638828254932574 IN IP4 192.168.1.5
    
94. s=Media Presentation
    
95. e=NONE
    
96. b=AS:5050
    
97. t=0 0
    
98. a=control:rtsp://admin:zd123456@192.168.1.5/
    
99. m=video 0 RTP/AVP 96
    
100. c=IN IP4 0.0.0.0
     
101. b=AS:5000
     
102. a=recvonly
     
103. a=x-dimensions:1920,1080
     
104. a=control:rtsp://admin:zd123456@192.168.1.5/trackID=1
     
105. a=rtpmap:96 H264/90000
     
106. a=fmtp:96 profile-level-id=420029; packetization-mode=1; sprop-parameter-sets=Z00AKpY1QPAET8s3AQEBQAABwgAAV+QB,aO4xsg==
     
107. a=Media_header:MEDIAINFO=494D4B48010300000400000100000000000000000000000000000000000000000000000000000000;
     
108. a=appversion:1.0
     
109. 
     
110. [URL:"rtsp://admin:zd123456@192.168.1.5/"]: Got a SDP description:
     
111. v=0
     
112. o=- 1638828254932574 1638828254932574 IN IP4 192.168.1.5
     
113. s=Media Presentation
     
114. e=NONE
     
115. b=AS:5050
     
116. t=0 0
     
117. a=control:rtsp://admin:zd123456@192.168.1.5/
     
118. m=video 0 RTP/AVP 96
     
119. c=IN IP4 0.0.0.0
     
120. b=AS:5000
     
121. a=recvonly
     
122. a=x-dimensions:1920,1080
     
123. a=control:rtsp://admin:zd123456@192.168.1.5/trackID=1
     
124. a=rtpmap:96 H264/90000
     
125. a=fmtp:96 profile-level-id=420029; packetization-mode=1; sprop-parameter-sets=Z00AKpY1QPAET8s3AQEBQAABwgAAV+QB,aO4xsg==
     
126. a=Media_header:MEDIAINFO=494D4B48010300000400000100000000000000000000000000000000000000000000000000000000;
     
127. a=appversion:1.0
     
128. 
     
129. [URL:"rtsp://admin:zd123456@192.168.1.5/"]: Initiated the "video/H264" subsession (client ports 36746-36747)
     
130. Sending request: SETUP rtsp://admin:zd123456@192.168.1.5/trackID=1 RTSP/1.0
     
131. CSeq: 4
     
132. Authorization: Digest username="admin", realm="IP Camera(F3061)", nonce="cdad57661c65aa2e1ea2d78f3351752a", uri="rtsp://admin:zd123456@192.168.1.5/", response="10c4a1dfcdf2b5c1651238c954e703d1"
     
133. User-Agent: ffrtspGet (LIVE555 Streaming Media v2017.10.28)
     
134. Transport: RTP/AVP;unicast;client_port=36746-36747
     
135. 
     
136. 
     
137. Received 204 new bytes of response data.
     
138. Received a complete SETUP response:
     
139. RTSP/1.0 200 OK
     
140. CSeq: 4
     
141. Session:       1383322580;timeout=60
     
142. Transport: RTP/AVP;unicast;client_port=36746-36747;server_port=8218-8219;ssrc=32cb7432;mode="play"
     
143. Date:  Mon, Dec 06 2021 22:04:14 GMT
     
144. 
     
145. 
     
146. [URL:"rtsp://admin:zd123456@192.168.1.5/"]: Set up the "video/H264" subsession (client ports 36746-36747)
     
147. [URL:"rtsp://admin:zd123456@192.168.1.5/"]: Created a data sink for the "video/H264" subsession
     
148. Sending request: PLAY rtsp://admin:zd123456@192.168.1.5/ RTSP/1.0
     
149. CSeq: 5
     
150. Authorization: Digest username="admin", realm="IP Camera(F3061)", nonce="cdad57661c65aa2e1ea2d78f3351752a", uri="rtsp://admin:zd123456@192.168.1.5/", response="35c213136d0091d0a2f465b9d6650e24"
     
151. User-Agent: ffrtspGet (LIVE555 Streaming Media v2017.10.28)
     
152. Session: 1383322580
     
153. Range: npt=0.000-
     
154. 
     
155. 
     
156. Received 179 new bytes of response data.
     
157. Received a complete PLAY response:
     
158. RTSP/1.0 200 OK
     
159. CSeq: 5
     
160. Session:       1383322580
     
161. RTP-Info: url=rtsp://admin:zd123456@192.168.1.5/trackID=1;seq=1629;rtptime=190893420
     
162. Date:  Mon, Dec 06 2021 22:04:15 GMT
     
163. 
     
164. 
     
165. [URL:"rtsp://admin:zd123456@192.168.1.5/"]: Started playing session...
     
166. [RKMEDIA][VDEC][Info]:MppDec Info change get, 1920x1080 in (1920x1088)
     
167. [RKMEDIA][RGA][Error]:Src(0Bytes) or Dst(6220800Bytes) Buffer is invalid!
     
168. mpp[2248]: mpp_buffer: mpp_buffer_put invalid input: buffer NULL from PrepareMppFrame
     
169. mpp[2248]: h264e_sps: set level to 4
     
170. [DEBUG utils.c:160:rtsp_codec_data_parse_from_user_h264] sps 27
     
171. [DEBUG utils.c:168:rtsp_codec_data_parse_from_user_h264] pps 4
     

复制代码

测试代码：

1. #include <assert.h>
   
2. #include <fcntl.h>
   
3. #include <pthread.h>
   
4. #include <signal.h>
   
5. #include <stdbool.h>
   
6. #include <stdio.h>
   
7. #include <stdlib.h>
   
8. #include <string.h>
   
9. #include <time.h>
   
10. #include <unistd.h>
    
11. #include <sys/time.h>
    
12. #include "common/sample_common.h"
    
13. #include "rkmedia_api.h"
    
14. #include "rkmedia_vdec.h"
    
15. #include "ffrtsp/ffrtsp.hh"
    
16. #include "librtsp/rtsp_demo.h"
    
17. #define  full_flow1
    
18. #define  close_mux1
    
19. //视频流处理pipeline
    
20. //rtsp->vdec->rga->im2gray->算法处理(测试RGA直接转IMAGE_TYPE_GRAY8)->处理结果添加水印->venc->rtsp推流
    
21. //                        ->venc->保存历史视频(mux测试)
    
22. //                        ->venc->添加水印—>rtsp流(后期流程)
    
23. 
    
24. typedef struct rkMuxerHandle {
    
25.         RK_U32 u32ModeIdx;
    
26.         RK_U32 u32ChnIdx;
    
27. } MuxerHandle;
    
28. 
    
29. rtsp_demo_handle g_rtsplive = NULL;
    
30. static rtsp_session_handle g_rtsp_session;
    
31. static bool quit = false;
    
32. static void sigterm_handler(int sig) {
    
33.         fprintf(stderr, "signal %d\n", sig);
    
34.         quit = true;
    
35. }
    
36. 
    
37. static long getCurrentTimeMsec() {
    
38.         long msec = 0;
    
39.         char str[20] = {0};
    
40.         struct timeval stuCurrentTime;
    
41. 
    
42.         gettimeofday(&stuCurrentTime, NULL);
    
43.         sprintf(str, "%ld%03ld", stuCurrentTime.tv_sec,(stuCurrentTime.tv_usec) / 1000);
    
44.         for (size_t i = 0; i < strlen(str); i++) {
    
45.                 msec = msec * 10 + (str[i] - '0');
    
46.         }
    
47. 
    
48.         return msec;
    
49. }
    
50. 
    
51. static RK_U32 gu32FileIdx;
    
52. int GetRecordFileName(RK_VOID *pHandle, RK_U32 u32FileCnt,RK_CHAR **pcFileName) {
    
53.        
    
54.         printf("#%s: Handle:%p, idx:%u ...\n", __func__, pHandle, *((RK_U32 *)pHandle));
    
55.          
    
56.         for (RK_U32 i = 0; i < u32FileCnt; i++) {
    
57.                 sprintf(pcFileName[i], "/userdata/MuxerCbTest_%u.mp4",*((RK_U32 *)pHandle));
    
58.           }
    
59. 
    
60.          printf("#%s: NewRecordFileName:[%s]\n", __func__, pcFileName[0]);
    
61. 
    
62.           *((RK_U32 *)pHandle) = *((RK_U32 *)pHandle) + 1;
    
63. 
    
64.           return 0;
    
65. }
    
66. void muxer_event_cb(RK_VOID *pHandle, RK_VOID *pstEvent) {
    
67.         RK_S32 s32ModeIdx = -1;
    
68.         RK_S32 s32ChnIdx = -1;
    
69. 
    
70.         printf("### %s: Handle:%p, event:%p\n", __func__, pHandle, pstEvent);
    
71.         if (pHandle) {
    
72.                 MuxerHandle *pstMuxerHandle = (MuxerHandle *)pHandle;
    
73.                 s32ModeIdx = (RK_S32)pstMuxerHandle->u32ModeIdx;
    
74.                 s32ChnIdx = (RK_S32)pstMuxerHandle->u32ChnIdx;
    
75.         }
    
76.         if (pstEvent) {
    
77.                 MUXER_EVENT_INFO_S *pstMuxerEvent = (MUXER_EVENT_INFO_S *)pstEvent;
    
78.                 printf("@@@ %s: ModeID:%d, ChnID:%d, EventType:%d, filename:%s, value:%d\n",
    
79.                 __func__, s32ModeIdx, s32ChnIdx, pstMuxerEvent->enEvent,
    
80.                 pstMuxerEvent->unEventInfo.stFileInfo.asFileName,
    
81.                 (int)pstMuxerEvent->unEventInfo.stFileInfo.u32Duration);
    
82.         }
    
83. }
    
84. 
    
85. int FFRKMedia_Vdec_Send(u_int8_t* framebuff,unsigned framesize,bool * pquit,int cur_chn)
    
86. {
    
87.         //RTSP流数据送到decode通道
    
88.     MEDIA_BUFFER mb = RK_MPI_MB_CreateBuffer(framesize, RK_FALSE, 0);
    
89.     RK_MPI_MB_SetSize(mb, framesize);
    
90.     memcpy(RK_MPI_MB_GetPtr(mb) ,framebuff , framesize);
    
91.     RK_MPI_MB_SetSize(mb, framesize);
    
92.     RK_MPI_SYS_SendMediaBuffer(RK_ID_VDEC, 0, mb);
    
93. 
    
94.        
    
95.        
    
96.     RK_MPI_MB_ReleaseBuffer(mb);
    
97.     if (quit)
    
98.             *pquit = true;
    
99. }
    
100. 
     
101. void vdec_packet_cb(MEDIA_BUFFER mb) {
     
102.          // decode 流媒体数据为NV12
     
103.         int ret;
     
104.         static RK_U32 jpeg_id = 0;
     
105.         MB_IMAGE_INFO_S stImageInfo = {0};
     
106.         ret = RK_MPI_MB_GetImageInfo(mb, &stImageInfo);//指定图像中获取图像信息 ,宽高，图片格式
     
107.         if (ret) {
     
108.                 printf("Get image info failed! ret = %d\n", ret);
     
109.                 RK_MPI_MB_ReleaseBuffer(mb);
     
110.                 return ;
     
111.         }
     
112.         printf("Get Frame:ptr:%p, fd:%d, size:%zu, mode:%d, channel:%d, "
     
113.              "timestamp:%lld, ImgInfo:<wxh %dx%d, fmt 0x%x>\n",
     
114.              RK_MPI_MB_GetPtr(mb), RK_MPI_MB_GetFD(mb), RK_MPI_MB_GetSize(mb),
     
115.              RK_MPI_MB_GetModeID(mb), RK_MPI_MB_GetChannelID(mb),
     
116.              RK_MPI_MB_GetTimestamp(mb), stImageInfo.u32Width,
     
117.              stImageInfo.u32Height, stImageInfo.enImgType);
     
118. /*        char jpeg_path[128];
     
119.         sprintf(jpeg_path, "/userdata/data/test_yuv%d.yuv", jpeg_id);
     
120.         FILE *file = fopen(jpeg_path, "w");
     
121.         if (file) {
     
122.                 fwrite(RK_MPI_MB_GetPtr(mb), 1, RK_MPI_MB_GetSize(mb), file);
     
123.                 fclose(file);
     
124.         }*/
     
125.         RK_MPI_MB_ReleaseBuffer(mb);
     
126.         jpeg_id++;
     
127. }
     
128. 
     
129. static void *MainStream(void * data)  {
     
130.         MEDIA_BUFFER buffer;
     
131.         char jpeg_path[128];
     
132.         static RK_U32 jpeg_id = 0;
     
133. 
     
134.         while (!quit) {
     
135.                 //printf("%s\n",__func__);
     
136.                 buffer = RK_MPI_SYS_GetMediaBuffer(RK_ID_RGA, 0, -1);
     
137.                 if (!buffer)
     
138.                         continue;
     
139. /*                sprintf(jpeg_path, "/userdata/data/test%d.jpg", jpeg_id);
     
140.                 FILE *file = fopen(jpeg_path, "w");
     
141.                 if (file) {
     
142.                         fwrite(RK_MPI_MB_GetPtr(buffer), 1, RK_MPI_MB_GetSize(buffer), file);
     
143.                         fclose(file);
     
144.                 }*/
     
145.                 RK_MPI_MB_ReleaseBuffer(buffer);
     
146.                 jpeg_id++;
     
147.         }
     
148. }
     
149. 
     
150. static FILE *g_output_file=NULL;
     
151. #define video_output_path "/userdata/data/"
     
152. #define video_output_length                        25*60*3                //fps=25,3分钟一个视频
     
153. static void venc_packet_cb(MEDIA_BUFFER mb) {
     
154.         static RK_S32 packet_cnt = 0;
     
155.         if (quit)
     
156.                 return;
     
157. 
     
158.         printf("#Get packet-%d, size %zu\n", packet_cnt, RK_MPI_MB_GetSize(mb));
     
159. 
     
160.         if (g_rtsplive && g_rtsp_session) {
     
161.                 printf("rtsp push \n");
     
162.                 rtsp_tx_video(g_rtsp_session, (uint8_t*)RK_MPI_MB_GetPtr(mb), RK_MPI_MB_GetSize(mb),
     
163.                 RK_MPI_MB_GetTimestamp(mb)); // RTSP 发送，通过获取 MB 编码数据虚拟地址，大小，时间戳，然后发送
     
164.                 rtsp_do_event(g_rtsplive);
     
165.         }
     
166. 
     
167.         RK_MPI_MB_ReleaseBuffer(mb);
     
168.         packet_cnt++;
     
169.         /*       
     
170.         static RK_S32 packet_cnt = 0;
     
171.         char pOutPath[128];
     
172.         struct tm t;
     
173.         struct timespec time = { 0, 0 };
     
174.         printf("%s\n",__func__);
     
175. #if 1
     
176.         if(packet_cnt==0)
     
177.         {
     
178.                 clock_gettime(CLOCK_REALTIME, &time);
     
179.                 strftime(pOutPath, sizeof(pOutPath), "/userdata/data/%Y-%m-%d-%H-%M-%S.h264", localtime_r(&time.tv_sec, &t));
     
180.                 printf("video file name=%s\n",pOutPath);
     
181.                 if (!g_output_file) {
     
182.                         g_output_file = fopen(pOutPath, "w");
     
183.                         if (!g_output_file) {
     
184.                                 printf("ERROR: open file: %s fail, exit\n", pOutPath);
     
185.                                 return ;
     
186.                         }
     
187.                 }
     
188.         }
     
189. #endif
     
190. #if 1
     
191.         if (quit)
     
192.                 return;
     
193. 
     
194.         const char *nalu_type = "Jpeg data";
     
195.         switch (RK_MPI_MB_GetFlag(mb)) {
     
196.                 case VENC_NALU_IDRSLICE:
     
197.                         nalu_type = "IDR Slice";
     
198.                         break;
     
199.                 case VENC_NALU_PSLICE:
     
200.                         nalu_type = "P Slice";
     
201.                         break;
     
202.                 default:
     
203.                         break;
     
204.         }
     
205. 
     
206.         if (g_output_file) {
     
207.                 fwrite(RK_MPI_MB_GetPtr(mb), 1, RK_MPI_MB_GetSize(mb), g_output_file);
     
208.                 printf("#Write packet-%d, %s, size %zu\n", packet_cnt, nalu_type,
     
209.                 RK_MPI_MB_GetSize(mb));
     
210.         } else {
     
211.                 printf("#Get packet-%d, %s, size %zu\n", packet_cnt, nalu_type,
     
212.                 RK_MPI_MB_GetSize(mb));
     
213.         }
     
214.         RK_MPI_MB_TsNodeDump(mb);
     
215.         RK_MPI_MB_ReleaseBuffer(mb);
     
216. #endif
     
217.         packet_cnt++;
     
218. #if 1
     
219.         if(packet_cnt==video_output_length)
     
220.         {
     
221.                 if (g_output_file)
     
222.                         fclose(g_output_file);
     
223.                 g_output_file = NULL;
     
224.                 packet_cnt = 0;
     
225.         }
     
226. #endif
     
227. */
     
228. }
     
229. 
     
230. static void rga_packet_cb(MEDIA_BUFFER mb) {
     
231.         static RK_U32 jpeg_id = 0;
     
232. 
     
233.         if (quit)
     
234.                 return;
     
235.         printf("%s\n",__func__);
     
236. 
     
237. /*        char jpeg_path[128];
     
238.         sprintf(jpeg_path, "/userdata/data/test%d.jpg", jpeg_id);
     
239.         FILE *file = fopen(jpeg_path, "w");
     
240.         if (file) {
     
241.         fwrite(RK_MPI_MB_GetPtr(mb), 1, RK_MPI_MB_GetSize(mb), file);
     
242.         fclose(file);
     
243.         } */
     
244. 
     
245.         RK_MPI_MB_TsNodeDump(mb);
     
246.         RK_MPI_MB_ReleaseBuffer(mb);
     
247.         jpeg_id++;
     
248. 
     
249. }
     
250. 
     
251. int main(int argc, char *argv[])
     
252. {
     
253.         int ret=0;
     
254.          
     
255.         signal(SIGINT, sigterm_handler);
     
256. #if 0       
     
257.         RK_CHAR *pOutPath = (char*)"/userdata/data/save.h264";
     
258.         if (pOutPath) {
     
259.                 g_output_file = fopen(pOutPath, "w");
     
260.                 if (!g_output_file) {
     
261.                         printf("ERROR: open file: %s fail, exit\n", pOutPath);
     
262.                         return 0;
     
263.                 }
     
264.         }
     
265. #endif
     
266.                //设置rtsp推流属性
     
267.         g_rtsplive = create_rtsp_demo(554);
     
268.         if(g_rtsplive==NULL)
     
269.                 printf("g_rtsplive is null\n");
     
270.         g_rtsp_session = rtsp_new_session(g_rtsplive, "/live/main_stream");
     
271.         if(g_rtsp_session == NULL)
     
272.                 printf("g_rtsp_session is null\n");
     
273.         rtsp_set_video(g_rtsp_session, RTSP_CODEC_ID_VIDEO_H264, NULL, 0);
     
274. //      rtsp_sync_video_ts(g_rtsp_session, rtsp_get_reltime(), rtsp_get_ntptime()); //rtsp 同步当前网络时间
     
275.         RK_MPI_SYS_Init();//初始化 MPI 系统
     
276. 
     
277.         //设置decode属性
     
278.         VDEC_CHN_ATTR_S stVdecAttr;
     
279.         stVdecAttr.enCodecType = RK_CODEC_TYPE_H264;
     
280.         stVdecAttr.enMode = VIDEO_MODE_STREAM;
     
281.         stVdecAttr.enDecodecMode = VIDEO_DECODEC_HADRWARE;
     
282. 
     
283.         ret = RK_MPI_VDEC_CreateChn(0, &stVdecAttr);
     
284.         if (ret) {
     
285.                 printf("Create Vdec[0] failed! ret=%d\n", ret);
     
286.                 return -1;
     
287.         }
     
288. 
     
289.         //设置decode有数据时 回调
     
290.         MPP_CHN_S VdecChn; //定义模块设备通道结构体。
     
291.         VdecChn.enModId = RK_ID_VDEC;
     
292.         VdecChn.s32DevId = 0;
     
293.         VdecChn.s32ChnId = 0;
     
294.         /*ret = RK_MPI_SYS_RegisterOutCb(&VdecChn, vdec_packet_cb); //注册数据输出回调。
     
295.         if (ret) {
     
296.                 printf("ERROR: register output callback for Vdec[0] error! ret=%d\n", ret);
     
297.                 return 0;
     
298.         }*/
     
299. 
     
300.         //设置encode属性
     
301.         MPP_CHN_S VencChn;
     
302.         VencChn.enModId = RK_ID_VENC;
     
303.         VencChn.s32DevId = 0;
     
304.         VencChn.s32ChnId = 0;
     
305.        
     
306.         VENC_CHN_ATTR_S venc_chn_attr;
     
307.         memset(&venc_chn_attr, 0, sizeof(venc_chn_attr));
     
308. 
     
309.         venc_chn_attr.stVencAttr.enType = RK_CODEC_TYPE_H264;
     
310.         venc_chn_attr.stRcAttr.enRcMode = VENC_RC_MODE_H264VBR;
     
311.         venc_chn_attr.stRcAttr.stH264Vbr.u32Gop = 25;
     
312. 
     
313.         venc_chn_attr.stRcAttr.stH264Vbr.u32MaxBitRate = 1920 * 1080 * 2;
     
314.         // frame rate: in 30/1, out 30  /1.
     
315.         venc_chn_attr.stRcAttr.stH264Vbr.fr32DstFrameRateDen = 1;
     
316.         venc_chn_attr.stRcAttr.stH264Vbr.fr32DstFrameRateNum = 25;
     
317.         venc_chn_attr.stRcAttr.stH264Vbr.u32SrcFrameRateDen = 1;
     
318.         venc_chn_attr.stRcAttr.stH264Vbr.u32SrcFrameRateNum = 25;
     
319. 
     
320.         venc_chn_attr.stVencAttr.imageType = IMAGE_TYPE_NV12; //输入图片的格式，和 VI 输出保持一致
     
321.         venc_chn_attr.stVencAttr.u32PicWidth = 1920; //编码图像宽度，单位像素点
     
322.         venc_chn_attr.stVencAttr.u32PicHeight = 1080;//编码图像高度，单位像素点
     
323.         venc_chn_attr.stVencAttr.u32VirWidth = 1920;//stride 宽度，必须 16 对齐
     
324.         venc_chn_attr.stVencAttr.u32VirHeight = 1080 + 8;// stride 高度，必须 16 对齐
     
325.         venc_chn_attr.stVencAttr.u32Profile = 77; //编码等级 77,是中级 66,基础等级，100,高级
     
326.         ret = RK_MPI_VENC_CreateChn(0, &venc_chn_attr);//创建通道
     
327.        
     
328.         ret = RK_MPI_SYS_RegisterOutCb(&VencChn, venc_packet_cb); //注册数据输出回调。
     
329.         if (ret) {
     
330.                 printf("ERROR: register output callback for Vdec[0] error! ret=%d\n", ret);
     
331.                 return 0;
     
332.         }       
     
333. #ifdef full_flow
     
334.         MPP_CHN_S VencChn1;
     
335.         VencChn1.enModId = RK_ID_VENC;
     
336.         VencChn1.s32DevId = 0;
     
337.         VencChn1.s32ChnId = 1;
     
338.        
     
339.         memset(&venc_chn_attr, 0, sizeof(venc_chn_attr));
     
340. 
     
341.         venc_chn_attr.stVencAttr.enType = RK_CODEC_TYPE_H264;
     
342.         venc_chn_attr.stRcAttr.enRcMode = VENC_RC_MODE_H264VBR;
     
343.         venc_chn_attr.stRcAttr.stH264Vbr.u32Gop = 25;
     
344. 
     
345.         venc_chn_attr.stRcAttr.stH264Vbr.u32MaxBitRate = 1920 * 1080 * 2;
     
346.         // frame rate: in 30/1, out 30  /1.
     
347.         venc_chn_attr.stRcAttr.stH264Vbr.fr32DstFrameRateDen = 1;
     
348.         venc_chn_attr.stRcAttr.stH264Vbr.fr32DstFrameRateNum = 25;
     
349.         venc_chn_attr.stRcAttr.stH264Vbr.u32SrcFrameRateDen = 1;
     
350.         venc_chn_attr.stRcAttr.stH264Vbr.u32SrcFrameRateNum = 25;
     
351. 
     
352.         venc_chn_attr.stVencAttr.imageType = IMAGE_TYPE_RGB888; //输入图片的格式，和 VI 输出保持一致
     
353.         venc_chn_attr.stVencAttr.u32PicWidth = 1920; //编码图像宽度，单位像素点
     
354.         venc_chn_attr.stVencAttr.u32PicHeight = 1080;//编码图像高度，单位像素点
     
355.         venc_chn_attr.stVencAttr.u32VirWidth = 1920;//stride 宽度，必须 16 对齐
     
356.         venc_chn_attr.stVencAttr.u32VirHeight = 1080 + 8;// stride 高度，必须 16 对齐
     
357.         venc_chn_attr.stVencAttr.u32Profile = 77; //编码等级 77,是中级 66,基础等级，100,高级
     
358.         ret = RK_MPI_VENC_CreateChn(1, &venc_chn_attr);//创建通道
     
359. #endif       
     
360.         //设置rga属性
     
361.        
     
362.         RGA_ATTR_S stRgaAttr;
     
363. 
     
364.         stRgaAttr.bEnBufPool = RK_TRUE;
     
365.         stRgaAttr.u16BufPoolCnt = 12;
     
366.         stRgaAttr.u16Rotaion = 0;
     
367.         stRgaAttr.stImgIn.u32X = 0;
     
368.         stRgaAttr.stImgIn.u32Y = 0;
     
369.         stRgaAttr.stImgIn.imgType = IMAGE_TYPE_NV12;
     
370.         stRgaAttr.stImgIn.u32Width = 1920;
     
371.         stRgaAttr.stImgIn.u32Height = 1080;
     
372.         stRgaAttr.stImgIn.u32HorStride = 1920;
     
373.         stRgaAttr.stImgIn.u32VirStride = 1080;
     
374. 
     
375.         stRgaAttr.stImgOut.u32X = 0;
     
376.         stRgaAttr.stImgOut.u32Y = 0;
     
377.         //stRgaAttr.stImgOut.imgType = IMAGE_TYPE_JPEG;
     
378.         stRgaAttr.stImgOut.imgType = IMAGE_TYPE_BGR888;
     
379.         stRgaAttr.stImgOut.u32Width = 1920;
     
380.         stRgaAttr.stImgOut.u32Height = 1080;
     
381.         stRgaAttr.stImgOut.u32HorStride = 1920;
     
382.         stRgaAttr.stImgOut.u32VirStride = 1080;
     
383. 
     
384.         ret = RK_MPI_RGA_CreateChn(0, &stRgaAttr);
     
385.         if (ret) {
     
386.                 printf("Create rga[0] falied! ret=%d\n", ret);
     
387.                 return -1;
     
388.         }
     
389. 
     
390.         MPP_CHN_S vRgaChn;
     
391.         vRgaChn.enModId = RK_ID_RGA;
     
392.         vRgaChn.s32DevId = 0;
     
393.         vRgaChn.s32ChnId = 0;
     
394. 
     
395. /*        ret = RK_MPI_SYS_RegisterOutCb(&vRgaChn, rga_packet_cb); //注册数据输出回调。
     
396.         if (ret) {
     
397.                 printf("ERROR: register output callback for RGA[0] error! ret=%d\n", ret);
     
398.                 return NULL;
     
399.         }*/
     
400. 
     
401.         pthread_t main_stream_thread;
     
402.         pthread_create(&main_stream_thread, NULL, MainStream, NULL);
     
403. #ifdef close_mux
     
404.         //设置mux属性
     
405.         MUXER_CHN_ATTR_S stMuxerAttr;
     
406.         memset(&stMuxerAttr, 0, sizeof(stMuxerAttr));
     
407.         stMuxerAttr.enMode = MUXER_MODE_AUTOSPLIT;
     
408.         stMuxerAttr.enType = MUXER_TYPE_MP4;
     
409.         stMuxerAttr.stSplitAttr.enSplitType = MUXER_SPLIT_TYPE_TIME;
     
410.         stMuxerAttr.stSplitAttr.u32TimeLenSec = 30;
     
411.        
     
412.         /*printf("#MuxerTest: use split name auto type...\n");
     
413.         stMuxerAttr.stSplitAttr.enSplitNameType = MUXER_SPLIT_NAME_TYPE_AUTO;
     
414.         stMuxerAttr.stSplitAttr.stNameAutoAttr.pcPrefix = (RK_CHAR*)"muxer_test";
     
415.         stMuxerAttr.stSplitAttr.stNameAutoAttr.pcBaseDir = (RK_CHAR*)"/userdata/data";
     
416.         // Split File name with timestamp.
     
417.         // stMuxerAttr.stSplitAttr.stNameAutoAttr.bTimeStampEnable = RK_TRUE;
     
418.         stMuxerAttr.stSplitAttr.stNameAutoAttr.u16StartIdx = 1;*/
     
419. 
     
420.          printf("#MuxerTest: use split name callback type, cb:%p, handle:%p...\n",
     
421.            GetRecordFileName, &gu32FileIdx);
     
422.             stMuxerAttr.stSplitAttr.enSplitNameType = MUXER_SPLIT_NAME_TYPE_CALLBACK;
     
423.             stMuxerAttr.stSplitAttr.stNameCallBackAttr.pcbRequestFileNames = GetRecordFileName;
     
424.             stMuxerAttr.stSplitAttr.stNameCallBackAttr.pCallBackHandle =(RK_VOID *)&gu32FileIdx;
     
425. 
     
426.         stMuxerAttr.stVideoStreamParam.enCodecType = RK_CODEC_TYPE_H264;
     
427.         stMuxerAttr.stVideoStreamParam.enImageType = IMAGE_TYPE_NV12;
     
428.         stMuxerAttr.stVideoStreamParam.u16Fps = 25;
     
429.         stMuxerAttr.stVideoStreamParam.u16Level = 41;    // for h264
     
430.         stMuxerAttr.stVideoStreamParam.u16Profile = 77; // for h264
     
431.         stMuxerAttr.stVideoStreamParam.u32BitRate = 1920 * 1080;
     
432.         stMuxerAttr.stVideoStreamParam.u32Width = 1920;
     
433.         stMuxerAttr.stVideoStreamParam.u32Height = 1080;
     
434.         ret = RK_MPI_MUXER_EnableChn(0, &stMuxerAttr);
     
435.         if (ret) {
     
436.                 printf("Create MUXER[0] failed! ret=%d\n", ret);
     
437.                 return -1;
     
438.           }
     
439.        
     
440.         MPP_CHN_S muxerChn;
     
441.         MUXER_CHN_S stMuxerChn;
     
442.        
     
443.         muxerChn.enModId = RK_ID_MUXER;
     
444.         muxerChn.s32DevId = 0;
     
445.         muxerChn.s32ChnId = 0;
     
446.        
     
447.         MuxerHandle stMuxerHandle;
     
448.         stMuxerHandle.u32ChnIdx = 0;
     
449.         stMuxerHandle.u32ModeIdx = RK_ID_MUXER;
     
450.        
     
451.         ret = RK_MPI_SYS_RegisterEventCb(&muxerChn, &stMuxerHandle, muxer_event_cb);
     
452.         if (ret) {
     
453.                 printf("Register event callback failed! ret=%d\n", ret);
     
454.                 return -1;
     
455.         }
     
456.        
     
457.         printf("### Start muxer stream...\n");
     
458.         ret = RK_MPI_MUXER_StreamStart(0);
     
459.         if (ret) {
     
460.                 printf("Muxer start stream failed! ret=%d\n", ret);
     
461.                 return -1;
     
462.         }
     
463. 
     
464.         // Bind VENC[0] to MUXER[0]:VIDEO
     
465.         VencChn.enModId = RK_ID_VENC;
     
466.         VencChn.s32DevId = 0;
     
467.         VencChn.s32ChnId = 0;
     
468.         stMuxerChn.enModId = RK_ID_MUXER;
     
469.         stMuxerChn.enChnType = MUXER_CHN_TYPE_VIDEO;
     
470.         stMuxerChn.s32ChnId = 0;
     
471.         ret = RK_MPI_MUXER_Bind(&VencChn, &stMuxerChn);
     
472.         if (ret) {
     
473.                 printf("ERROR: Bind VENC[0] and MUXER[0]:VIDEO error! ret=%d\n", ret);
     
474.                 return 0;
     
475.         }
     
476. #endif
     
477.         // VDec Bind Rga
     
478.         ret = RK_MPI_SYS_Bind(&VdecChn, &vRgaChn);
     
479.         if (ret) {
     
480.                 printf("ERROR: Bind Vdec[0] and VRGA[0] failed! ret=%d\n");
     
481.                 return -1;
     
482.         }
     
483.         // VDec Bind VENC for save video
     
484.         ret = RK_MPI_SYS_Bind(&VdecChn, &VencChn);
     
485.         if (ret) {
     
486.                 printf("ERROR: Bind Vdec[0] and Venc[0] failed! ret=%d\n");
     
487.                 return -1;
     
488.         }
     
489. #ifdef full_flow
     
490.         ret = RK_MPI_SYS_Bind(&vRgaChn, &VencChn1);
     
491.         if (ret) {
     
492.                 printf("ERROR: Bind VRGA[0] and Venc[1] failed! ret=%d\n");
     
493.                 return -1;
     
494.         }
     
495.         //连接到rtsp推流上
     
496. #endif
     
497. 
     
498.         //设置流媒体参数
     
499.         struct FFRTSPGet ffrtsp_get;
     
500.         ffrtsp_get.callback = FFRKMedia_Vdec_Send;
     
501.         ffrtsp_get.count = 1;
     
502.         ffrtsp_get.ffrtsp_get_info[0].url = (char*)"rtsp://admin:zd123456@192.168.1.5";
     
503.         ffrtspGet(ffrtsp_get);
     
504.         //设置rtsp推流属性
     
505.         //g_rtsplive = create_rtsp_demo(554);
     
506.         //g_rtsp_session = rtsp_new_session(g_rtsplive, "/live/main_stream");
     
507.         //rtsp_set_video(g_rtsp_session, RTSP_CODEC_ID_VIDEO_H264, NULL, 0);
     
508. //        rtsp_sync_video_ts(g_rtsp_session, rtsp_get_reltime(), rtsp_get_ntptime()); //rtsp 同步当前网络时间
     
509.         while(!quit)
     
510.         {
     
511.                 sleep(1);
     
512.         }
     
513.         if (g_rtsplive)
     
514.                 rtsp_del_demo(g_rtsplive);
     
515. #ifdef close_mux
     
516.         printf("### Stop muxer stream...\n");
     
517.         ret = RK_MPI_MUXER_StreamStop(0);
     
518.         if (ret) {
     
519.                 printf("Muxer stop stream failed! ret=%d\n", ret);
     
520.                 return -1;
     
521.         }
     
522. 
     
523.         // UnBind VENC[0] to MUXER[0]
     
524.         VencChn.enModId = RK_ID_VENC;
     
525.         VencChn.s32DevId = 0;
     
526.         VencChn.s32ChnId = 0;
     
527.         stMuxerChn.enModId = RK_ID_MUXER;
     
528.         stMuxerChn.enChnType = MUXER_CHN_TYPE_VIDEO;
     
529.         stMuxerChn.s32ChnId = 0;
     
530.         ret = RK_MPI_MUXER_UnBind(&VencChn, &stMuxerChn);
     
531.         if (ret) {
     
532.                 printf("ERROR: UnBind VENC[0] and MUXER[0] error! ret=%d\n", ret);
     
533.                 return 0;
     
534.         }
     
535. #endif
     
536.         //释放资源
     
537. #ifdef full_flow
     
538.         RK_MPI_SYS_UnBind(&vRgaChn, &VencChn1);
     
539. #endif
     
540.         RK_MPI_SYS_UnBind(&VdecChn, &vRgaChn);
     
541.         RK_MPI_SYS_UnBind(&VdecChn, &VencChn);
     
542. #ifdef full_flow
     
543.         RK_MPI_VENC_DestroyChn(1);
     
544. #endif
     
545.         RK_MPI_VENC_DestroyChn(0);
     
546.         RK_MPI_RGA_DestroyChn(0);
     
547.         RK_MPI_VDEC_DestroyChn(0);
     
548. 
     
549.         return 0;
     
550. }
     
551. 
     
552. 
     
553. 
     

复制代码

chien126

补充张图片，图片上时间戳，静止不动

板蓝根

你是用 librtsp.a 吧？这个是 rockchip 提供的库，好像是有问题，只要输入源不是 VI 就会出现这种情况，但是因为 rockchip 只提供了静态库文件具体什么问题我们也不得而知。你可以自己实现 rtsp 推流，或者用我们的 libffrtsp.so 试一下

chien126

板蓝根 发表于 2021-12-8 09:28
你是用 librtsp.a 吧？这个是 rockchip 提供的库，好像是有问题，只要输入源不是 VI 就会出现这种情况，但 ...

使用ffrtsp用VLC打开也卡住了，硬件IP地址配置如下
1、eth0接IP camera设置IP地址192.168.1.25，camera ip为192.168.1.5
2、eth1接PC,设置IP地址10.0.0.6，pc IP为10.0.0.4
3、用VLC打卡地址rtsp://10.0.0.6:8554/H264_stream_0 卡住没有图像。
4、测试代码如下：

1. #include <assert.h>
   
2. #include <fcntl.h>
   
3. #include <pthread.h>
   
4. #include <signal.h>
   
5. #include <stdbool.h>
   
6. #include <stdio.h>
   
7. #include <stdlib.h>
   
8. #include <string.h>
   
9. #include <time.h>
   
10. #include <unistd.h>
    
11. #include <sys/time.h>
    
12. #include "common/sample_common.h"
    
13. #include "rkmedia_api.h"
    
14. #include "rkmedia_vdec.h"
    
15. #include "ffrtsp/ffrtsp.hh"
    
16. 
    
17. 
    
18. 
    
19. 
    
20. struct RTSP_PUSH_INFO ffrtsp_push[MAXFFRTSPChn];
    
21. 
    
22. static bool quit = false;
    
23. static void sigterm_handler(int sig) {
    
24.         fprintf(stderr, "signal %d\n", sig);
    
25.         quit = true;
    
26. }
    
27. 
    
28. static long getCurrentTimeMsec() {
    
29.         long msec = 0;
    
30.         char str[20] = {0};
    
31.         struct timeval stuCurrentTime;
    
32. 
    
33.         gettimeofday(&stuCurrentTime, NULL);
    
34.         sprintf(str, "%ld%03ld", stuCurrentTime.tv_sec,(stuCurrentTime.tv_usec) / 1000);
    
35.         for (size_t i = 0; i < strlen(str); i++) {
    
36.                 msec = msec * 10 + (str[i] - '0');
    
37.         }
    
38. 
    
39.         return msec;
    
40. }
    
41. 
    
42. 
    
43. 
    
44. int FFRKMedia_Vdec_Send(u_int8_t* framebuff,unsigned framesize,bool * pquit,int cur_chn)
    
45. {
    
46.         //RTSP流数据送到decode通道
    
47.     MEDIA_BUFFER mb = RK_MPI_MB_CreateBuffer(framesize, RK_FALSE, 0);
    
48.     RK_MPI_MB_SetSize(mb, framesize);
    
49.     memcpy(RK_MPI_MB_GetPtr(mb) ,framebuff , framesize);
    
50.     RK_MPI_MB_SetSize(mb, framesize);
    
51.     RK_MPI_SYS_SendMediaBuffer(RK_ID_VDEC, 0, mb);
    
52.         //printf("%s\n",__func__);
    
53.         if(ffrtsp_push[0].fp == NULL) {
    
54.                 continue;
    
55.         }
    
56.         //printf("%s 1\n",__func__);
    
57.         if (RK_MPI_MB_GetPtr(mb) != NULL) {
    
58.                 printf("%s\n",__func__);
    
59.                 fwrite(RK_MPI_MB_GetPtr(mb), RK_MPI_MB_GetSize(mb), 1, ffrtsp_push[0].fp);
    
60.         }
    
61.                
    
62.     RK_MPI_MB_ReleaseBuffer(mb);
    
63.     if (quit)
    
64.             *pquit = true;
    
65. }
    
66. static void *rtsppushbuff(void *data) {
    
67.         printf("%s\n",__func__);
    
68.         ((struct RTSP_PUSH_INFO *)data)->type = RTSP_CODEC_H264;
    
69.         ffrtsph264Push((struct RTSP_PUSH_INFO *)data);
    
70. }
    
71. 
    
72. int main(int argc, char *argv[])
    
73. {
    
74.         int ret=0;
    
75.          
    
76.         signal(SIGINT, sigterm_handler);
    
77. 
    
78. 
    
79.         pthread_t rtsppush_thread;
    
80. 
    
81.         ffrtsp_push[0].idex = 0;
    
82.         ffrtsp_push[0].port = 8554;
    
83.         ffrtsp_push[0].type = RK_CODEC_TYPE_H264;
    
84.        
    
85.         // RTSP 推流线程
    
86.         pthread_create(&rtsppush_thread, NULL, rtsppushbuff, (void *)&ffrtsp_push[0]);
    
87. 
    
88. 
    
89. 
    
90. 
    
91.         //设置流媒体参数
    
92.         struct FFRTSPGet ffrtsp_get;
    
93.         ffrtsp_get.callback = FFRKMedia_Vdec_Send;
    
94.         ffrtsp_get.count = 1;
    
95.         ffrtsp_get.ffrtsp_get_info[0].url = (char*)"rtsp://admin:zd123456@192.168.1.5";
    
96.         ffrtspGet(ffrtsp_get);
    
97. 
    
98.        
    
99.         while(!quit)
    
100.         {
     
101.                 sleep(1);
     
102.         }
     
103. 
     
104. 
     
105.         return 0;
     
106. }
     
107. 
     
108. 
     
109. 
     

复制代码

5、log如下：

1. ./rtsp_test1
   
2. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libffrtsp.so)
   
3. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libffrtsp.so)
   
4. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libffrtsp.so)
   
5. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face_engine.so)
   
6. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face_engine.so)
   
7. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face_engine.so)
   
8. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face_engine.so)
   
9. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face.so)
   
10. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face.so)
    
11. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face.so)
    
12. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face.so)
    
13. ./rtsp_test1: /lib/libstdc++.so.6: no version information available (required by /usr/lib/libarcsoft_face.so)
    
14. media get entity by name: rkcif-lvds-subdev is null
    
15. media get entity by name: rkcif-lite-lvds-subdev is null
    
16. media get entity by name: rkisp-mpfbc-subdev is null
    
17. media get entity by name: rkisp_dmapath is null
    
18. media get entity by name: rockchip-mipi-dphy-rx is null
    
19. Rga built version:1.04 cb973b1+2021-06-01 11:34:20
    
20. rtsppushbuff
    
21. Created new TCP socket 8 for connection
    
22. Connecting to 192.168.1.5, port 554 on socket 8...
    
23. Play this stream using the URL "rtsp://10.0.0.6:8554/H264_stream_0"
    
24. Beginning streaming...
    
25. ...remote connection opened
    
26. Sending request: DESCRIBE rtsp://admin:zd123456@192.168.1.5 RTSP/1.0
    
27. CSeq: 2
    
28. User-Agent: ffrtspGet (LIVE555 Streaming Media v2017.10.28)
    
29. Accept: application/sdp
    
30. 
    
31. 
    
32. Received 184 new bytes of response data.
    
33. Received a complete DESCRIBE response:
    
34. RTSP/1.0 401 Unauthorized
    
35. CSeq: 2
    
36. WWW-Authenticate: Digest realm="IP Camera(F3061)", nonce="32be1bc1d9706735c8a7d0ddeb8fa885", stale="FALSE"
    
37. Date:  Mon, Dec 13 2021 22:48:44 GMT
    
38. 
    
39. 
    
40. Resending...
    
41. Sending request: DESCRIBE rtsp://admin:zd123456@192.168.1.5 RTSP/1.0
    
42. CSeq: 3
    
43. Authorization: Digest username="admin", realm="IP Camera(F3061)", nonce="32be1bc1d9706735c8a7d0ddeb8fa885", uri="rtsp://admin:zd123456@192.168.1.5", response="7ca4546c386098f11bc4bc79352c5576"
    
44. User-Agent: ffrtspGet (LIVE555 Streaming Media v2017.10.28)
    
45. Accept: application/sdp
    
46. 
    
47. 
    
48. Received 702 new bytes of response data.
    
49. Received a complete DESCRIBE response:
    
50. RTSP/1.0 200 OK
    
51. CSeq: 3
    
52. Content-Type: application/sdp
    
53. Content-Base: rtsp://admin:zd123456@192.168.1.5/
    
54. Content-Length: 572
    
55. 
    
56. v=0
    
57. o=- 1639435724717783 1639435724717783 IN IP4 192.168.1.5
    
58. s=Media Presentation
    
59. e=NONE
    
60. b=AS:5050
    
61. t=0 0
    
62. a=control:rtsp://admin:zd123456@192.168.1.5/
    
63. m=video 0 RTP/AVP 96
    
64. c=IN IP4 0.0.0.0
    
65. b=AS:5000
    
66. a=recvonly
    
67. a=x-dimensions:1920,1080
    
68. a=control:rtsp://admin:zd123456@192.168.1.5/trackID=1
    
69. a=rtpmap:96 H264/90000
    
70. a=fmtp:96 profile-level-id=420029; packetization-mode=1; sprop-parameter-sets=Z00AKpY1QPAET8s3AQEBQAABwgAAV+QB,aO4xsg==
    
71. a=Media_header:MEDIAINFO=494D4B48010300000400000100000000000000000000000000000000000000000000000000000000;
    
72. a=appversion:1.0
    
73. 
    
74. [URL:"rtsp://admin:zd123456@192.168.1.5/"]: Got a SDP description:
    
75. v=0
    
76. o=- 1639435724717783 1639435724717783 IN IP4 192.168.1.5
    
77. s=Media Presentation
    
78. e=NONE
    
79. b=AS:5050
    
80. t=0 0
    
81. a=control:rtsp://admin:zd123456@192.168.1.5/
    
82. m=video 0 RTP/AVP 96
    
83. c=IN IP4 0.0.0.0
    
84. b=AS:5000
    
85. a=recvonly
    
86. a=x-dimensions:1920,1080
    
87. a=control:rtsp://admin:zd123456@192.168.1.5/trackID=1
    
88. a=rtpmap:96 H264/90000
    
89. a=fmtp:96 profile-level-id=420029; packetization-mode=1; sprop-parameter-sets=Z00AKpY1QPAET8s3AQEBQAABwgAAV+QB,aO4xsg==
    
90. a=Media_header:MEDIAINFO=494D4B48010300000400000100000000000000000000000000000000000000000000000000000000;
    
91. a=appversion:1.0
    
92. 
    
93. [URL:"rtsp://admin:zd123456@192.168.1.5/"]: Initiated the "video/H264" subsession (client ports 59324-59325)
    
94. Sending request: SETUP rtsp://admin:zd123456@192.168.1.5/trackID=1 RTSP/1.0
    
95. CSeq: 4
    
96. Authorization: Digest username="admin", realm="IP Camera(F3061)", nonce="32be1bc1d9706735c8a7d0ddeb8fa885", uri="rtsp://admin:zd123456@192.168.1.5/", response="9347da75e78d0d7f8950b6dab8316ab7"
    
97. User-Agent: ffrtspGet (LIVE555 Streaming Media v2017.10.28)
    
98. Transport: RTP/AVP;unicast;client_port=59324-59325
    
99. 
    
100. 
     
101. Received 204 new bytes of response data.
     
102. Received a complete SETUP response:
     
103. RTSP/1.0 200 OK
     
104. CSeq: 4
     
105. Session:        448226533;timeout=60
     
106. Transport: RTP/AVP;unicast;client_port=59324-59325;server_port=8222-8223;ssrc=777d88c7;mode="play"
     
107. Date:  Mon, Dec 13 2021 22:48:44 GMT
     
108. 
     
109. 
     
110. [URL:"rtsp://admin:zd123456@192.168.1.5/"]: Set up the "video/H264" subsession (client ports 59324-59325)
     
111. [URL:"rtsp://admin:zd123456@192.168.1.5/"]: Created a data sink for the "video/H264" subsession
     
112. Sending request: PLAY rtsp://admin:zd123456@192.168.1.5/ RTSP/1.0
     
113. CSeq: 5
     
114. Authorization: Digest username="admin", realm="IP Camera(F3061)", nonce="32be1bc1d9706735c8a7d0ddeb8fa885", uri="rtsp://admin:zd123456@192.168.1.5/", response="e2935df5aea2223cfe6517b08beb150c"
     
115. User-Agent: ffrtspGet (LIVE555 Streaming Media v2017.10.28)
     
116. Session: 448226533
     
117. Range: npt=0.000-
     
118. 
     
119. 
     
120. Received 180 new bytes of response data.
     
121. Received a complete PLAY response:
     
122. RTSP/1.0 200 OK
     
123. CSeq: 5
     
124. Session:        448226533
     
125. RTP-Info: url=rtsp://admin:zd123456@192.168.1.5/trackID=1;seq=47568;rtptime=417018600
     
126. Date:  Mon, Dec 13 2021 22:48:44 GMT
     
127. 
     
128. 
     
129. [URL:"rtsp://admin:zd123456@192.168.1.5/"]: Started playing session...
     
130. FFRKMedia_Vdec_Send
     
131. FFRKMedia_Vdec_Send
     
132. FFRKMedia_Vdec_Send
     
133. FFRKMedia_Vdec_Send
     
134. FFRKMedia_Vdec_Send
     
135. FFRKMedia_Vdec_Send
     
136. FFRKMedia_Vdec_Send
     
137. FFRKMedia_Vdec_Send
     
138. FFRKMedia_Vdec_Send
     
139. FFRKMedia_Vdec_Send
     
140. FFRKMedia_Vdec_Send
     
141. FFRKMedia_Vdec_Send
     
142. FFRKMedia_Vdec_Send
     
143. FFRKMedia_Vdec_Send
     
144. FFRKMedia_Vdec_Send
     
145. FFRKMedia_Vdec_Send
     
146. FFRKMedia_Vdec_Send
     
147. FFRKMedia_Vdec_Send
     
148. FFRKMedia_Vdec_Send
     
149. FFRKMedia_Vdec_Send
     
150. FFRKMedia_Vdec_Send
     
151. FFRKMedia_Vdec_Send
     
152. FFRKMedia_Vdec_Send
     
153. FFRKMedia_Vdec_Send
     
154. FFRKMedia_Vdec_Send
     
155. FFRKMedia_Vdec_Send
     
156. FFRKMedia_Vdec_Send
     
157. FFRKMedia_Vdec_Send
     
158. FFRKMedia_Vdec_Send
     
159. FFRKMedia_Vdec_Send
     
160. FFRKMedia_Vdec_Send
     
161. FFRKMedia_Vdec_Send
     
162. FFRKMedia_Vdec_Send
     
163. FFRKMedia_Vdec_Send
     
164. FFRKMedia_Vdec_Send
     
165. FFRKMedia_Vdec_Send
     

复制代码

板蓝根

没看到有解码器初始化和流发送啊，代码是不是贴漏了？先从下面方式排查一下。
1. 去掉解码步骤，ffrtsp_get 回调获取到的 buff 直接额送到 ffrtsp_push,确认一下是不是 rtsp 配置问题。ffrtsp_demo_test.cpp
2. ffrtsp 后直接保留 h264 文件/ Vdec 解码后保留 NV12 / VENC 编码后保留 H264 来确认哪个步骤出了问题

chien126

板蓝根 发表于 2021-12-14 09:41
没看到有解码器初始化和流发送啊，代码是不是贴漏了？先从下面方式排查一下。
1. 去掉解码步骤，ffrtsp_ge ...

没用解码器，IP camera获得的流就是H264编码，NV12的，直接推流到另一个网口的

板蓝根

ffrtsp_get 之后 fwrite 本地文件保存的文件可以播放吗？ 直接跑 ffrtsp_demo_test 可以出流吗？ 其次可以用 gdb 等调试手段调式一下呀

chien126

板蓝根 发表于 2021-12-15 09:31
ffrtsp_get 之后 fwrite 本地文件保存的文件可以播放吗？ 直接跑 ffrtsp_demo_test 可以出流吗？ 其次可以 ...

使用ffrtsp_demo_test测试也是出不了流，请教下2个问题
1、我打开了SAVE_FILE配置保存为test_rtsp_0，用什么工具打开，我直接拖到VLC上打不开
2、我刚开始的测试代码，偶尔也打开过，想问下是不是需要 网口需要设置路由之类，请问下你们网卡怎么配置的，我在开机启动上以下命令：ifconfig eth0 10.0.0.6 netmask 255.255.255.0；ifconfig eth1 192.168.1.25 netmask 255.255.255.0

板蓝根

1. ffplay 和 vlc 都可以播放，ffplay 要把文件后缀改成 .264 才可以。
2. 双网卡的话有可能是网关的问题，建议你先把一张网卡down 掉，PC 先 ping 通在测试。

xiongyingsun

chien126 发表于 2021-12-26 22:46
使用ffrtsp_demo_test测试也是出不了流，请教下2个问题
1、我打开了SAVE_FILE配置保存为test_rtsp_0，用 ...

这个可以拉音频么~