lancas.blogg.se - Ffmpeg rtsp streaming example c++

You can pack all of these components into one process/thread which makes handling memory a little easier and reduces copying of large memory chunks. After you have muxed your streams you can then dump the final video into a file or stream it to a server. You will most likely have to do some timestamp-magic in this step. Each audio/video/subtitle track will be represented as stream in the FFmpeg-muxer.

Muxing: This is the step where you combine your audio and video data.

This step is the most resource-demanding step. Depending on the codec you want to use, you first have to get some settings straight and then consume the raw frames provided by the previous parts of your pipeline.

Encoding: This step is similar for both video and audio.

But because I’m not great with audio I will skip this part and leave it to the professionals to explain this part 🙂

Filtering: If you want to filter your raw audio input, adjust the volume, do some mixing or other crazy audio stuff, this is the place to do it.

Because FFmpeg uses the planar YUV 4:2:2 pixelformat internally you might need to convert the pixel format you get from your source device (especially webcams only output in packed format).Ī list of the FFmpeg pixel formats can be found here. Because the raw video image can be quite huge you may want to think about doing some of your pixel-magic on the GPU (compositing would fit nicely there). Here the per-pixel manipulation like scaling or resampling is done.

Scaling/resampling: This is the first step after capturing your video data.

But there are plenty of great tutorials on this from other people: using v4l2 and using pulseaudio video capturing -> scaling -> encoding \Īudio capturing -> filtering -> encoding / Since this step is highly platform dependent it will not be covered in this tutorial. I’m assuming you have already captured your video/audio data. We will first take a short overview over this pipeline and then focus on each individual section. If you want to create videos using FFmpeg there is a basic pipeline setup to go with.