Raspberry Pi GPU Audio Video Programming

by Jan Newmarch

Overview

Delve into the Broadcom VideoCore GPU used on the Raspberry Pi and master topics such as OpenGL ES and OpenMAX. Along the way, you’ll also learn some Dispmanx, OpenVG, and GPGPU programming.

The author, Jan Newmarch bumped into a need to do this kind of programming while trying to turn the RPi into a karaoke machine: with the CPU busting its gut rendering MIDI files, there was nothing left for showing images such as karaoke lyrics except for the GPU, and nothing really to tell him how to do it.

Raspberry Pi GPU Audio Video Programming scratches his itch and since he had to learn a lot about RPi GPU programming, he might as well share it with you. What started as a side issue turned into a full-blown project of its own; and this stuff is hard.

What You'll Learn

• Use Dispmanx and EGL on Raspberry Pi

• Work with OpenMAX and its components, state, IL Client Library, * * Buffers, and more on RPi

• Process images and video on RPi

• Handle audio on RPi

• Render OpenMAX to OpenGL on the RPi

• Play multimedia files on the RPi

• Use OpenVG for text processing and more

• Master overlays

Who This Book Is For

You should be comfortable with C programming and at least some concurrency and thread programming using it. This book is for experienced programmers who are new or learning about Raspberry Pi.

Product Details

ISBN-13:	9781484224717
Publisher:	Apress
Publication date:	12/19/2016
Edition description:	1st ed.
Pages:	439
Product dimensions:	7.01(w) x 10.00(h) x 0.04(d)

About the Author

Jan Newmarch is Head of ICT (Higher Education) at Box Hill Institute, Adjunct Professor at Canberra University and Adjunct Lecturer in the School of Information Technology, Computing and Mathematics at Charles Sturt University. He is interested in more aspects of Computing than he has time to pursue, but the major thrust over the last few years has developed from user interfaces under Unix into Java, the Web and now into general distributed systems. Jan has developed a number of publicly available software systems in these areas. Right now, he is looking at sound for Linux systems and programming the Raspberry Pi's GPU.

Table of Contents

1. Introduction to Raspberry Pi.- 2. Khronos Group.- 3. Compiling Programs for the Raspberry Pi.- 4. Dispmanx on the Raspberry Pi.- 5. EGL on RPi.- 6. OpenGL ES on RPi.- 7. OpenMAX on RPi Concepts.- 8. OpenMAX Components.- 9. OpenMAX on the RPi State.- 10. OpenMAX IL Client Library on the RPi.- 11. OpenMAX Buffers on the RPi.- 12. Image Processing on the RPi.- 13. OpenMAX Video Processing on the RPi.- 14. OpenMAX Audio on the RPi.- 15. Rendering OpenMAX to OpenGL on the RPi.- 16. Playing Multimedia Files on the RPi.- 17. Basic OpenVG on the RPi.- 18. Text Processing in OpenVG on the RPi.- 19. Overlays on the RPi.