Enhancing Web Media Support: A WebAssembly-Driven Open-Source Framework

In 2024, we presented our open-source project that opens browser support to a variety of formats. This project introduces a new HTML5 syntax designed to create dynamic media pipelines for use cases related to media content handling. It leverages several technologies, including WebAssembly, Emscripten, Web Components, and GPAC. Together, these tools enable dynamic support for data formats not natively supported by browsers. This enables the option of display of data in legacy formats and promotes the development of new formats without relying on browsers to supply native support and without relying on generation and maintenance of browser plugins.

The proposed HTML5 syntax is intuitive and flexible, catering both to novice web designers and professional developers within the open-source community who want to ensure that media content is accessible across all browsers. However, creating new decoders and integrating into the underlying GPAC media filter framework can be challenging for developers unfamiliar with WebAssembly and GPAC’s framework.

To address this, alongside the player and SDK, we have updated our Visual Studio Code extension to streamline the development and integration of custom media decoders. The extension is now fully integrated with GitHub repositories, enabling users to retrieve, modify, compile, and test WebAssembly decoders directly. Additionally, we have released a new set of license-free decoders covering various use cases, including documents, images, audio, and video.

Our visual studio code extension is available at the following URL : https://marketplace.visualstudio.com/items?itemName=Bevara.bevara-access

This project is open to contributions. Below are the links to our repositories: • Filters Repository: Contains all license-free media filters that can be integrated “as is“ into web pages or modified. • Solver Repository: The fundamental glue component that enables the dynamic building of media filters within web pages. • Player Repository: Provides the SDK and tools for compiling media filters locally.

By encouraging the use of public forks on open projects—which require making derived projects public—we aim to foster a growing repository of freely available decoders for the community to use and build upon.