JavaFX Media Enhancements Survey

[John Hendrikx]

Hi,

Some background: I've intergrated both MPV and VLC media players into 
JavaFX by having them render their output to a Stage. JavaFX is rendered 
on a child Stage of this main stage, and the child stage tracks the 
exact size of the main stage on which video is rendered. The JavaFX 
stage is transparent, so JavaFX is overlayed over the video.  JavaFX's 
own media player is unfortunately insufficient for my purposes (a remote 
controlled entertainment center projected on a big screen), so I've 
highlighted the minimum I'd need to make JavaFX's media player a third 
alternative for the two players I already support:

1) ID3 metadata support for MP4 files.
Rating: 3

2) Support for multichannel audio rendering (more than 2 channels).
Rating: 2

3) Subtitles support for MP4 files and HTTP Live Streaming.
Rating: 1

4) HDR support.
Rating: 3

5) InputStream for AudioClip with PCM support.
Rating: 3

6) Public APIs to access raw audio and video frames.
Rating: 3 (I extract video frames for previews using org.bytedeco ffmpeg)

7) Support for multiple audio tracks in MP4 files and alternate audio streams in HTTP Live Streaming provided via #EXT-X-MEDIA tag.
Rating: 2

8) Media recording/capture.
Rating: 3

9) Opus audio codec.
Rating: 1

10) MKV (matroska) file format.
Rating: 1

11) WebM/VP9/Opus
Rating: 1

12) RTSP (Real Time Streaming Protocol)
Rating: 3

13) Pluggable codecs
Rating: 2 (could be useful if support for popular codecs starts lagging behind)

Please, list any additional media formats (codecs) / protocols you would like to see in upcoming JavaFX releases:

The main ones have been mentioned (MKV, Opus).

List any additional media enhancements you consider important to JavaFX Media:

- Ability to control subtitle delay (as part of subtitle support)
- Ability to control playback speed (with audio pitch correction)

--John

On 22/07/2022 06:48, Alexander Matveev wrote:
> Greetings!
>
> We are running a little survey to get input on possible JavaFX Media enhancements. Below you can find a list of possible JavaFX Media enhancements, which we might implement in the future, although there is no commitment. We will appreciate if you can rate each enhancement on how useful/important it will be for JavaFX mainline. Put “1" for very important and I need this feature; “2" for looks important, but I am not planning to use it; “3" for not important and I do not need it.
>
> 1) ID3 metadata support for MP4 files.
> Rating:
>
> 2) Support for multichannel audio rendering (more than 2 channels).
> Rating:
>
> 3) Subtitles support for MP4 files and HTTP Live Streaming.
> Rating:
>
> 4) HDR support.
> Rating:
>
> 5) InputStream for AudioClip with PCM support.
> Rating:
>
> 6) Public APIs to access raw audio and video frames.
> Rating:
>
> 7) Support for multiple audio tracks in MP4 files and alternate audio streams in HTTP Live Streaming provided via #EXT-X-MEDIA tag.
> Rating:
>
> 8) Media recording/capture.
> Rating:
>
> 9) Opus audio codec.
> Rating:
>
> 10) MKV (matroska) file format.
> Rating:
>
> 11) WebM/VP9/Opus
> Rating:
>
> 12) RTSP (Real Time Streaming Protocol)
> Rating:
>
> 13) Pluggable codecs
> Rating:
>
> Please, list any additional media formats (codecs) / protocols you would like to see in upcoming JavaFX releases:
>
> List any additional media enhancements you consider important to JavaFX Media:
>
> Thanks,
> Alexander