Allow streaming from third party applications

(#917) Feature Open: Under consideration video

Problem

Screen capture and encoding in every chat app including fluxer is nowhere close and likely to never be close to being as good as programs dedicated to this task such as OBS Studio. Some examples of what can be accomplished using these programs to stream include:
  • Stream specific zones of a monitor/window (useful in cases where someone has an ultrawide monitor and wants to screenshare something that forces big black bars on the side, or for people who only have one big monitor and want to screenshare a zone of it, etc)
  • Manage audio mixing (could edit volume of a program for your stream without changing the volume for yourself, could manage volume of specific sources)
  • Take advantage of hardware encoding for newer codecs such as AV1
For advanced users it is basically impossible to get these features within an integrated chat experience. If you want these features you have to stream on an external platform and send a link around.

Proposed solution

Add a feature where a user in a voice chat can get a WHIP/RTMP stream url and stream key to use in third party software such as OBS studio to be able to start a video stream to that chat from the external software. Or give each user their own global stream url+stream key that allows them to start a stream in whatever voice chat they are currently in. Streams from external software should be presented to other users exactly the same as any stream started using the normal built in screen sharing features.

Notes (optional)

LiveKit has something called LiveKit Ingress which seems to be meant to enable stuff like this https://docs.livekit.io/transport/media/ingress-egress/ingress/ https://www.linode.com/docs/guides/live-streaming-with-livekit-and-obs/

8 comments

Sign in with Fluxer to comment and vote.
Comment by sophie 🌸
this would be absolutely fantastic, especially for NVIDIA users on linux where OBS can use NVENC but most other apps don't implement it! obs-vkcapture is also difficult to beat with regards to overhead. as an anecdote, i remember a few years back, being on my old PC because i was moving. i was stuck with an i3-8100 and a 1050 ti. gaming, and streaming on the same system, i could run GTA V on max settings 1080p60 to twitch via OBS-VKcapture and it was buttery smooth, whereas screensharing to anything else like discord or web-based stuff was terrible, like 9 fps and drove the cpu to 100%, impacting game performance.
Comment by vicky
vicky 1 vote originally by @vkyfox on GitHub
I second this will all of my being. I enjoy fooling around in OBS a lot, for audio as well as video, and I would love it so, so, so much if there was some kind of direct link between OBS output and Fluxer streaming. If only for the fact — I don't know if it got better in the last months — that it's always been a nightmare to make screen capture work decently with HDR-capable displays where OBS handles it out-of-the box like it's nothing! My only concern is the potential latency that could be added with the use of those protocols? but the truth is I know next to nothing about them :D
Comment by @coffeecode3d
RexSystem 1 vote originally by @coffeecode3d on GitHub
I was coming here to say that I use broadcast box already and being able to integrate it like that would be amazing
Comment by Jonah
Jonah 1 vote
I stream a podcast weekly using Streamyard, which allows me to stream to YouTube and Twitch simultaneously. If I could stream directly from that to Fluxer via RTMP that’d be fantastic. Currently our paid subscribers have to chat separately in a Signal group.
Comment by Adam Novagen
As someone who regularly streams games with OBS for my friends to follow along, it would be FANTASTIC for them to be able to watch right from the Fluxer call, instead of neesing to load VLC on the side. I would consider this an absolute killer feature. +1!
Comment by CLynx
CLynx 1 vote edited 2 replies
I hope it will make it into the app at some point especially since after the new SFU update screen capture on Windows is still going to use WGC in most cases from what I've seen in the help centre? WGC is horrible for game capture in particular because it forces software cursor which causes cursor input lag (bad), and on systems with broken MPOs (common on pre-50 series NVIDIA GPUs with some monitors) it also breaks Independent Flip (very very very bad) in games where the cursor is visible, which means DWM composition, which increases input lag massively and breaks VRR. According to the help centre page about issues fixed by the new voice system, it will come with injection based game capture, but only in exclusive fullscreen (you have to go out of your way to achieve this on modern Windows, and it doesn't even exist in DirectX 12) and in games without anti-cheat. To be fair Microsoft should just fix WGC, but this issue has been reported to MS by OBS devs since WGC was first created so I wouldn't count on it. Their own game bar game recording feature doesn't even use it afaik. OBS itself uses WGC as a capture method of last resort, if DXGI/GDI methods can't capture something
Comment by Hampus
HampusStaff 3 votes 1 reply
I will see what I can do to offer proper injection-based game capture, but so far we've been flagged as malware and gotten 1,000 support tickets and Reddit posts claiming that Fluxer is spyware because of it. I still need to look into a safe way to do this, and might offer it as a companion application that you can install, quite possibly, to isolate it from the main Fluxer application.
Comment by CLynx
CLynx 1 vote
I would just like to give an update on this, like a month ago out of frustration I tried reporting this issue on the MS Feedback Hub (with very low hopes, to be clear!), and while I received absolutely 0 response, the other day I decided to check Windows Insider release notes and found this under "Windows 11 Insider Release Preview Build 26200.10066/26300.10066" from 13 Nov:
[Mouse cursor] New! The new Pointer indicator makes it easier for people with low vision to locate and use the mouse pointer. To turn it on, go to Settings > Accessibility > Mouse pointer and touch and turn on Pointer indicator. After you turn on the setting, press Windows logo key + Ctrl + Shift + X to turn the pointer indicator on or off. This update also improves mouse pointer performance during screen captures, reducing visible cursor latency in scenarios such as game streaming.
After installing this out of curiosity and forcing some gradual rollout features on with vivetool, I can confirm that Microsoft actually seems to have fixed my main issue with WGC. Pleasantly surprised