skrashevich/go2rtc

go2rtc

Ultimate camera streaming application with support RTSP, WebRTC, HomeKit, FFmpeg, RTMP, etc.

• zero-dependency and zero-config small app for all OS (Windows, macOS, Linux, ARM)
• zero-delay for many supported protocols (lowest possible streaming latency)
• streaming from RTSP, RTMP, DVRIP, HTTP (FLV/MJPEG/JPEG/TS), USB Cameras and other sources
• streaming from any sources, supported by FFmpeg
• streaming to RTSP, WebRTC, MSE/MP4, HLS or MJPEG
• first project in the World with support streaming from HomeKit Cameras
• first project in the World with support H265 for WebRTC in browser (Safari only, https://github.com/AlexxIT/Blog/issues/5)
• on the fly transcoding for unsupported codecs via FFmpeg
• play audio files and live streams on some cameras with speaker
• multi-source 2-way codecs negotiation
  • mixing tracks from different sources to single stream
  • auto match client supported codecs
  • 2-way audio for some cameras
• streaming from private networks via ***
• can be integrated to any smart home platform or be used as standalone app

Inspired by:

• series of streaming projects from https://github.com/deepch
• https://github.com/pion/webrtc go library and whole https://github.com/pion team
• https://github.com/aler9/rtsp-simple-server idea from https://github.com/aler9
• https://gstreamer.freedesktop.org/ framework pipeline idea
• MediaSoup framework routing idea
• HomeKit Accessory Protocol from https://github.com/brutella/hap

---

• Fast start
  • go2rtc: ***ary
  • go2rtc: Docker
  • go2rtc: Home Assistant Add-on
  • go2rtc: Home Assistant Integration
• Configuration
  • Module: Streams
    • Two way audio
    • Source: RTSP
    • Source: RTMP
    • Source: HTTP
    • Source: FFmpeg
    • Source: FFmpeg Device
    • Source: Exec
    • Source: Echo
    • Source: HomeKit
    • Source: DVRIP
    • Source: Tapo
    • Source: Ivideon
    • Source: Hass
    • Source: ISAPI
    • Source: Roborock
    • Source: WebRTC
    • Source: WebTorrent
    • Incoming sources
    • Stream to camera
  • Module: API
  • Module: RTSP
  • Module: WebRTC
  • Module: WebTorrent
  • Module: ***
  • Module: Hass
  • Module: MP4
  • Module: HLS
  • Module: MJPEG
  • Module: Log
• Security
• Codecs filters
• Codecs madness
• Codecs negotiation
• Projects using go2rtc
• Camera experience
• TIPS
• FAQ

Fast start

1. Download ***ary or use Docker or Home Assistant Add-on or Integration
2. Open web interface: http://localhost:1984/

Optionally:

• add your streams to config file
• setup external access to webrtc

Developers:

• write your own web interface
• integrate web api into your smart home platform

go2rtc: ***ary

Download ***ary for your OS from https://github.com/AlexxIT/go2rtc/releases/:

• go2rtc_win64.zip - Windows 64-bit
• go2rtc_win32.zip - Windows 32-bit
• go2rtc_linux_amd64 - Linux 64-bit
• go2rtc_linux_i386 - Linux 32-bit
• go2rtc_linux_arm64 - Linux ARM 64-bit (ex. Raspberry 64-bit OS)
• go2rtc_linux_arm - Linux ARM 32-bit (ex. Raspberry 32-bit OS)
• go2rtc_linux_mipsel - Linux MIPS (ex. https://github.com/AlexxIT/XiaomiGateway3)
• go2rtc_mac_amd64.zip - Mac Intel 64-bit
• go2rtc_mac_arm64.zip - Mac ARM 64-bit

Don't forget to fix the rights chmod +x go2rtc_xxx_xxx on Linux and Mac.

go2rtc: Docker

Container https://hub.docker.com/r/alexxit/go2rtc with support amd64, 386, arm64, arm. This container is the same as Home Assistant Add-on, but can be used separately from Home Assistant. Container has preinstalled FFmpeg, *** and Python.

go2rtc: Home Assistant Add-on

https://my.home-assistant.io/badges/supervisor_addon.svg](https://my.home-assistant.io/redirect/supervisor_addon/?addon=a889bffc_go2rtc&repository_url=https%3A%2F%2Fgithub.com%2FAlexxIT%2Fhassio-addons)

1. Install Add-On:
   • Settings > Add-ons > Plus > Repositories > Add https://github.com/AlexxIT/hassio-addons
   • go2rtc > Install > Start
2. Setup Integration

go2rtc: Home Assistant Integration

https://github.com/AlexxIT/WebRTC custom component can be used on any https://www.home-assistant.io/installation/, including https://github.com/AlexxIT/HassWP on Windows. It can automatically download and use the latest version of go2rtc. Or it can connect to an existing version of go2rtc. Addon installation in this case is optional.

Configuration

• by default go2rtc will search go2rtc.yaml in the current work dirrectory
• api server will start on default 1984 port (TCP)
• rtsp server will start on default 8554 port (TCP)
• webrtc will use port 8555 (TCP/UDP) for connections
• ffmpeg will use default transcoding options

Configuration options and a complete list of settings can be found in https://github.com/AlexxIT/go2rtc/wiki/Configuration.

Available modules:

• streams
• api - HTTP API (important for WebRTC support)
• rtsp - RTSP Server (important for FFmpeg support)
• webrtc - WebRTC Server
• mp4 - MSE, MP4 stream and MP4 shapshot Server
• hls - HLS TS or fMP4 stream Server
• mjpeg - MJPEG Server
• ffmpeg - FFmpeg integration
• *** - *** integration (external access for private network)
• hass - Home Assistant integration
• log - logs config

Module: Streams

go2rtc support different stream source types. You can config one or multiple links of any type as stream source.

Available source types:

• rtsp - RTSP and RTSPS cameras with two way audio support
• rtmp - RTMP streams
• http - HTTP-FLV, MPEG-TS, JPEG (snapshots), MJPEG streams
• ffmpeg - FFmpeg integration (HLS, files and many others)
• ffmpeg:device - local USB Camera or Webcam
• exec - advanced FFmpeg and GStreamer integration
• echo - get stream link from bash or python
• homekit - streaming from HomeKit Camera
• dvrip - streaming from DVR-IP NVR
• tapo - TP-Link Tapo cameras with two way audio support
• ivideon - public cameras from Ivideon service
• hass - Home Assistant integration
• isapi - two way audio for Hikvision (ISAPI) cameras
• roborock - Roborock vacuums with cameras
• webrtc - WebRTC/WHEP sources
• webtorrent - WebTorrent source from another go2rtc

Read more about incoming sources

Two way audio

Supported for sources:

• RTSP cameras with ONVIF Profile T (back channel connection)
• TP-Link Tapo cameras
• Hikvision ISAPI cameras
• Roborock vacuums models with cameras
• Any Browser as IP-camera

Two way audio can be used in browser with WebRTC technology. The browser will give access to the microphone only for HTTPS sites (https://stackoverflow.com/questions/52759992/how-to-access-camera-and-microphone-in-chrome-without-https).

go2rtc also support play audio files and live streams on this cameras.

Source: RTSP

yaml
streams:
  sonoff_camera: rtsp://rtsp:12345678@192.168.1.123/av_stream/ch0
  dahua_camera:
    - rtsp://admin:password@192.168.1.123/cam/realmonitor?channel=1&subtype=0&unicast=true&proto=Onvif
    - rtsp://admin:password@192.168.1.123/cam/realmonitor?channel=1&subtype=1
  amcrest_doorbell:
    - rtsp://username:password@192.168.1.123:554/cam/realmonitor?channel=1&subtype=0#backchannel=0
  unify_camera: rtspx://192.168.1.123:7441/fD6ouM72bWoFijxK
  glichy_camera: ffmpeg:rstp://username:password@192.168.1.123/live/ch00_1 

Recommendations

• Amcrest Doorbell users may want to disable two way audio, because with an active stream you won't have a call button working. You need to add #backchannel=0 to the end of your RTSP link in YAML config file
• Dahua Doorbell users may want to change backchannel https://github.com/AlexxIT/go2rtc/issues/52
• Unify users may want to disable HTTPS verification. Use rtspx:// prefix instead of rtsps://. And don't use ?enableSrtp https://github.com/AlexxIT/go2rtc/issues/81
• TP-Link Tapo users may skip login and password, because go2rtc support login https://drmnsamoliu.github.io/video.html
• If your camera has two RTSP links - you can add both of them as sources. This is useful when streams has different codecs, as example AAC audio with main stream and PCMU/PCMA audio with second stream
• If the stream from your camera is glitchy, try using ffmpeg source. It will not add CPU load if you won't use transcoding
• If the stream from your camera is very glitchy, try to use transcoding with ffmpeg source

Source: RTMP

You can get stream from RTMP server, for example Frigate.

yaml
streams:
  rtmp_stream: rtmp://192.168.1.123/live/camera1

Source: HTTP

Support Content-Type:

• HTTP-FLV (video/x-flv) - same as RTMP, but over HTTP
• HTTP-JPEG (image/jpeg) - camera snapshot link, can be converted by go2rtc to MJPEG stream
• HTTP-MJPEG (multipart/x) - simple MJPEG stream over HTTP
• MPEG-TS (video/mpeg) - legacy streaming format

yaml
streams:
  # [HTTP-FLV] stream in video/x-flv format
  http_flv: http://192.168.1.123:20880/api/camera/stream/780900131155/657617
  
  # [JPEG] snapshots from Dahua camera, will be converted to MJPEG stream
  dahua_snap: http://admin:password@192.168.1.123/cgi-bin/snapshot.cgi?channel=1

  # [MJPEG] stream will be proxied without modification
  http_mjpeg: https://mjpeg.sanford.io/count.mjpeg

PS. Dahua camera has bug: if you select MJPEG codec for RTSP second stream - snapshot won't work.

Source: FFmpeg

You can get any stream or file or device via FFmpeg and push it to go2rtc. The app will automatically start FFmpeg with the proper arguments when someone starts watching the stream.

• FFmpeg preistalled for Docker and Hass Add-on users
• Hass Add-on users can target files from https://www.home-assistant.io/more-info/local-media/setup-media/ folder

Format: ffmpeg:{input}#{param1}#{param2}#{param3}. Examples:

yaml
streams:
  # [FILE] all tracks will be copied without transcoding codecs
  file1: ffmpeg:/media/BigBuckBunny.mp4

  # [FILE] video will be transcoded to H264, audio will be skipped
  file2: ffmpeg:/media/BigBuckBunny.mp4#video=h264

  # [FILE] video will be copied, audio will be transcoded to pcmu
  file3: ffmpeg:/media/BigBuckBunny.mp4#video=copy#audio=pcmu

  # [HLS] video will be copied, audio will be skipped
  hls: ffmpeg:https://devstreaming-cdn.apple.com/videos/streaming/examples/bipbop_16x9/gear5/prog_index.m3u8#video=copy

  # [MJPEG] video will be transcoded to H264
  mjpeg: ffmpeg:http://185.97.122.128/cgi-bin/faststream.jpg#video=h264

  # [RTSP] video with rotation, should be transcoded, so select H264
  rotate: ffmpeg:rtsp://rtsp:12345678@192.168.1.123/av_stream/ch0#video=h264#rotate=90

All trascoding formats has https://github.com/AlexxIT/go2rtc/blob/master/cmd/ffmpeg/ffmpeg.go: h264, h265, opus, pcmu, pcmu/16000, pcmu/48000, pcma, pcma/16000, pcma/48000, aac, aac/16000.

But you can override them via YAML config. You can also add your own formats to config and use them with source params.

yaml
ffmpeg:
  bin: ffmpeg  # path to ffmpeg binary
  h264: "-codec:v libx264 -g:v 30 -preset:v superfast -tune:v zerolatency -profile:v main -level:v 4.1"
  mycodec: "-any args that support ffmpeg..."
  myinput: "-fflags nobuffer -flags low_delay -timeout 5000000 -i {input}"

• You can use video and audio params multiple times (ex. #video=copy#audio=copy#audio=pcmu)
• You can use go2rtc stream name as ffmpeg input (ex. ffmpeg:camera1#video=h264)
• You can use rotate params with 90, 180, 270 or -90 values, important with transcoding (ex. #video=h264#rotate=90)
• You can use width and/or height params, important with transcoding (ex. #video=h264#width=1280)
• You can use raw param for any additional FFmpeg arguments (ex. #raw=-vf transpose=1)
• You can use input param to override default input template (ex. #input=rtsp/udp will change RTSP transport from TCP to UDP+TCP)
  • You can use raw input value (ex. #input=-timeout 5000000 -i {input})
  • You can add your own input templates

Read more about encoding https://github.com/AlexxIT/go2rtc/wiki/Hardware-acceleration.

Source: FFmpeg Device

You can get video from any USB-camera or Webcam as RTSP or WebRTC stream. This is part of FFmpeg integration.

• check available devices in Web interface
• resolution and framerate must be supported by your camera!
• for Linux supported only video for now
• for macOS you can stream Facetime camera or whole Desktop!
• for macOS important to set right framerate

yaml
streams:
  linux_usbcam:   ffmpeg:device?video=0&resolution=1280x720#video=h264
  windows_webcam: ffmpeg:device?video=0#video=h264
  macos_facetime: ffmpeg:device?video=0&audio=1&resolution=1280x720&framerate=30#video=h264#audio=pcma

Source: Exec

FFmpeg source just a shortcut to exec source. You can get any stream or file or device via FFmpeg or GStreamer and push it to go2rtc via RTSP protocol:

yaml
streams:
  stream1: exec:ffmpeg -hide_banner -re -stream_loop -1 -i /media/BigBuckBunny.mp4 -c copy -rtsp_transport tcp -f rtsp {output}

Source: Echo

Some sources may have a dynamic link. And you will need to get it using a bash or python script. Your script should echo a link to the source. RTSP, FFmpeg or any of the supported sources.

Docker and Hass Add-on users has preinstalled python3, curl, jq.

Check examples in https://github.com/AlexxIT/go2rtc/wiki/Source-Echo-examples.

yaml
streams:
  apple_hls: echo:python3 hls.py https://developer.apple.com/streaming/examples/basic-stream-osx-ios5.html

Source: HomeKit

Important:

• You can use HomeKit Cameras without Apple devices (iPhone, iPad, etc.), it's just a yet another protocol
• HomeKit device can be paired with only one ecosystem. So, if you have paired it to an iPhone (Apple Home) - you can't pair it with Home Assistant or go2rtc. Or if you have paired it to go2rtc - you can't pair it with iPhone
• HomeKit device should be in same network with working mDNS between device and go2rtc

go2rtc support import paired HomeKit devices from Home Assistant. So you can use HomeKit camera with Hass and go2rtc simultaneously. If you using Hass, I recommend pairing devices with it, it will give you more options.

You can pair device with go2rtc on the HomeKit page. If you can't see your devices - reload the page. Also try reboot your HomeKit device (power off). If you still can't see it - you have a problems with mDNS.

If you see a device but it does not have a pair button - it is paired to some ecosystem (Apple Home, Home Assistant, HomeBridge etc). You need to delete device from that ecosystem, and it will be available for pairing. If you cannot unpair device, you will have to reset it.

Important:

• HomeKit audio uses very non-standard AAC-ELD codec with very non-standard params and specification violation
• Audio can be transcoded by ffmpeg source with #async option
• Audio can be played by ffplay with -use_wallclock_as_timestamps 1 -async 1 options
• Audio can't be played in VLC and probably any other player

Recommended settings for using HomeKit Camera with WebRTC, MSE, MP4, RTSP:

streams:
  aqara_g3:
    - hass:Camera-Hub-G3-AB12
    - ffmpeg:aqara_g3#audio=aac#audio=opus#async

RTSP link with "normal" audio for any player: rtsp://192.168.1.123:8554/aqara_g3?video&audio=aac

This source is in active development! Tested only with Aqara Camera Hub G3 (both EU and CN versions).

Source: DVRIP

Other names: DVR-IP, NetSurveillance, Sofia protocol (NETsurveillance ActiveX plugin XMeye SDK).

• you can skip username, password, port, channel and subtype if they are default
• setup separate streams for different channels
• use subtype=0 for Main stream, and subtype=1 for Extra1 stream
• only the TCP protocol is supported

yaml
streams:
  camera1: dvrip://username:password@192.168.1.123:34567?channel=0&subtype=0

Source: Tapo

TP-Link Tapo proprietary camera protocol with two way audio support.

• stream quality is the same as RTSP protocol
• use the cloud password, this is not the RTSP password! you do not need to add a login!
• you can also use UPPERCASE MD5 hash from your cloud password with admin username

yaml
streams:
  # cloud password without username
  camera1: tapo://cloud-password@192.168.1.123
  # admin username and UPPERCASE MD5 cloud-password hash
  camera2: tapo://admin:MD5-PASSWORD-HASH@192.168.1.123

Source: Ivideon

Support public cameras from service Ivideon.

yaml
streams:
  quailcam: ivideon:100-tu5dkUPct39cTp9oNEN2B6/0

Source: Hass

Support import camera links from https://www.home-assistant.io/ config files:

• support https://www.home-assistant.io/integrations/generic/, setup via GUI
• support https://www.home-assistant.io/integrations/homekit_controller/

yaml
hass:
  config: "/config"  # skip this setting if you Hass Add-on user

streams:
  generic_camera: hass:Camera1  # Settings > Integrations > Integration Name
  aqara_g3: hass:Camera-Hub-G3-AB12

More cameras, like https://www.home-assistant.io/integrations/tuya/, https://www.home-assistant.io/integrations/onvif/, and possibly others can also be imported by using https://github.com/felipecrs/hass-expose-camera-stream-source#importing-home-assistant-cameras-to-go2rtc-andor-frigate.

Source: ISAPI

This source type support only backchannel audio for Hikvision ISAPI protocol. So it should be used as second source in addition to the RTSP protocol.

yaml
streams:
  hikvision1:
    - rtsp://admin:password@192.168.1.123:554/Streaming/Channels/101
    - isapi://admin:password@192.168.1.123:80/

Source: Roborock

This source type support Roborock vacuums with cameras. Known working models:

• Roborock S6 MaxV - only video (the vacuum has no microphone)
• Roborock S7 MaxV - video and two way audio

Source support load Roborock credentials from Home Assistant https://github.com/humbertogontijo/homeassistant-roborock. Otherwise, you need to log in to your Roborock account (MiHome account is not supported). Go to: go2rtc WebUI > Add webpage. Copy roborock://... source for your vacuum and paste it to go2rtc.yaml config.

If you have graphic pin for your vacuum - add it as numeric pin (lines: 123, 456, 678) to the end of the roborock-link.

Source: WebRTC

This source type support two connection formats:

• https://www.ietf.org/id/draft-murillo-whep-01.html - is an unapproved standard for WebRTC video/audio viewers. But it may already be supported in some third-party software. It is supported in go2rtc.
• go2rtc/WebSocket - This format is only supported in go2rtc. Unlike WHEP it supports asynchronous WebRTC connection and two way audio.

yaml
streams:
  webrtc1: webrtc:http://192.168.1.123:1984/api/webrtc?src=dahua1
  webrtc2: webrtc:ws://192.168.1.123:1984/api/ws?src=dahua1

Source: WebTorrent

This source can get a stream from another go2rtc via WebTorrent protocol.

yaml
streams:
  webtorrent1: webtorrent:?share=huofssuxaty00izc&pwd=k3l2j9djeg8v8r7e

Incoming sources

By default, go2rtc establishes a connection to the source when any client requests it. Go2rtc drops the connection to the source when it has no clients left.

• Go2rtc also can accepts incoming sources in RTSP, HTTP and WebRTC/WHIP formats
• Go2rtc won't stop such a source if it has no clients
• You can push data only to existing stream (create stream with e***y source in config)
• You can push multiple incoming sources to same stream
• You can push data to non e***y stream, so it will have additional codecs inside

Examples

• RTSP with any codec

  yaml
  ffmpeg -re -i BigBuckBunny.mp4 -c copy -rtsp_transport tcp -f rtsp rtsp://localhost:8554/camera1
  

• HTTP-MJPEG with MJPEG codec

  yaml
  ffmpeg -re -i BigBuckBunny.mp4 -c mjpeg -f mpjpeg http://localhost:1984/api/stream.mjpeg?dst=camera1
  

• HTTP-FLV with H264, AAC codecs

  yaml
  ffmpeg -re -i BigBuckBunny.mp4 -c copy -f flv http://localhost:1984/api/stream.flv?dst=camera1
  

• MPEG-TS with H264 codec

  yaml
  ffmpeg -re -i BigBuckBunny.mp4 -c copy -f mpegts http://localhost:1984/api/stream.ts?dst=camera1
  

Incoming: Browser

You can turn the browser of any PC or mobile into an IP-camera with support video and two way audio. Or even broadcast your PC screen:

1. Create e***y stream in the go2rtc.yaml
2. Go to go2rtc WebUI
3. Open links page for you stream
4. Select camera+microphone or display+speaker option
5. Open webrtc local page (your go2rtc should work over HTTPS!) or share link via WebTorrent technology (work over HTTPS by default)

Incoming: WebRTC/WHIP

You can use OBS Studio or any other broadcast software with https://www.ietf.org/archive/id/draft-ietf-wish-whip-01.html protocol support. This standard has not yet been approved. But you can download OBS Studio https://github.com/obsproject/obs-studio/actions/runs/3969201209:

• Settings > Stream > Service: WHIP > [***]

Stream to camera

go2rtc support play audio files (ex. music or https://www.home-assistant.io/integrations/#text-to-speech) and live streams (ex. radio) on cameras with two way audio support (RTSP/ONVIF cameras, TP-Link Tapo, Hikvision ISAPI, Roborock vacuums, any Browser).

API example:

POST http://localhost:1984/api/streams?dst=camera1&src=ffmpeg:http://example.com/song.mp3#audio=pcma#input=file

• you can stream: local files, web files, live streams or any format, supported by FFmpeg
• you should use ffmpeg source for transcoding audio to codec, that your camera supports
• you can check camera codecs on the go2rtc WebUI info page when the stream is active
• some cameras supp