ITS has discovered a need to transport two independent HD video streams where the pair represents a 3D image. This is different than interleaving odd even frames; left-right-left-right. It is two independent views of the same object in real time with a stereo lens spacing; two independent cameras. This is how we all see, two independent views with stereo spacing that our brains turn into 3D space perception.
When one has to insert an HD video stream into Ethernet or a radio transport system. Video compression is needed to reduce the bit rate to fit within the transport channel. In either method, transport may be point to point or networked. When networks are involved, the pathway from source to destination is typically variable. Variability worsens when inserting in packetised video to the cloud. When inserting into radio, the bit error rate (BER), atmospheric effects and any relay channels (nodes) along the way may also vary the path length.
Compression, pathway length and network node hops introduce variable latency in each stream and may be quite different in each. Latency in a compressed video transported in these ways can vary 100 milliseconds to several seconds. Compression/decompression alone introduces a variable latency from 60-500 milliseconds and is influenced by scene variability from frame to frame.
The group of pictures (GOP) settings of the MPEG compressor, processing power of the source and destination computing systems, system buffering requirements and BER. If the source is video at 60 frames per second (FPS), latency in frames may vary from 3 to 10 frames. The transport parameters may add as much as seconds to CODEC latency depending on other traffic, BER (results in retry-resend delays), pathway length, node hops and more. These latencies may also be 10s of milliseconds to 100s of milliseconds. Transport latency variation in terms of frames at 60 FPS may be from 1-10 frames or more.
If a standalone video stream is involved, the latency properly buffered can be managed to provide a steady decoded video output at the source frame rate, but delayed. Buffering absorbs the variability in latency to avoid dropped and freeze frames. We all have experienced dropped and frees frames when viewing streaming video; e.g “buffering…” messages and shuddering in the video. Even so, it works for a single stream image.
However 3D imaging requires 2 time correlated images viewed together. If one eye views an image that is 2-20 frames older than the other, the 3D image will be hard for the viewer to ingest and correlate to a clear perspective view of the object.
ITS believes there is a solution (see a prototype block diagram, below) employing elements of our field proven Intellectual Property Cores (IPC). That can dynamically correlate two independent video streams without specialised CODECs, network data or setup. One of the elements is a two- channel version of our KRONOS Timestamper. Kronos can receive HD-SDI video from a source and will embed an accurate KLV microsecond time stamp on each frame.
At the destination end our Dynamic Latency Compensator (DLC) IPC can be used in 2_channel form. This element reads the microsecond timestamps of each incoming HD-SDI video stream and compares it to a locally synchronised time; either GPS or NTP. The Dynamic Latency Compensator is able to use these time measurements to generate a pair of SDI outputs that represents the original 3D imagery with 0-1 differential frame error. In addition, it can also measure the average latency from source to destination frame to frame. A real time and accurate latency measurement can assist with managing man-in-the-loop control. In man-in-the-loop situations a latency magnitude beyond 200 milliseconds can result in unpredictable and dangerous human control.
CODECs used for this solution can be H.264/H.265 CODEC pairs targeting bit rates as low as 6 megabits/sec1, but they must reliably preserve the
KLV metadata timestamp during the encoding and decoding back to a pair of SDI streams. These CODECS are available from multiple sources. Learn more about our custom product skills and field proven IPCs here, https://www.itsamerica.com/assets/ITS%20IP%20and%20Capabilities.pdf
Contact us and let’s collaborate to deliver a correlated HD-SDI 3D imaging system for your application.