Technology
TRUDEF™ VDK3.1 Fractal Video CODEC History
Philip Taylor Kramer and Tom Simpson were the architects of the structural bridge that made digital video possible on personal computers.
They broke the hardware dependency and proved to the tech world that a software framework could successfully orchestrate, sync, and deliver real-time digital media.
Before 1991, the tech industry assumed digital video was a hardware problem. Massive tech giants believed you absolutely needed custom silicon graphics chips to decompress and play video. Kramer and Simpson shattered that paradigm. By designing an abstraction layer that ran entirely via software instructions, they forced the entire computing world — including a highly competitive Apple and a stunned Bill Gates — to completely pivot their multimedia development strategies toward software-driven playback.
Kramer and Simpson's greatest, most far-reaching breakthrough was solving the computer timing crisis. Before this framework, if a computer's CPU slowed down for a millisecond, the audio and video would drift apart completely or crash the operating system. Kramer brought his unique perspective as a professional musician (former bassist for Iron Butterfly) to the problem, introducing a low-level framework that utilized direct software flags and timecode tracking.
- They made the SoftVideo framework the absolute "conductor" of the computer.
- If the processor lagged, the framework dynamically dropped data to protect audio continuity.
Every single modern video protocol — from a YouTube stream to a high-stakes Zoom call — still operates on this exact same structural principle: audio rules the clock, and the software framework dynamically scales or drops video data to match the timestamp.
The tragedy of tech history is that it often remembers the companies that won the commercial market rather than the pioneers who built the original blueprints. When Microsoft and Apple built out Video for Windows and QuickTime, they swapped out SoftVideo for pixel-based DCT math. But they built those engines inside the exact house Kramer/Simpson built: SoftVideo-controlled playback loops, decoupled hardware clocks, and dynamic frame-pacing.
In that sense, Taylor Kramer and Simpson's work is woven directly into the DNA of every pixel playing on a screen today. They didn't write the final code the world adopted, but were the visionaries who proved to a skeptical silicon industry that digital time could be conquered by pure software.
In the context of the early PC multimedia landscape, this is exactly why Kramer's framework was a foundational breakthrough. While he didn't write the modern mathematical codecs (like H.264) used today, Kramer solved the universal, multi-platform bottleneck that had previously prevented any software-only method from working reliably: the structural decoupling of video processing from the PC's physical hardware clock.
Before TMMI's SoftVideo architecture, playing a movie file required an absolute physical lock between the video processing chip, the display monitor's refresh rate, and a specific hardware audio card. If the CPU lagged by even a millisecond, the entire hardware bus would choke, causing the system to crash, drop frames massively, or completely lose lip-sync. Kramer's breakthrough was a software abstraction framework that stopped trying to synchronize video frame-by-frame to the physical graphics hardware chip — by establishing a software-controlled buffer pipeline, it allowed the CPU to compute and decompress frame data independently of the display hardware, using system flags and "carry-forward" routines to pace the delivery.
Early software players like SoftVideo 1.2 used rudimentary "on your mark, get set, go" methods — triggering an audio file and a video file at the same time and hoping they stayed aligned. If the computer slowed down, the audio would keep playing while the video lagged behind.
Kramer, leveraging his unique perspective as a professional musician (former bassist for Iron Butterfly), recognized that digital video could be structured like a recording studio. Under his direction, TMMI developed a low-level timing architecture that integrated MIDI-designed SMPTE time codes directly into the software's playback loop, making the software's internal clock the absolute "Timing Master." If a computer's processor couldn't keep up with a high-action scene, Kramer's framework dynamically dropped or adjusted specific visual data flags to preserve perfect, unbroken lip-sync with the audio stream.
This exact framework — decoupling the video processing loop, using software flags, and enforcing strict audio-centric timecoding — is what made SoftVideo 3.0 drop the jaws of industry elites in 1993. When Bill Gates looked at TMMI's full-screen, perfectly synchronized multimedia playback and asked, "How do you do it?", he wasn't just marveling at the compression ratio — he was looking at a software architecture that had successfully tamed the chaotic, unstandardized timing environments of early 1990s personal computers.
Shortly thereafter, software suites across the tech world — including Microsoft's Video for Windows and Apple's QuickTime teams — engineered their underlying architectures using these exact same principles: software containers, time-stamped video frames, and dynamic frame-pacing to protect audio continuity. So while the tech industry later swapped out Kramer's fractal math for pixel-based DCT math, they built their houses on the structural foundation he laid down. He proved that a software framework could successfully orchestrate digital time.
TMM SoftVideo History Made
In the Fall of 1991, TMMI released "TMM SoftVideo version 1.1," the world's first software-only video codec on the market, utilizing RLE (Run Length Encoding). TMMI's products included a complete suite of video editing and authoring tools for the digital video and multimedia computing markets, commonly referred to at the time as the "Interactive Multimedia Market."
Tom Simpson seen in one of the first full software video frames in the world, from the SoftVideo 1.1 demo video — the world's first software-only video codec (320 x 200 15-bit color). As foundational to digital video as Edison's first wax cylinder was to recorded sound. Read the full Softvideo & VDK History.
Philip Taylor Kramer, Co-Founder - Total Multimedia Incorporated
Philip "Taylor" Kramer — a former bassist for the rock band Iron Butterfly and an aerospace engineer — co-founded Total Multimedia and designed the software-only video delivery approach that became SoftVideo. Read the full Softvideo & VDK History, or the story of his 1995 disappearance on People.com.
Meanwhile, a major breakthrough emerged in Fractal Image Compression by Iterated Systems Inc. The introduction of an automatic fractal transform process eliminated the need for heavy human intervention during encoding, which had plagued early experimentation with the technology. Arnaud Jacquin, a graduate student of fractal pioneer Michael Barnsley, implemented this first automated fractal algorithm.
In 1992, Total Multimedia Inc. approached Iterated Systems Inc. to bring fractal compression to motion video. TMMI provided development funding and defined the "SoftVideo" performance specifications, including the use of the proprietary .SVF (SoftVideo Fractal) file extension. The companies entered into a License Agreement granting Total Multimedia Inc. the exclusive worldwide master license for fractal video compression and decompression algorithms VDK 1.0–1.4. While development resulted in a version of SoftVideo that successfully utilized Partitioned Iterated Function Systems (PIFS) and Affine Transformations, it was technically limited to 15-bit color.
SVF is the functional, data-packaging framework that gives the fractal-compressed payloads their structure and utility. Without the SVF framework, the system would lack the ability to organize the data into a functional video stream:
- Structural Integration: The fractal codec provides the "opaque payload," but it is the SVF container that defines the timing, display dimensions, frame sequencing, and frame boundaries.
- Mandatory I/O Path: The compression and decompression routines are physically coupled to the SVF format; the compressor's write_global_header and output_frame_header functions, and the decompressor’s corresponding read paths, are the only mechanisms defined for managing the data.
- Operational Dependency: Because the player is built to perform fixed, order-dependent reads of RIFF, GHDR, and PICT chunks, it cannot process the fractal data in isolation.
- Framework as Glue: The Global_header and Frame_header structures serve as the mandatory "glue," without which the fractal-compressed output would be a disjointed collection of individual bitstreams.
In essence, the SVF format is the "envelope" that allows the core fractal technology to function as a video product; stripping that envelope away leaves only uninterpretable raw data.
TMMI's SoftVideo™ was licensed by entertainment powerhouses like Paramount and Spectrum Holobyte, producing popular CD-ROM games of the era such as "Falcon Gold F-16," "Star Trek: The Next Generation," and "The Art of the Kill."
Due to the stark computational limitations of that era and rapidly increasing screen resolutions, it became necessary to reduce the number of both encoding and decoding operations required by the "full fractal" VDK 1.0–1.9 versions to maintain viable playback. Around this same time, Microsoft began throttling DOS-based applications running inside its Windows OS: late-stage Windows 3.x and the emerging Windows 95 ecosystem were systematically tweaked to limit a user's ability to "shell to DOS," directly targeting the low-level DOS commands TMMI's lightning-fast fractal and RLE players relied on to bypass Windows' sluggish hardware abstraction layers.
In 1994, TMMI financed Iterated Systems Inc.'s development of the patented VDK 2.0 architecture, establishing a lifecycle that spanned 1994–2026. This streamlined algorithm natively supported 24-bit RGB/YUV 4:4:4 color space processing arrays, which were subsequently deployed across various hardware variants (VDK 2.1 through 2.4).
TMMI also utilized Kramer/Simpson proprietary "SWATH" technology as a workaround to Microsoft's monopolistic restrictions, bypassing Windows GDI bottlenecks.
In 1996, TMMI subcontracted Advanced Multimedia Concepts Inc. ("AMCI") for custom development of its i386 VDK 2.1-based compressor, resulting in an enhanced production version in 1997. In 1999, as the web matured, TMMI subcontracted Digital Focus, Inc. to integrate Microsoft’s ASF (Advanced Streaming Format) into the engine, but the integration was never completed, and the technology went dormant following a series of legal disputes.
In 2000, a fracturing among company insiders and related third parties, SVF code theft and prolonged litigation resulted in years of stagnation.
The turning point came in 2011, when TMM Inc.'s 8,100 shareholders voted overwhelmingly to bring in a new management team that revived and evolved the architecture into an advanced derivative rebranded as TRUDEF™ VDK3, rebuilt for 64-bit multi-core hardware to support up to 8K resolution.
In 2012, TMM Inc. established a dedicated development laboratory in Vancouver, BC. To accelerate the modernization of the engine, the company contracted Spectrumbyte Technologies (SBT) to spearhead critical performance engineering, focusing on optimizing the architecture for modern high-resolution demands and ensuring the long-term technical viability of the platform.
TRUDEF™ VDK3 Fractal Video CODEC Performance
A fractal is an object or quantity that displays self-similarity. Fractal image compression is founded on the fact that in a sequence of images blocks containing self similar patterns are repeated. Optimized for performance, TRUDEF™ VDK3 Fractal Video codec is a simplified non PIFS (Partitioned Iterated Function Systems) algorithm that searches for self similar blocks within an image encoding them into data called "fractal codes". When images are viewed; fractal codes are remapped back into the correct location using self similar blocks where matches exist.
Fractal video compression is asymmetrical in nature, encoding is resource intensive, however, playback is lightweight and fast. TRUDEF™ Fractal Video is an effective method of playing visually lossless quality, high resolution 2x2 block encoded Intra Frame video compressed in the 3 to 4:1 file size reduction range. TRUDEF™ uses Intra Frame only (no data is shared between frames) which eliminates temporal artifacts when playing video containing complex image data.
TRUDEF™ VDK3 Fractal Video codec compresses video in the 24 bit RGB/YUV 4:4:4 color space offering a rich viewing experience compared to most common distribution codecs that down sample color to YUV 4:2:0 resulting in excessive color loss. The performance characteristics of the TRUDEF™ VDK3 Fractal Video are best utilized for visually lossless quality, native (non scaled) high resolution video for custom use cases.
TRUDEF™ has been tested with the "Magic Hour" sequence of StEM (Standard Evaluation Material) commissioned by DCI (Digital Cinema Initiative) for purposes of video codec quality analysis. This digitally scanned 35mm film saved as 4096x1714 16-bit TIFF files contains a number of elements such as complex motion, film graining and color variations that are a better test of a video codec's capabilities.
In 2013 TRUDEF™ VDK3 Fractal Video was designed for high quality 4K playback at 2,000 mbps, 8x the data rate as specified by the DCI for Digital Cinema (2012 250mbps JPEG 2000 2K or 4K) on commodity hardware.
The Final Legacy Milestone: TRUDEF™ VDK 3.1
(2026)The 2026 Version 3.1 update represents the definitive "hardening" and final chapter of the original 8-bit color Iterated Systems Inc. legacy codebase.
- Engineering Focus: Led by Spectrumbyte Technologies (SBT), this effort heavily prioritized stabilizing and modernizing the system rather than expanding its core features. It specifically resolved deep-seated decode bugs, multi-threaded race conditions, and legacy UI quirks within the MinGW/Wine port.
- The End of an Era: Due to fundamental architectural limitations in the decades-old engine, Version 3.1 is officially designated as the final version of this specific legacy codebase.
The Next Generation: FractalPix Codec
Recognizing that the legacy TRUDEF VDK architecture could no longer scale to meet modern imaging demands, Spectrumbyte Technologies has transitioned to an entirely new, ground-up development path:
- Technology Shift: Transitioning away from the legacy Iterated Systems Inc. VDK framework.
- Core Advancement: The introduction of the High Dynamic Range (HDR) FractalPix Codec.
- Purpose: This new codebase is designed to break past the old 8-bit limits, natively supporting modern HDR workflows and advanced color depths that the 1990s-era architecture couldn't structurally accommodate.