AudioIntelligence is a premium, high-fidelity Music Information Retrieval (MIR) and DSP framework. Built for Swift 6 and Apple Silicon (M4 optimized), it delivers bit-exact scientific accuracy validated against the EBU SQAM dataset.
While legacy libraries like Librosa are excellent for research, AudioIntelligence is engineered for Industrial-Grade Production:
- ⚡ Sub-millisecond Latency: Native AMX (Apple Matrix Extension) and Metal kernels for real-time professional workflows.
- 🎨 Native SwiftUI UI: Includes
AudioIntelligenceUIfor hardware-accelerated, real-time spectrograms, waveforms, and meters. - 🛡️ Swift 6 Actor Isolation: The world's first MIR library with compile-time thread safety and zero data races.
- 💿 Professional Format Support: Mastery of ALL native Apple codecs including AAC, MP3, ALAC, and FLAC via
AVAudioConverter. - 🍏 Apple Binary Standard: Zero JSON artifacts. All forensic DNA signatures are exported in high-performance .plist format.
- 4️⃣ Hybrid 4GB Cache: Advanced persistent storage for instantaneous retrieval of forensic DNA signatures.
Built with SwiftUI and Metal, our ready-to-use components deliver industrial-grade visualization out of the box.
Example: The 'AudioScope Pro' dashboard built using the Infinity Engine v6.3.
Coming from the Python world? AudioIntelligence provides 1:1 functional parity with Librosa while delivering 10x performance improvements.
- Migration Guide: A Rosetta stone for Librosa users.
- Format Support: Native support for WAV, MP3, FLAC, and more.
The Infinity Engine is formally validated against industry "Gold Standards":
- ITU-R BS.1770-4 / EBU R128: bit-exact, multi-channel loudness metering (±0.1 LU precision).
- Forensic True Peak: 511-tap high-precision inter-sample detection (BT.1770 compliant).
- EBU Tech 3341/3342: Verified Integrated, Momentary, Short-term, and LRA compliance.
- SQAM Level A: Comprehensive 70-track scientific audit completed with 100% stability.
- Scientific Integrity: Verified mathematical parity with Librosa (MSE < 0.00018).
We maintain a strict "Scientific First" policy. Every algorithm is validated against official industry test vectors to ensure absolute forensic integrity.
- Automated CI Suite: Every commit is tested on macOS 15runners via GitHub Actions.
- Reference Parity: High-precision tests verify parity with EBU R128 and ITU-R BS.1770 standards.
- SQAM Suite: Comprehensive analysis of the official EBU Sound Quality Assessment Material library.
- Regression Testing: Extensive coverage for multi-channel energy summation and gating logic.
To run the scientific validation suite locally:
swift test --filter ScientificValidationTestsAudioIntelligence is organized into specialized domains for maximum performance and architectural clarity:
Sources/AudioIntelligenceCore/
├── Core/ # Foundation (Loading, Caching, Phase Vocoding)
├── Feature/ # Analysis (Spectral, Rhythm, Pitch, Harmonic, Mastering)
├── Effects/ # Transformation (HPSS, Stem Separation, NMF)
├── Display/ # Visualization (Metal Spectrograms, Waveforms)
└── Util/ # Governance (DNA Reporting, Calibration, DSP Helpers)
From time-domain forensic analysis to frequency-domain neural separation, AudioIntelligence provides a comprehensive toolkit for professional audio engineering:
- STFT / ISTFT: Frame-major, vDSP-optimized spectral foundations.
- Loudness (EBU R128): Scientifically calibrated gating and weighting.
- True Peak: 4x sinc-interpolated inter-sample detection.
- Forensic DNA: Bit-depth integrity and forgery audit.
- Mel / Chroma / CQT / VQT: High-resolution pitch and timbral transforms.
- Viterbi Decoder: Professional sequence modeling for state analysis.
- Onsets & Rhythm: Multi-band rhythmic mapping and tempograms.
- Harmony & Tonnetz: 6D Harmonic relationship mapping on the tonnetz grid.
- StructureEngine: Automated structural segmentation (Intro, Verse, Chorus, Outro) and Recurrence Matrices.
- Wavelets: Multi-resolution analysis via DWT (Haar, Daubechies 2/3).
- NMF Source Separation: Deterministic non-negative matrix factorization.
- HPSS: Median-filter based Harmonic-Percussive source separation.
- Pitch Audits: YIN, Piptrack (parabolic), and Viterbi sequence tracking.
- AudioScience: AES17 dynamic range, SMPTE IMD, and ITU-R 468-4 weighting.
- Instrument DNA: Neural-assisted instrument fingerprinting and predictions.
AudioIntelligence is designed for seamless integration with AI Agents, Mastering DAWs, and Automated Forensic Pipelines.
- Scientific Integrity Report: Official v8.1.5 verification certificate.
- Report Specification: Detailed breakdown of the forensic output, now utilizing the Apple Binary Property List (.plist) standard.
- Engine Catalog: Comprehensive technical specs for all 31+ specialized DSP engines.
- The Basics: SPM Setup and a production-grade SwiftUI Analysis View.
- MIR DNA: Feature extraction and Metal-accelerated spectrograms.
- Rhythm & Pulse: Implementing beat-perfect synchronization and metronomes.
- Source Separation: Real-time instrumental isolation using HPSS and Neural Stems.
- Scientific Forensics: Integrity auditing, EBU R128 compliance, and DNA Reporting.
- Engine Manual: Technical specs for the complete 26-engine suite.
- Integration Guide: Swift 6 Actor-model and SwiftUI UI patterns.
- Calibration Manifest: Verified parity vs EBU/AES reference vectors.
- Project Structure: Global module map.
- Risk Management: Strategic migration and industrial risk guide.
© 2026 trgysvc — Engineered for Professional Excellence.