isomer presentation
TRANSCRIPT
MIDI
Audio
Ab
stra
ctio
n
Layer
Description
Isomer-Symbolic
Ingests single or multiple MIDI files (in parallel) from a specified directory and populates a MySQL database with a symbolic model and associated raw MIDI data. While the raw MIDI data remains uninterpreted, it is organized into individual streams (based on MIDI track) containing collections of raw NodeEvents.
DescriptionIsomer-Audio ingests single or multiple audio files (in parallel) from a specific directory and populates a MySQL database with an audio model and associated raw audio data. While the raw audio data remains uninterpreted, it is organized into separate streams depending on the type of preprocessing (e.g. source separation) employed.
Isomer-Audio
SMSMEAPsoftopenBliSSARTSIMMJAFE
Externals
A.R.E. is an acronym defined as: Abstracted Representation Engine. The A.R.E. parses ingested raw symbolic and audio data and populates a MySQL database with abstraction layer data in a cartesian coordinate format. This allows input from various sources to combine in a single representation suitable for further analysis and transformation.
Isomer-A.R.E.
stream
segment
slice
stream
s
time
melodyharmonyrhythmtimbre
melodyharmonyrhythmtimbre
2ms
time
stream
1stre
am
2
pitch pitch IR
IR equity proximity equity
registral return
melody
A.R.E. Data(single point)
pitch pitch IR
IR equity proximity equity
registral return
tension pitches
average chroma
chroma (PCS)
harmony
A.R.E. Data(single point)
pitch pitch IR
IR equity proximity equity
registral return
tension pitches
average chroma
chroma (PCS)
N1 onset N2 onset
offset onset delta (p)
duration delta (p)
rhythm
A.R.E. Data(single point)
pitch pitch IR
IR equity proximity equity
registral return
tension pitches
average chroma
chroma (PCS)
N1 onset N2 onset
offset onset delta (p)
duration delta (p)
RMS spectral stability
spectral flatness MFCC
timbre
A.R.E. Data(single point)
Isomer-Query allows users to retrieve Isomer-generated A.R.E. data (above) and mine that data for musically relevant trends. Displays analyzed A.R.E. data as time points (X-axis) and streams/sub-streams (Y-axis) for a given model and allows on-demand calculation of any/all of the following data for any grid coordinates or range of coordinates:
Isomer-Query
harmonymelody rhythmtimbre
Registral DirectionRegistral ReturnProximity RatioInterval RangeMelodic Accent
Tension DirectionTension InstabilityAverage Tension
Temporal DirectionTemporal Instability
IOI RangeNPVI IOI
NPVI DurationAgogic Accent
Textural FingerprintDynamic Accent
harmony
melody
rhythm
timbre
PitchPitch IR
IR EquityProximity EquityRegistral Return
Registral DirectionRegistral ReturnProximity RatioInterval RangeMelodic Accent
Event Properties
Event Trends
TensionPitch Collection
Average ChromaChroma (12)
Tension DirectionTension InstabilityAverage Tension
Event Properties
Event TrendsN1 OnsetN2 Onset
OffsetOnset Delta (p)
Duration Delta (p)
Event Properties
Temporal DirectionTemporal Instability
IOI RangeNPVI IOI
NPVI DurationAgogic Accent
Event Trends
RMSSpectral StabilitySpectral Flatness
MFCC (13)
Event Properties
Textural FingerprintDynamic Accent
Event Trends