Relating Superhuman Virtuosity to Human Performance ?· Relating Superhuman Virtuosity to Human Performance…
Post on 30-Aug-2018
Relating Superhuman Virtuosity to Human Performance
An exciting field of compositional endeavour is outlined in this paper. We focus upon transitions from humanto beyond human performance ability founded in psychoacoustic measurement data. The challenge is to makesuch changes perceptually smooth and acoustically plausible. The point of greatest ambiguity and hencecompositional tension is around the limits of what is humanly possible. Virtuosity contextualised accuratelyagainst human ability is much harder to design than bare feats of bravura. For convincing illusion anextrapolation of human performance characteristics to impossible tempi is necessary. This is by no meanstrivial given the context sensitivity of expressive deviations reported in performance research literature. This compositional agenda is intimately linked to advances in computer music, through research into soundsynthesis and the synthesis of human performance. Historical precedents in work of Nancarrow, Jaffe andothers is highlighted.
Key-Words :- human performance, transhuman skill, limits of performance, computer music composition
You have finally obtained the latest recording ofacclaimed concert virtuoso Reilly A. Komputer.Music spreads over your expensive Ambidolbicssystem, evoking the best seat of the ViennaMusikvereinsaal. Reilly plays a wonderfully warmpiece, very comfortable to the ear, what exquisitepoise and feeling! You smile as the tempo iscranked up; this great virtuoso just couldn't staycalm for long. Gradually the accelerando istransforming the music to a moto perpetuo of rage.The notes are flying, fiery, flamboyant. You realisewith a start that the speeds have alreadytranscended the humanly possible. This scenario is accessible with currenttechnology given the use of a automated piano likea Disklavier. If Reilly was a violinist, such anillusion would likely require advanced soundsynthesis. Developments in physical modellingcould make such a composition renderable even fora string quartet or for an orchestral composition.Underlying all such work is the study of humanperformance, gaining data that can be extrapolatedto inhuman tempi and densities of music whilststaying in touch with the human element. This paper examines some background andapproaches to the 'modulation of ability' illusion.We speak notionally of skill, yet our investigationscan be widened to all sorts of human relatedparameters as targets for compositional study. Wemight wish to model the fatigue, the confidence,the proprioceptive sensations of the performer. Wemust also distinguish a particular focus of thispaper, shifting rates of play whilst preserving
sensible values in other qualities like expression,from the case where one moves from the human tothe inhuman directly by also dropping allexpressive deviations. All of the parameter spacessuggested by psychoacoustic data and models areup for grabs! One composer might aim to movefrom human to beyond human fatigue endurance,always maintaining a human tempo level. His rivalcould investigate the opposite, of human fatigueresources feeding inhuman tempi. Complex models adopted from psychology andphysiology will be multidimensional andparameters will show dependences. As composers,we may choose to hold some whilst modulatingothers. Human performance will no doubt takedevious paths through the theoretical parameterspaces, paths we may match or pervert. There is noclaim that movement cannot be discrete:continuous change in parameters may be useful forsetting up illusions and ambiguities, but abruptchange has also proved a worthy formal device. Previous effort in beyond human performance hasachieved much working by intuition. This is asaving grace, for whatever models from thepsychology of music a composer might attempt toingest into his work, his experience as a humanbeing would automatically allow (perhaps a morelaborious, but still effective) adjustment of musicalparameters to his ear. The assumptions of this paper are such that weassume a sound quality comparable to acousticperformance for computer rendered music. Humanperformance informed data can still be usefuloutside such a scope, but the sense of illusion andtension at the edge of the superhuman will rest
upon an equivalent auditory experience to thetraditional concert. This paper will detail some sources ofinformation for the composer of transhumanillusions in performance and synthesis research,some existing works in this category, and speculateabout achievements to come.
2 The Limits of Human Performance
The trend of composers challenging performersseems a constant of musical history . Look atBeethoven and Schuppanzigh or the virtuosoculture within which Liszt flourished. One only hasto glimpse the dense notations of a new complexitycomposer like Ferneyhough to see how rigourouslythe demands in motor skill and concentration canbe set forth for modern performers. Performerscatch up: if in mid life, Nancarrow wascomplaining 'As long as I've been writing musicI've been dreaming of getting rid of the performers' yet by the time of his late fame he wasaccepting commissions from exceptionalinstrumentalists like the Arditti Quartet. With a wealth of composers probing everyinstrument on the planet, a wealth of performersspending their lives in pursuit of mastery, a wealthof engineering effort that has stabilised manytraditional instruments, has the cult of difficultyreached its limit? We must already be deep indiminishing returns? There is a similar controversythat arises amongst sports psychologists everyOlympics. Will humans go on breaking worldrecords? The issues take in drugs, genetics,technological improvement and the greater pool ofpotential competitors. Some predict near stasis nowfor most sports, others quote that a linear trend ofimprovement is still implied for decades to come. Given the uncertainty over future athleticperformance, let us not make the mistake ofpredicting the asymptotic limits of humanmusicians just yet. However, it is clear that thereare levels of virtuosity that will remain outsidehuman manipulation. Even Boulez could not writea pointillistic piano sonata that utterly disregardsthe time to move the hand from one location toanother within the realm of physics. It is taken as proven that there is room betweenultimate human ability and human auditorycapabilities- the Nancarrow Studies for PlayerPiano will do as the proof. No human will ever playRhythm Study 3a, but one can certainly hear it andappreciate the distinct note streams.
Table 1 gathers estimates of the limits of humandigital dexterity (mostly from the viewpoint ofpianism), with some comparable figures. Wherepiano works are the target, they have been selectedfor a scale like toccata character, one note at a time,requiring a sustained speed over a number ofmeasures. Ten fingered arpeggiation between handsin fixed position, glissando and chord onsetasynchrony would offer faster mechanisms forplaying, but are sidestepped in favour of the motoperpetuo etude.
Work Speed HertzBrandenburg no 5, 1st mvtharpsichord cadenza
Chopin Etude Op 10 No 4 Presto. SQ atminim= 88 per min.
Chopin Etude Op 25 No 11 Allegro con briotriplet SQ atminim= 69
Prokofiev, first pianoconcerto first cadenza
quintuplet SQ atminim= 88
Nancarrow Study No3a SQ at minim= 120 16Ligeti Etude No 10 (Bk 2)(performance instruction-at the limit of continuum)
triplets at 240 bpm 12
scales played by thisauthor, realistic limit
demisemi at 112bpm
'Typing world record' 37,500 key strokesover 50 minutes
'Typing speed record'-Stella Pajunas
216 words perminute- assume anaverage of fourcharacters per word
piano trills  12-14 notes persecond
Toronto ConservatoryPiano Syllabus 1986(quoted in )
scales required at500 notes perminute for level 12
Nancarrow timbral gliss,study 25 [12 pp 243]
175 notes in onesecond
drum and bass semiquavers at 180bpm=720 bpm
author - presto possible-one hand using quintuplets
120 bpm DSQquintuplet
author- presto possible-using two hands inalternation
160 bpm DSQquintuplet
Table 1- Estimated limits of finger repetitionrates
All the human performances approximate thedomain of haptic rates (below 20Hz). The limitedevidence here does seem to suggest a peak ofvirtuosity for around 15 Hz for controlled scalefigures in keeping with the toccata style.
3 Human Performance andPsychoacoustic Studies
There are a wealth of scientific studies thecomposer can turn to.  is a good starting pointfor current psychoacoustic research. For Ligeti'spoint of continuum, 20-60 milliseconds is oftengiven for the minimum separation to differentiatemusical sound events. The average listener wouldbe able to hear a constant stream of onsets at atempo from 1000- 3000 bpm. If our estimation of amaximum sustainable speed was that of constantdemisemiquavers at 120 bpm, the performer cannotbreak the 1000 bpm event horizon! More likelytimbre, overlap and especially reverberation givecontinuum, not human finger racing. If a performer grows tired maintaining thedemanding tempi near continuum, an acceleratingperformer will be more and more constricted bywhat has been called Fitt's law , that the timedelay between productions must be proportional tothe distance traversed and inversely proportional tothe target area. This is critical not just to triggeringevents, but also in terms of the precision of pitch,dynamic and timbre. The design of the instrumentis tangled up in this. The composer will observethat these problems of instrumental layout,performer fatigue and ultimately the human formitself, can be disregarded when a virtual instrumentis involved, and are exactly the qualities we wouldbring back into our computer models in designingtranshuman performance that correlates to humanactivity. That our tradition of music has performancescarry expressive deviations in note length, in pitch,in attack and any other parameter a performer canwring from their instrument to convey theirpassions, is a central area of study in thepsychology of music [5, 11]. , whose subjectsincluded Boulez, demonstrates how much humanbeings tend to deviate from strict time values- 'infive initial experiments we found thatoursubjects exhibited systematic and substantialerrors'. Such empirical investigation into expressiveperformance allows the application of data andmodels to synthesis. As alluded to earlier, changing a global parameterlike tempo cannot be done independently ofassociated context sensitive variables like degree ofexpressive variation, itself tied to the parsing ofmusical structure. These issues are broached withverve in . The restrictions of instruments themselves are ofcompositional interest. We can detach the strictures
of fingering from physical models of theinstrument. Inspiring studies for the composer maybe found in [13, 21, 24] Studies of skill acquisition, motor skills andhuman performance provide good reading, thoughmost are biased towards athletics. Composers mayfind a dearth of specific information on musicaltopics, but would certainly be able to obtaininteresting introductions to fatigue, concentrationor training [8, 17, 25].
Nancarrow's painstaking work with player pianos isthe forebear of all future work in this field. Heexplores complex tempo ratios rigidly in his moreabstract studies, but also recreates performanceliberties. As an analyst notes, 'the player piano hasalways been for Nancarrow an opportunity toachieve rhythmic deviations Western notation doesnot easily acknowledge' . For tightmathematical forms mechanical precision isrequisite, but 'the late unmetered Studies 41, 45 and48 approach a chaotic rhythmic energy close to thatof free improvisation'. Given the many years ofpiano roll punching, the dedication to makeexpressive corrections by hand is apparent. The fact that fast note streams blur intocontinuous texture has been utilised by composersfor some time.  gives a wonderfully pertinentquotation from Ligeti in this regard, the Hungarianmaster discussing Continuum- 'A harpsichord hasan easy touch; it can be played very fast, almostfast enough to reach the level of continuum, but notquite (it takes about eighteen separate sounds persecond to reach the threshold where you can nolonger make out individual notes and the limit setby the mechanism of the harpsichord is aboutfifteen to sixteen notes per second)'. This putsLigeti's estimation of the discrimination of the ear(in the case of a harpsichord sound) at about 50 mS.Whilst the harpsichord cannot continuously pluck asingle string at this rate, it is certainly obtainable byarpeggiation. With his incredible enthusiasm for Nancarrow'swork it is unsurprising that Ligeti has his ownplayer piano works. Most are conversions byJurgen Hocker of extant piano etudes, works thatmight be said to stretch the demands on humanpianists to the limit (once again in musicalhistory). Two quotes from  concern us. Onthe tenth etude involved in table 1, 'the ultra-rapidrepeated notes of which are a test of the piano
mechanism as well as the pianist- Ligeti asks herefor 'almost the speed of Continuum''. On thefourteenth etude, the only work conceivedoriginally for player piano, Toop writes 'It isprecisely the humane and humanist dimensions thatLigeti's studies add to the mechanical intricacies ofhis models that underpin their aesthetic status'.Such human related mechanical virtuosity is atheme in deep resonance with this paper. The overloading of performers, the overstretchingof humans to their limits is a central concern of thenew music movement of complexity, one of whosemost famous exponents is Ferneyhough. Thediscoveries and compositional practises of this fieldcan be invaluable to any composer seeking somebase of knowledge of human performancelimitations.  reprints the introductory notes ofCasandra's Dream Song - 'some of thecombinations of actions specified are in any caseeither not literally realisable (certain dynamicgroupings) or else lead to complex, partlyunpredictable resultssuch divergencies andimpurities as then follow from the naturallimitations of the instrument itself may be taken tobe the intentions of the composer.' Ferneyhough works with human beings so that hemight 'take advantage of these human qualities andlimitations through careful, well-thought-outcompositional strategies'. His understanding ofhuman performance limitations are necessarilyhighly advanced. See the same paper, pg 13 for amarvellous diagram of the care that has gone intothe potential fingering of what looks on the surfacelike a very difficult figure for the violin. We can move beyond instrumental compositionto the possibilities of computer sound synthesis.David Jaffe's Silicon Valley Breakdown [3, 15](amazingly from 1982, very early in thedevelopment of physical modelling!) provides awon...