swift - Realtime Audio with AVAudioEngine in iOS 8 -



swift - Realtime Audio with AVAudioEngine in iOS 8 -

hej. want implement realtime sound application new avaudioengine in swift. has experience new framework? how real time applications work?

my first thought store (processed) input info avaudiopcmbuffer object , allow play avaudioplayernode can see in demo class:

import avfoundation class audioio { var audioengine: avaudioengine var audioinputnode : avaudioinputnode var audioplayernode: avaudioplayernode var audiomixernode: avaudiomixernode var audiobuffer: avaudiopcmbuffer init(){ audioengine = avaudioengine() audioplayernode = avaudioplayernode() audiomixernode = audioengine.mainmixernode allow framelength = uint32(256) audiobuffer = avaudiopcmbuffer(pcmformat: audioplayernode.outputformatforbus(0), framecapacity: framelength) audiobuffer.framelength = framelength audioinputnode = audioengine.inputnode audioinputnode.installtaponbus(0, buffersize:framelength, format: audioinputnode.outputformatforbus(0), block: {(buffer, time) in allow channels = unsafearray(start: buffer.floatchanneldata, length: int(buffer.format.channelcount)) allow floats = unsafearray(start: channels[0], length: int(buffer.framelength)) var = 0; < int(self.audiobuffer.framelength); i+=int(self.audiomixernode.outputformatforbus(0).channelcount) { // doing real time stuff self.audiobuffer.floatchanneldata.memory[i] = floats[i]; } }) // setup sound engine audioengine.attachnode(audioplayernode) audioengine.connect(audioplayernode, to: audiomixernode, format: audioplayernode.outputformatforbus(0)) audioengine.startandreturnerror(nil) // play player , buffer audioplayernode.play() audioplayernode.schedulebuffer(audiobuffer, attime: nil, options: .loops, completionhandler: nil) } }

but far away real time , not efficient. ideas or experiences? , not matter, if prefer objective-c or swift, grateful notes, remarks, comments, solutions, etc.

i've been experimenting avaudioengine in both objective-c , swift. in objective-c version of engine, sound processing done purely in c (by caching raw c sample pointers available through avaudiopcmbuffer, , operating on info c code). performance impressive. out of curiosity, ported engine swift. tasks playing sound file linearly, or generating tones via fm synthesis, performance quite good, arrays involved (e.g. granular synthesis, sections of sound played , manipulated in non-linear fashion), there important performance hit. best optimization, cpu usage 30-40% greater objective-c/c version. i'm new swift, perhaps there other optimizations of ignorant, far can tell, c/c++ still best selection realtime audio. @ amazing sound engine. i'm considering this, direct utilize of older c api.

if need process live audio, avaudioengine may not you. see reply question: i want phone call 20 times per sec installtaponbus:buffersize:format:block:

swift ios8 avfoundation core-audio avaudioengine

Comments

Post a Comment

Popular posts from this blog

ruby on rails - Devise Logout Error in RoR -

ruby on rails - Devise Logout Error in RoR - while using devise in ror, encountering unusual error when trying log out url different root url. displays me : actioncontroller::invalidauthenticitytoken in devise::sessionscontroller#destroy" for illustration if rooting path after log in '/structure', , seek log out '/general' error, while logging out '/structure' fine. any help highly appreciated. ruby-on-rails ruby devise
Read more

c# - Create a Notification Object (Email or Page) At Run Time -- Dependency Injection or Factory -

c# - Create a Notification Object (Email or Page) At Run Time -- Dependency Injection or Factory - i have code emails me notification when happens. trying add together page , also remove dependency on email. for reference; have name of notification want send stored string in database. @ runtime have list of people , string representation of want receive. i thought dependency injection ninject, kernel bindings got big , seemed hacking together. then thought simple factory, activator.createinstance(email/page) inotifcation, don't know how handle differing constructor parameters (unless utilize common, complex property, employee, has info need). so far have this: public interface inotification { void sendmessage(); } public class email: inotification { private readonly string _toemailaddress; private string body { { homecoming "email"; } } private static string smtphost { ...
Read more

model view controller - MVC Rails Planning -

model view controller - MVC Rails Planning - i'm starting rails , i'm building app stores films info, user can watch film , give grade on web application. i have coded cinema model, controller , views. now, have 2 questions: should need create model , controller grading? in case, should create or should wait , create first users model , controller? yes, on model , controller grades. that'd feasible way maintain track of who's graded what. it's create first, i'd start users, since grades depend on both films , users. ruby-on-rails model-view-controller
Read more