AI startup Stability AI has teamed up with chipmaker Arm to deliver Stability’s Secure Audio Open, an AI mannequin that may generate audio together with sound results, to cell gadgets working Arm chips.
Whereas quite a few AI-powered apps can generate audio, like Suno and Udio, most depend on cloud processing, that means that they will’t be used offline. Furthermore, some audio technology fashions have been skilled on copyrighted content material — posing an IP threat. Stability claims Secure Audio Open’s coaching set is made up completely of royalty-free audio and songs.
Secure Audio Open working on Arm chips, which will likely be demoed on the Cellular World Congress convention in Barcelona this week, can generate a sound from a textual content description like, “Light ocean waves at sundown.” Stability says that it labored with Arm to optimize and “distill” Secure Audio Open, dashing up technology occasions by 30x. Producing a single 11-second audio pattern takes round 8 seconds on an Armv9 CPU.
To be clear, the optimized Secure Audio Open mannequin isn’t obtainable to obtain — a minimum of not but. However in an announcement, Stability CEO Prem Akkaraju hinted that Stability will work to deliver its fashions, together with Secure Audio Open, to client apps and gadgets sooner or later.
“As increasingly skilled creatives and companies undertake generative AI to energy their manufacturing pipeline, it’s necessary that our fashions and workflows can be found in every single place for builders to construct and creators to create,” Akkaraju stated. “We’re excited to companion with Arm for this precise motive.”
Stability says that it’s collaborating with Arm to additional optimize Secure Audio Open.
Stability, the beleaguered agency behind the favored picture technology mannequin Secure Diffusion, raised new money final yr as buyers together with Eric Schmidt and Napster founder Sean Parker sought to show the enterprise round. Emad Mostaque, Stability’s co-founder and ex-CEO, reportedly mismanaged Stability into monetary wreck, main workers to resign, a partnership with Canva to fall via, and buyers to develop involved concerning the firm’s prospects.
In the previous couple of months, Stability has employed a brand new CEO, appointed Titanic director James Cameron to its board of administrators, and launched a number of new picture technology fashions.