You’ve gotta be kidding. Make music on those things you see kids playing games on? Heck yeah. Game systems are better suited to music tasks than you might think. Putting a 3D game in your pocket requires some serious computing horsepower, and pocket game systems have to crunch big numbers while conserving battery life and reducing heat. They need tight controls, split-second response, and rugged reliability. Sure, the headphone jack output on these game systems isn’t exactly pro-quality, but recent improvements make the systems sound surprisingly good, even if retro 8-bit beats aren’t your style. Because they have to keep up with the demands of games, they can exceed the battery and processing power of devices like the iPhone or Palm – and unlike with those devices, you don’t have to worry about an AT&T contract or someone calling while you’re making music.
A great place to start: the Nintendo DS and Sony PSP. These machines can match the price of a bare-bones drum machine, while packing capabilities a mid-range computer might have envied not so long ago. They can fill out your existing studio of music tools with new glitchy soundmakers and synths or wireless touch MIDI controllers. Or they can help you escape the tyranny of your computer screen. The person in front of you in coach class just reclined their seat, and you can’t unfold your laptop? PSP to the rescue.
In fact, game systems are so good at music production that an entire underground community snaps them up for the purpose. Some don’t even run a single game — they’re too busy having fun with the music apps. An entire scene has arisen around 8-bit music, pioneered by applications like Nanoloop and Little Sound DJ for the Game Boy. Since that has gotten more attention than currentgeneration systems, though, and because it emphasizes a certain (though appealing) 8-bit sound, I’ll focus on the newer systems here.
There’s just one catch. Game system makers have tight restrictions on software development. Only one major recent developer has built an authorized music app, the Korg DS-10 for the Nintendo DS. The DS-10 (shown at right) is much easier to run as a result — though there are drawbacks, too, as the DS-10 can’t load custom samples or easily save project files as audio. The rest of these software titles require you to hack your system to get around barriers intended to prevent game piracy. That’s the bad news. The good news is, the richness of available software could make it worth it.
So, what kind of software developers make the software that runs on hacked game systems? In general, developing software for the big computer platforms is easy. Many basic developer tools are available free, and anyone who wants to develop and distribute software can. Game consoles are different. Traditionally, game console manufacturers have had strict requirements for authorizing developers, giving them tighter control over the software that ships on their systems. It’s simply not practical for most developers writing music software for mobile game systems to publish via authorized channels. (I spoke to at least a couple of Sony PSP developers who did try to become authorized; Sony turned them down.) Theoretically, this should control quality, although many homebrew apps, as labors of love, are extremely stable.
That sounds like an easy problem to solve — developers of oddball music apps could just release unauthorized apps, right? Given the niche appeal of such software, Sony and Nintendo probably wouldn’t object. But then the issue is how to run that software. The Sony PSP and Nintendo DS each run games from proprietary media, and creating PSP Universal Media Discs or DS cartridges is impossible for an independent developer. Flash memory could work, but the Nintendo DS doesn’t have a memory card slot, and the Sony PSP has specific anti-piracy protections that prevent running software from its MemoryStick without specially- signed digital files.
That leaves homebrew developers with only one choice: Hack the system so it will run unauthorized apps, and on the DS, add the missing flash memory using special hardware. See “How to Hack” on pages 35 and 37 for more info. Now, on to the apps!
The apps: Nintendo DS
The DS is the less powerful of the two current-generation mobile game systems, but it’s a huge leap over the Game Boys of old. And while it lacks the Sony’s floating point processing power, it has earned popularity for its stylus and touch interface and dual screens — each of which is put to good use in the following music apps.
XSeed Games Korg DS-10
$30, www.korgDSIOsynthesizer.com
What it is: This is no homebrew. Developed with Korg and brought the to USA by XSeed Games, the DS-10 redefines what is usually meant by “game.” As a soundmaker, the DS-10 is on par with many soft synth plug-ins, and there’s no attempt to hide the workings of LFOs and Control Voltage — this is a cartridge for real synth lovers. The design is loosely inspired by Korg’s classic monophonic MS-10, and accordingly, the DS-10 is a subtractive synth with basic patching for customizing sounds. The DS-10 does a number of things the MS-10 couldn’t, though. It has two dual-oscillator synths you can patch, plus four drum parts. There are onboard effects (delay, chorus, flanger), a mixer, and even a basic 16- step sequencer. Korg contributed to the onboard sounds, and while the fidelity isn’t what you’d get from a high-end software or hardware synth, the results are sonically charming and endlessly fun — and just might give you a boatload of loops to record into a tool like Ableton Live later on.
How you can use it musically: Using your stylus, you can tap notes, sequence parts, and trigger whole patterns, arranging songs or even setting up to play the unit live. The DS-10 is limited to audio output; you can save projects in memory slots, but you can’t export audio or connect to a computer. But with four drum parts and two synths, you can make simple patterns, then record them on another device to use as loops. There are also arrangement options, so you could play with the DS-10 itself. If you can convince a friend to buy a DS-10 cartridge, you can exchange sounds and sync units wirelessly.
Dreaming of a wireless MIDI controller, with a stylus? Here you go.
DS MIDI Interface
Free, dsmidiwifi.tobw.net
What it is:The DS has appeal as a controller: dual displays, a precise styluscontrolled touch interface, and ergonomically-positioned, solid game-style buttons. And it’s interesting as a sound source, too, with a selection of homebrew synths. The challenge: get data to and from the device. The easiest way to do this is via the WiFi connection. Download a server app for Mac, Windows, or Linux, and a variety of DSMI-enabled homebrew software can communicate with your computer. If you’re really adventurous, you can hack standard MIDI jacks into your DS — just be prepared to crack open the case and be handy with a soldering iron. (The WiFi connection, therefore, is much simpler.)
How you can use it musically: Don’t expect rock-solid timing, but even the WiFi connection works, especially for continuous controls like converting your DS into an X/Y touchpad. You’ll find homebrew apps that use DSMI for sync, and others that let you sequence onboard synths from your computer. The DSMI website also includes sample applications, including keyboards and pads, and designs inspired by the Korg KAOSS Pad and Monome controller.
Do you long for the days of tracking-style composition, as opposed to sequencing? Look no farther.
NitroTracker
Free, nitrotracker.tobw.net
What it is:This is no toy; NitroTracker is a full-blown music creation tool in the mold of a generation of music editors called “trackers.” Sequencers as we know them today, with piano roll editors and multitrack views, were once just one of a number of approaches to music editing on computers. “Trackers” organize music on steps on a timeline, and loyalists to the approach swear by the step-by-step control the design affords. NitroTracker can play back multi-sampled drum kits and instrument sounds and fine-tune detailed patterns using them, with loop editing, drawable volume envelopes, and mixing.
How you can use it musically:With a streamlined design and stylus control, NitroTracker is a friendly entry into the world of trackers even for those who’ve never tried one before. It can save to WAV files, so you can work out a detailed pattern or musical idea and export it to your sequencer of choice. If you’d rather stay away from your computer, you can even finish entire sequenced songs on the DS. DSMI support means you can send and receive MIDI notes and sync via your WiFi connection. If you’re looking for samples, the NitroTracker site has plenty of downloads, including some vintage Nintendo game sounds if you’re feeling nostalgic for 8-bit Game Boy and NES tunes.
Remember “Life”? No, not yours before you got addicted to gear. The cell-division game. GlitchDS does that . . . to audio.
GlitchDS, RepeaterDS
Free, www.glitchds.com
What it is:GlitchDS is a tool for culturing and evolving glitchy audio loops as though they were microscopic bacteria. Applying a model called a cellular automaton — known in this implementation as the “Game of Life,” a simplified digital model of how cells mutate — your loops will morph and transform rather than play endlessly the same way. Along the same lines, RepeaterDS from the same creator is a simple sample looper controlled by the stylus.
How you can use it musically:Think of these as laboratories for unusual-sounding loops. GlitchDS is especially packed with features, including custom “trigger points” for modifying loops, distortion, and a 32- step frequency modulation sequencer. (Yes, you read that right: it’s frequency modulation sequencing, so expect some unusual results.) And even if you don’t entirely understand what you’re doing, you’re bound to get some interesting sounds. As with NitroTracker, you’ll find a variety of samples to download for each to get you started.
This is a TB-ish step sequencer . . . on steroids.
The apps: Sony PSP
Sony’s PSP has been upstaged in the market by the Nintendo DS, but as a pocket computer, the PSP is formidable, making it ideal for music synthesis. If you associate game music with 8-bit and lo-fi, digital sound, the PSP could change your mind. Programmers say the onboard Floating Point calculation hardware makes programming DSP easier — that’s something the DS, Apple’s iPhone, and the Linuxbased GP2X game system don’t have. The powerful CPU Sony packed in helps, as well. The result: rich-sounding synths and timestretch algorithms, some easily rivaling what you’d find on a computer.
Free, psprhythm.com
What it is: PSP Rhythm is a sequencer for rhythmic and melodic patterns with built-in sound chopping, pitch-shifting, timestretching, and effects, packed into an interface that looks a bit like the love child of Fruity Loops (FL Studio) and a Roland TB-303. What sets it apart is the detail of its features and the quality of its audio engine. It can act as a basic wavetable synth or a powerful sample slicer. Thanks to the power of the PSP, you can load a fair number of effects, and with 999 steps, sequence a fairly complex song. The software also gets extremely frequent updates, though recently the team has turned some attention to developing BtBx for the iPhone. (That’s further evidence that Sony, starved for titles on its PSP, ought to open its online store to homebrew developers.) Its hardware-style, skinnable interface is arguably one of the most friendly of any of the mobile apps.
How you can use it musically: If you want to crank out some sophisticatedsounding loops quickly, PSP Rhythm could easily be your best choice. Complete with high-fidelity audio sample slicing and bassline and wavetable synths, PSP Rhythm not only squashes the capabilities of most other mobile apps, but can compete with a lot of pricier hardware. The one thing that’s missing, of course, is audio input and anything beyond a headphone jack for output, but you can easily export patterns or songs to a Memory Stick and move them to your computer.
PSPSEQ looks geeky, and it is. But the musical power behind this puppy is astonishing by any measure.
PSPSEQ
Free, www.dspmusic.org/psp
What it is:Behind a retro, minimal interface, PSPSEQ hides what is likely the most powerful application built for any mobile device. The key to PSPSEQ is its synthesis capabilities. In addition to the usual virtual analog synthesis, developer Ethan Bordeaux has added FM synthesis, Karplus-Strong physical modeling string synthesis, and even some digital idiosyncrasies of his own. (Ever tried “rotational synthesis”?) All of these sounds can be modulated in fine detail using the step sequencer.
How you can use it musically:PSPSEQ’s creator says he believes in the software being a self-contained music creation environment, and it shows: Assuming your bread and butter is carefully-composed synthesized sound, PSPSEQ is a wonderland. Audio export is still there, though, if you’d like to move files to another environment. Composing sequences using just the game controls on a PSP may sound unforgiving, and the learning curve can indeed be a bit tricky at first. But because PSPSEQ is packed with shortcuts, many sound design effects that would be time-consuming to sequence elsewhere can be achieved quickly, and new updates add new shortcuts and workflow improvements. With 100 loops per song and 1,000 measures, you’re unlikely to have to repeat yourself if you don’t want to. It’s not an environment for everyone, but if you’re willing to immerse yourself in PSPSEQ, you can create sonic materials that no one would guess came from a $200 game machine.
How to Hack: Nintendo DS
The hack – hardware: Nintendo owners need a way of loading games on the device by adding flash memory, and a way of circumventing Nintendo’s encryption. A single cartridge called a “flash loader” or “pass-through” accomplishes both tasks in hardware, without touching the DS software. The most recent and popular of these devices look just like standard Nintendo cartridges, but with a small slot at the top for MicroSD memory cards.
How to get it: You’ll need to mail-order the special hardware. Your best bet is to start with the homebrew music software you want to run and work backwards. Most of the hardware is very similar, though subtle differences can introduce compatibility issues. Some of the most popular solutions are cards like the R4DS, M3, and SuperCard. A recent patching solution called DLDI helps make saving easier and smooths over some compatibility issues.
Using the hack for music: Passthrough cards have gotten increasingly easy to use. Drop homebrew files with the “.nds” extension onto a MicroSD card, pop the card into the special cartridge, boot, and play. A number of the homebrew music apps also include sample sets and will describe how to install these. Some (GlitchDS and RepeaterDS) use the RAW file for samples, but free RAW converters are available on Mac, Windows, and Linux.
How Nintendo is fighting back: Nintendo is trying to block manufacture and distribution of the hacking hardware. For now, though, that seems to be having little impact, partly because there are so many variants of the hardware. At least on all DS systems made so far, homebrew development and operation remains very possible, at least until Nintendo decides to make a new game machine that eliminates the vulnerability.
Is it ethical? As with Sony, Nintendo considers this hardware to violate their intellectual property. Mostly, they’re concerned about whether or not you pirate their games, meaning you can decide to support developers and pay for the software you use. (Nintendo has even highlighted the work of 8-bit musicians through official outlets and sponsorship; as you’d expect, someone running an unauthorized music app isn’t a concern, whereas someone stealing Legend of Zelda is.) Unlike with the PSP hacks, you don’t have to modify firmware running on your system, so once you remove the special cartridge, you’re left with a stock Nintendo system.
How to Hack: Sony PSP
The hack – alternative firmware: Alternative firmware works just like the standard PSP firmware, but maximizes the use of the processor and allows software to run from a Memory Stick. The Memory Stick itself is also modified so that apps are recognized and available from the standard PSP menus.
How to get it: Unless you have a very early PSP, you actually can’t hack your PSP without another PSP that’s already been hacked. This restriction is surprisingly easy to work around, however. Used PSPs on services like Craigs’ List are often available pre-hacked. You can also check PSP homebrew forums or Craigs’ List to find people who will modify your system, usually for free or up to $25. You can also perform the operation yourself if you mail order the Datel Battery Tool, a specialized battery that allows you to modify the firmware on an unhacked PSP.
Using the hack for music: Once you’ve hacked your PSP, the rest is pretty easy. To access the MemoryStick on your computer, either connect your PSP with a USB cable and put it into storage mode, or take the MemoryStick out of your PSP and access it with a flash memory reader. Drop the files you want on the MemoryStick in “PSP/GAME” or “PSP/GAME150” directories. (In some cases, the homebrew-loading eLoader software may also be required.) Check the documentation and forum at PSPSEQ and PSP Rhythm for more specifics. But once the games are installed, running them is simple. You’ll find them under Game > Memory Stick.
How Sony is fighting back: Sony regularly releases firmware updates, though as long as you don’t install them, it makes little difference, and hackers have generally been keeping pace with Sony’s new firmware. The new line of attack: change the hardware. Sony has discontinued batteries that hackers use to exploit the system, and the PSP-3000 “PSP Bright” revision is designed not to be hacked. While hackers are likely to try to find a way to hack even the PSP-3000, your best bet is to get an older system, either the “fat” PSP-1000 or “slim” PSP-2000.
Is it ethical? There’s no question you’re voiding your warranty and violating Sony’s license by hacking your system, but whether you do so in a way that supports developers is up to you. Many in the PSP homebrew and hacker community actively discourage piracy and purchase games. You can still run commercially-purchased game discs on a hacked system (though not games purchased from Sony’s online store).
Where to learn more
createdigitalmusic.com/tag/mobile
Create Digital Music regularly covers mobile devices, and the overlap between gaming and music (try also tag/DS and tag/PSP for specific systems).
palmsounds.com
Palm Sounds is a blog devoted to music on mobile devices; there’s a strong emphasis on PDA/smartphone platforms, but with a fair bit of game system news, as well.
www.tobw.net/dswiki
From the author of DSMI and NitroTracker, this Wiki covers everything you need to know to develop and run homebrew software – it’s particularly useful for navigating the maze of hardware for hacking the system.