SDL

SDL is a wonderful library designed to give simple and direct access to input devices and output graphics and sound. It's available on many many operating systems.

http://www.libsdl.org/

to use with aalib do:

export SDL_VIDEODRIVER=aalib