The CSIRAC, Australia's first digital computer, played music in 1950-1951 using a speaker and raw pulses, marking a groundbreaking achievement. Geoff Hill, with his musical background, programmed it to play tunes, showcasing early computer music capabilities.