@thearcanecomposer @morix Have you looked for a second-hand iPod Touch? (With dock connector/USB cable). Alternatively go old and get a classic iPod and replace the firmware with Rockbox?

(To be clear: recommending because of the hardware design, not the proprietory OS vendor behind it.)