Support for audio files

[usmanm]

Similar to dspy.Image, it would be useful to add dspy.Audio. We've started using DSPy recently for our voice AI agent, but lack of support for audio is a blocker for many use-cases.

We're happy to upstream a patch, if we could get a bit of guidance in terms of how to get started.

[okhat]

Thanks so much @usmanm ! This hasn't been a priority so far... I'm not sure it's planned but I'll tag @isaacbmiller to see if he thinks it's worthwhile

[isaacbmiller]

I think it would be really cool! I would wait for #1801 to be merged or patch based off of that branch.

I tried to design it such that other modalities would be not that difficult to implement, but I haven't used the audio api.

[ryanh-ai]

We are also interested in this and would collaborate or test a patch.

Any interest in video from this group?

[usmanm]

Nice, we'll wait for your change to go in @isaacbmiller, and then take a stab at implementing audio file support.

We don't have a need for video, @ryanh-ai. But would be cool to have more folks test out audio support.

[AriMKatz]

also interested in audio