I have created a repo that allows one to use Whisper with a microphone in real time. https://github.com/mallorbc/whisper_mic