How to pass Audio from Microphone to Google Speech To Text?

[goxr3plus]

I can't find any example for this functionality on the repository :

https://github.com/GoogleCloudPlatform/google-cloud-java/tree/master/google-cloud-clients/google-cloud-speech

Is it supported at all ?

[yihanzhen]

Hi @goxr3plus ,
Can you provide more context? What is the major difference here between audio from microphone and audio produced otherwise?
If you are looking for a streaming call, Speech can take StreamingRecognizeRequest. More information about streaming calls can be found here.

[goxr3plus]

Thanks for replying :) . I need to stream audio from computer microphones . I am doing it with another library which supports only Google Cloud Speech Private , though i can't find out how to with your official library in Java .

https://github.com/goxr3plus/java-google-speech-api

[yihanzhen]

I am not aware of the private repo for speech as you mentioned, would you mind sharing it? Although I do believe under most circumstances features in a private repo are usually under development and should become public in the future.

[goxr3plus]

@hzyi-google What i need is plug-in the microphone to the computer and 10 lines of Java code to get the audio from Microphone and do Speech Recognition with google-cloud-java library ?

How can i do that in Java Code ? I know how to capture audio from the Microphone .

How can i call StreamingRecognizeRequest with your current Java Library , can we have an example please ?? :)

[goxr3plus]

This is the repository i am talking about : https://github.com/goxr3plus/java-google-speech-api

[goxr3plus]

I don't need to recognize audio from .flac files etc .... just raw data from Microphone how i can do it ?

 try (SpeechClient speechClient = SpeechClient.create()) {
   RecognitionConfig.AudioEncoding encoding = RecognitionConfig.AudioEncoding.FLAC;
   int sampleRateHertz = 44100;
   String languageCode = "en-US";
   RecognitionConfig config = RecognitionConfig.newBuilder()
     .setEncoding(encoding)
     .setSampleRateHertz(sampleRateHertz)
     .setLanguageCode(languageCode)
     .build();
   String uri = "gs://bucket_name/file_name.flac";
   RecognitionAudio audio = RecognitionAudio.newBuilder()
     .setUri(uri)
     .build();
   RecognizeResponse response = speechClient.recognize(config, audio);
 }

[yihanzhen]

If your question is how to capture audio from outside the computer using java, this might be what you want to refer to.

[goxr3plus]

Thank you, but my question is let's say i capture the audio from the Microphone, how to pass the Audio to the Google Text To Speech Library so it returns text, in real time. I need to do Real Time Speech Recognitom from 🎤 microphone using your library how i can do it?

…

On Fri, Jun 22, 2018, 01:57 Hanzhen Yi ***@***.***> wrote: If your question is how to capture audio from outside the computer using java, this <https://docs.oracle.com/javase/tutorial/sound/capturing.html> might be what you want to refer to. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#3188 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ATbiwCcbmHUtdxJ8-UwF3q-jL3qaxsVKks5t_CTtgaJpZM4Th3mo> .

[goxr3plus]

@hzyi-google My dear friend i am waiting an answer on this , it is very important :) .

[yihanzhen]

Here comes the answer my dear friend :-) Sorry I was quite busy in the past few days.

Suppose your microphone has an interface similar to Iterable:

interface Microphone {
	
  boolean hasNext();
  Audio next();

}

Then you could use splitCall in BidiStreamingCallable this way:

try (SpeechClient client = SpeechClient.create()) {

  ResponseObserver<StreamingRecognizeResponse> responseObserver =
      new ResponseObserver<StreamingRecognizeResponse>() {
    
    public void onStart(StreamController controller) {
      // do nothing
    }

    public void onResponse(StreamingRecognizeResponse response) {
      // do something with the response
    }

    public void onComplete() {
      // do something to close up
    }

    public void onError() {
      // do something to handle errors
    }
  }

  ClientStream<StreamingRecognizeRequest, StreamingRecognizeResponse> clientStream =
	    speechClient.streamingRecognizeCallable().splitCall(responseObserver);
  
  StreamingRecognitionConfig config = StreamingRecognitionConfig.newBuilder()
    ... // set up config
    .build();

  StreamingRecognizeRequest configRequest = StreamingRecognizeRequest.newBuilder()
    .setStreamingConfig(configRequest)
    .build();  // The first request in a streaming call has to be a config

  clientStream.send(configRequest);
  
  while (microphone.hasNext()) {
    StreamingRecognizeRequest request = 
        createRecognizeRequestFromMicrophone(microphone.next()); // create streaming requests
    clientStream.send(request);
  }
}

Is this what you want?

[goxr3plus]

I have followed all the links , trying to figure out the code you send me . I wrote a small code to show you what i need . Can you please make it a runnable example with the above code you gave me ... not assuming methods that doesn't exist , a runnable example please . I will add credentials , no problem for that ( access tokens etc).

package googleSpeech;

import javax.sound.sampled.AudioFormat;
import javax.sound.sampled.AudioInputStream;
import javax.sound.sampled.AudioSystem;
import javax.sound.sampled.DataLine;
import javax.sound.sampled.TargetDataLine;

public class GoogleSpeechTest {
	
	public GoogleSpeechTest() {
		
		//Target data line
		TargetDataLine line ;
		
			
		//Capture Microphone Audio Data
		try {
			
			// Signed PCM AudioFormat with 16kHz, 16 bit sample size, mono
			int sampleRate = 16000;
			AudioFormat format = new AudioFormat(sampleRate, 16, 1, true, false);
			DataLine.Info info = new DataLine.Info(TargetDataLine.class, format);
			
			//Check if Microphone is Supported
			if (!AudioSystem.isLineSupported(info)) {
				System.out.println("Line not supported");
				System.exit(0);
			}
			
			//Get the target data line
			line= (TargetDataLine) AudioSystem.getLine(info);
			line.open(format);
			line.start();
			
			//Audio Input Stream
			AudioInputStream audio = new AudioInputStream(line);
			
			
			
		} catch (Exception ex) {
			ex.printStackTrace();
		}
		
		
		// ------------------------ WHAT I NEED -----------------------------
		
		//Send audio from Microphone to Google Servers and return Text
	
		//TAKE THE AUDIO FROM THE AudioInputStream , send to Google on the fly and return text
	}
	
	public static void main(String[] args) {
		new GoogleSpeechTest();
	}
	
}