java - byte[] 可以转换成连续的输入流
问题描述
Netty 搭建的项目Websocket Server
Netty Client 发送请求:</p>
File file = new File("D:\\zh-16000-30s.pcm");
FileInputStream fis = new FileInputStream(file);
int length = 0;
int dataSize = 4096;
byte[] bytes = new byte[dataSize];
int status = 0;
// simulator Andorid or IOS push Streaming
while ((length = fis.read(bytes, 0, dataSize)) != -1) {
JSONObject jsonObject = new JSONObject();
jsonObject.put("audio", Base64.getEncoder().encodeToString(Arrays.copyOf(bytes, length)));\\
jsonObject.put("status", status);
WebSocketFrame frame = new TextWebSocketFrame(jsonObject.toJSONString());
ch.writeAndFlush(frame);
status = 1;
}
if(length == -1){
status = 2;
}
if(status == 2){
JSONObject jsonObject = new JSONObject();
jsonObject.put("audio", "");
jsonObject.put("status", status);
WebSocketFrame frame = new TextWebSocketFrame(jsonObject.toJSONString());
ch.writeAndFlush(frame);
}
Netty 服务器处理程序:
protected void channelRead0(ChannelHandlerContext ctx, WebSocketFrame frame) throws Exception {
// ping and pong frames already handled
if (frame instanceof TextWebSocketFrame) {
// Send the uppercase string back.
String request = ((TextWebSocketFrame) frame).text();
JSONObject jsonObject = JSONObject.parseObject(request);
Integer status = jsonObject.getInteger("status");
byte[] recByte = Base64.getDecoder().decode(jsonObject.getString("audio"));
if(status.intValue() == 0){
ctx.channel().attr(AttributeKey.newInstance("login")).getAndSet(recByte);
}else if(status.intValue() == 1){
byte[] a = (byte[]) ctx.channel().attr(AttributeKey.valueOf("login")).get();
byte[] c=new byte[a.length+recByte.length];
System.arraycopy(a, 0, c, 0, a.length);
System.arraycopy(recByte, 0, c, a.length, recByte.length);
ctx.channel().attr(AttributeKey.valueOf("login")).getAndSet(c);
}else if(status.intValue() == 2){
// the end of file or streaming
saveAudio((byte[]) ctx.channel().attr(AttributeKey.valueOf("login")).get());
}
ctx.channel().writeAndFlush(new TextWebSocketFrame(request.toUpperCase(Locale.US)));
} else {
String message = "unsupported frame type: " + frame.getClass().getName();
throw new UnsupportedOperationException(message);
}
}
我想使用Microsoft Speech Streaming Recognition
示例代码片段:</p>
// Creates an instance of a speech config with specified
// subscription key and service region. Replace with your own subscription key
// and service region (e.g., "westus").
SpeechConfig config = SpeechConfig.fromSubscription("YourSubscriptionKey", "YourServiceRegion");
// Create an audio stream from a wav file.
// Replace with your own audio file name.
PullAudioInputStreamCallback callback = new **WavStream**(new FileInputStream("YourAudioFile.wav"));
AudioConfig audioInput = AudioConfig.fromStreamInput(callback);
代码片段2:
private final InputStream stream;
public WavStream(InputStream wavStream) {
try {
this.stream = parseWavHeader(wavStream);
} catch (Exception ex) {
throw new IllegalArgumentException(ex.getMessage());
}
}
@Override
public int read(byte[] dataBuffer) {
long ret = 0;
try {
ret = this.stream.read(dataBuffer, 0, dataBuffer.length);
} catch (Exception ex) {
System.out.println("Read " + ex);
}
return (int)Math.max(0, ret);
}
@Override
public void close() {
try {
this.stream.close();
} catch (IOException ex) {
// ignored
}
}
问题:</p>
如何将 byte[] 转换为 inputStream 连续。
例如:
我说 30s 的声音,假设 1s 等于 netty 服务器接收一次包
netty服务器发送1s包到微软语音识别
微软语音服务器返回中间结果
netty客户端发送完成,微软同时认可
谢谢
解决方案
你的问题是关于 netty websocket 服务器的吗?或者关于语音 SDK 对象?
我对以这种方式使用语音 SDK 的建议是使用推送流而不是拉流。通常,您更容易管理。伪代码:
// FOR SETUP... BEFORE you are accepting audio in your websocket server
// (or on first acceptance of the first packet of audio):
// create push stream
// create audio config from push stream
// create speech config
// create speech recognizer from speech config and audio config
// hook up event handlers for intermediate results (recognizing events)
// hook up event handlers for final results (recognized events)
// start recognition (recognize once or start continuous recognition)
// ON EACH AUDIO packet your websocket server accepts:
// push the audio data into the push stream with
// ON EACH recognizing event, send back the result.text to your client
// ON EACH recognized event, send back the result.text to your client
--抢劫室 [MSFT]
推荐阅读
- javascript - 在个人资料图片 Firebase Web Realtime-Database 下显示名称
- c# - 使用 C# 中的 NAudio 将 M4A 音频文件转换为 MP3 的问题/错误
- git - 从压扁的树枝上分枝
- reactjs - 在本机反应中获取元素
- javascript - 接口上“字符串”类型的索引签名无法识别(打字稿)
- python - TypeError: unhashable type: 'list' in last code line
- python-3.x - 如何在 SELECT 语句中降低 postgresql 数组中的元素以进行不区分大小写的搜索
- python - python中的排序时间
- java - 如何摆脱 GridLayoutManager 项目之间的差距
- excel - 一年中所有月份的通用EOMONTH公式显示日期到季度结束日期?