Skip to content
This repository was archived by the owner on Feb 3, 2026. It is now read-only.

Add Speech-to-Speech Translation With Translation Text Display#10

Open
ElishaMisoi wants to merge 3 commits intojfversluis:masterfrom
ElishaMisoi:feature/speech-to-speech-translation
Open

Add Speech-to-Speech Translation With Translation Text Display#10
ElishaMisoi wants to merge 3 commits intojfversluis:masterfrom
ElishaMisoi:feature/speech-to-speech-translation

Conversation

@ElishaMisoi
Copy link
Copy Markdown

@ElishaMisoi ElishaMisoi commented Apr 25, 2020

What does this PR do?

  • Adds Speech-to-Speech Translation and displays translation text in a 'chat-like' ListView

Description of Task(s) to be completed?

  • Given two users communicating in different languages, one user should be able to speak in their native language and the other user should be able to hear the translation in a language they can comprehend.
  • A user should be able to hear the translation in audio format.
  • A user should be able to be displayed with both the original text and the translated text.

How should this be manually tested?

  • Clone this repository on local machine and CD into project folder

$ git clone https://github.com/jfversluis/TravelMonkey.git

$ cd TravelMonkey

  • Check out to the PR's branch

$ git checkout feature/speech-to-speech-translation

  • Pull the branch

  • Install app dependencies by restoring Nuget Packages

  • Add your Azure Region and SpeechAPIKey in APIKeys class

  • Rebuild and Deploy Solution

Screenshot

  • You obviously won't hear the audio 🙃

translationGif

Thoughts On Azure Microsoft.CognitiveServices.Speech and Xamarin.Forms

  • I struggled using Stream... I could not get a good example or workaround for using Stream with Microsoft.CognitiveServices.Speech.
  • The SDK has not been optimized for Xamarin and hence can be painfully slow.
  • This service is pretty cool though 🙃
  • Aand... Xamarin rocks!!! 😎

What went Well

  • I was able to successfully implement speech-to-speech translation

What did not go so well

  • I struggled using stream when sending speech, ended up using .wav files which can be quite slow 😪.
  • My UI... It's not the best out there 😅

@ElishaMisoi ElishaMisoi changed the title Added Speech-to-Speech Translation With Translation Text Display Add Speech-to-Speech Translation With Translation Text Display Apr 26, 2020
@codemillmatt
Copy link
Copy Markdown
Contributor

Thanks for completing the challenge! Fill out this form so we can send you the swag! https://aka.ms/cog-svcs-swag

@ElishaMisoi
Copy link
Copy Markdown
Author

Thanks for completing the challenge! Fill out this form so we can send you the swag! https://aka.ms/cog-svcs-swag

Thank you 🙂

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants