Narration Capture Mode

[chirag03k]

Initial PR for Narration Capture Mode

See Issue #40 for more information on the capabilities and limitations of this right now.

Directions for Use
STEP 1: Create storydata.json for a particular story, but leave out segmentation and narration data in the storydata.json file

STEP 2: In the downloads folder of the android device, create a folder with the story title, and in it create another folder with the story title + an underscore + a level number (e.g. if the story was titled, say, "butterflies" and the level was "1", you should have the file structure "Downloads/butterfly/butterflies_1"). Save the storydata.json in the subfolder.

STEP 3: Configure debug.json to look like the following. Replace "storyName_level" with your story name and level identical to the subfolder created earlier.

  { 
    "type": "TRANSITION", 
    "skill": "stories", 
    "tutor_id": "story.echo::storyName_level", 
    "tutor_desc":"story.echo", 
    "tutor_data": "[unpackaged_asset]storyName_level",
    "use_hash_name": "false"
  }

STEP 4: Configure config.json to include the following variable:

  "content_creation_mode": false

STEP 5: Launch RoboTutor.

@JackMostow - So far, everything about this seems to work, aside from recognition issues. I am not sure if this is device specific. Does creating this PR create an apk that you can test? If not, I'll send you one that I generate.

[chirag03k]

Fixed.

[JackMostow]

@chirag03k -

• Merging master into anything surprised me. Was merging master into narrate_mode the way you incorporated the master commits made between your first narrate_mode commit on 8/26/2020 and the most recent master commit on 1/11/2021? Does narrate_mode actually depend on any of those commits? I assume it doesn't depend on any subsequent commits to development, which will get included by merging narrate_mode into development.

• The config.json here works only for English. Instead of specifying a particular config.json, please specify just the particular settings required for narration.

• Why "content_creation_mode": false? Shouldn't it be true for narrate_mode?

• @sansyrox - The apk branch doesn't yet have an apk for narrate_mode. I thought issuing a PR to development generates an apk automatically, but it didn't yet. I gather it requires something more, namely what -- resolving conflicts?

[sansyrox]

@sansyrox - The apk branch doesn't yet have an apk for narrate_mode. I thought issuing a PR to development generates an apk automatically, but it didn't yet. I gather it requires something more, namely what -- resolving conflicts?

@JackMostow , there are many conflicts that need to be resolved. After that the apk generation will be triggered.

[chirag03k]

@JackMostow -

1. Merging master into narrate mode was actually unintended, but it was actually meaningless because master had 0 commits between when I started working in narrate mode and when I merged it, so I didn’t revert the merge.
2. and 3. You are right about both of these. I’ll fix them. Content creation mode being false is a typo.
3. Should I email you my own apk?

[JackMostow]

@chirag03k –

1. I think mailing apks is prohibited. Besides, they’re big. Please put it in GDrive instead.
2. Please try RoboTutor-CMNINIT_WARMUP_FIX-2021-05-25.apk -- do you get the same problem I get but others don't?
3. (Where) have you by any chance found the source code for decoder.getInSpeech called by comp_listener/src/main/java/edu/cmu/xprize/listener/SpeechRecognizer.java l. 686? It's in a Sphinx library used by RoboTutor, not in RoboTutor itself.
4. See you at 4pm ET today unless sooner is good.
   Thanks! – Jack

3f984cd#diff-12643fc3c660cc99685c264511694814e6afa617510fb2b557f2f3892701629e

[chirag03k]

I'll need to fix the gradle issues with compiling the apk and upload to GDrive accordingly.

[JackMostow]

@chirag03k - I think an apk won't get auto-generated until the branch passes automated checks that it currently doesn't.

[chirag03k]

I resolved all the merge conflicts, but it was a little messy because I used vscode and accidentally updated some configuration files. Hopefully an apk can be autogenerated now.

[chirag03k]

I cherry-picked commits from development that weren't merging into narrate_mode becuase they were integral to the functioning of travis. I also resolved the conflicts on github.

[JackMostow]

@chirag03k #48 for narrate_mode still has conflicts in comp_listener/src/main/java/edu/cmu/xprize/listener/SpeechRecognizer.java to resolve. Can you do it?