automated-tests - Botium 测试用例间歇性和不一致地失败

Question

似乎我通过 Botium 运行的聊天机器人测试用例间歇性且不一致地失败。聊天机器人部分使用 DialogFlow。调度程序询问用户是否想听音乐等。如果正在播放音乐，用户可以要求聊天机器人停止/取消音乐。

我已经尝试增加超时。在我的项目目录的 botium.json 文件中，我添加了功能：“WAITFORBOTTIMEOUT”：50000，

这是我的测试集目录中的前几个文件：Cancel.convo.txt：

Cancel

#me
Cancel_input

#bot
Cancel_output_0

Cancel_input.utterances.txt：

Cancel_input
could you stop
enough music
music off
stop playing the music
can you stop the music
turn off music
enough
can you stop playing music please
stop the music
stop playing
stop
I give up
forget it
not now
stop it
cancel
never mind
go away
be quiet
shut up
i'm busy

Cancel_output_0.utterances.txt：

Cancel_output_0
Cancelled

日志输出：

Botium Test-Suite
    1) Cancel/Cancel_input-L1
    ✓ Cancel/Cancel_input-L10 (441ms)
    2) Cancel/Cancel_input-L11
    ✓ Cancel/Cancel_input-L12 (245ms)
    3) Cancel/Cancel_input-L13
    4) Cancel/Cancel_input-L14
    ✓ Cancel/Cancel_input-L15 (283ms)
    5) Cancel/Cancel_input-L16
    ✓ Cancel/Cancel_input-L17 (286ms)
    ✓ Cancel/Cancel_input-L18 (269ms)
    ✓ Cancel/Cancel_input-L19 (264ms)
    ✓ Cancel/Cancel_input-L2 (264ms)
    ✓ Cancel/Cancel_input-L20 (256ms)
    ✓ Cancel/Cancel_input-L21 (303ms)
    ✓ Cancel/Cancel_input-L3 (301ms)
    6) Cancel/Cancel_input-L4
    ✓ Cancel/Cancel_input-L5 (230ms)
    ✓ Cancel/Cancel_input-L6 (262ms)
    ✓ Cancel/Cancel_input-L7 (284ms)
...

标签： automated-testschatbot