How to map timestamp to seconds referring to Issue #3627

[shahzebali42]

How to map timestamp to seconds Issue #3627

How to map timestamps to seconds using the formula :

segment_start + timestep/total_frames * segment_duration:

I am getting correct timestamps but i want to find respecting seconds of the audio.
Can anyone explain this formulae?

What do we have to put in these --> segment_start, segment_duration <-- variables to find respective seconds?

My audio's sample rate=16000 , sample width = 2

[stale]

This issue has been automatically marked as stale. If this issue is still affecting you, please leave any comment (for example, "bump"), and we'll keep it open. We are sorry that we haven't been able to prioritize it yet. If you have any new additional information, please include it with your comment!

[stale]

Closing this issue after a prolonged period of inactivity. If this issue is still present in the latest release, please create a new issue with up-to-date information. Thank you!

[abarcovschi]

@shahzebali42 did you ever figure out where to get the values for segment_start and segment_duration?

[abarcovschi]

I figured out how to map from timesteps to seconds for each non-blank token. The formula I used is the following:

sec_time = frame_num * (audio_len / (num_frames * sample_rate))

where:

• frame_num = the timestep of the symbol, as returned in the 'timesteps' field of Wl2Decoder.decode() outputs.
• audio_len = the number of samples in the loaded audio file corresponding to the transcript (if using batched w2v2 acoustic model inference, will be zero padded to the length of the longest loaded audio file in the batch).
• num_frames = the number of frames in the emission matrix returned by the w2v2 acoustic model inference for that audio file (if using batched inference, the number of frames for each audio file will be the same as in this case all loaded audio files are padded to the length of the longest audio file in the batch).
• sample_rate = sample rate of loaded audio files (usually 16000 Hz).