Use the IVS API to embed timestamped metadata into a stream. Then use timed metadata to trigger actions based on the data.