what's the basis for conversion between hours of neural data to number of tokens... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		g413n 6 days ago \| parent \| context \| favorite \| on: We collected 10k hours of neuro-language data in o... what's the basis for conversion between hours of neural data to number of tokens? is that counting the paired text tokens?

rio-popper 6 days ago [–]

edit: oops sorry misread - the neural data is tokenised by our embedding model. the number of tokens per second of neural data varies and depends on the information content.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact