I ran into the same looping issue with that model. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		JLCarveth 5 months ago \| parent \| context \| favorite \| on: Gemma 3 270M: Compact model for hyper-efficient AI I ran into the same looping issue with that model.

danielhanchen 5 months ago [–]

Definitely give

temperature = 1.0, top_k = 64, top_p = 0.95, min_p = 0.0

a try, and maybe repeat_penalty = 1.1

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact