this is exactly what I did when I wrote my first agent with scraping. later we switched to taking control of the users browser through a browser extension.