Stack Overflow famously ran on a half-rack of servers, duplicated in two locations for redundancy. This stopped when they got acquired by a cloud company - they were moved into the cloud. But it's clearly both possible and not too expensive.

I see prices around me for $500-ish/month for half-rack colo. Of course you have to bring your own servers if using this option.