You can rent a partial rack space from almost any colocation provider, and they come in units all the way from 1U to 42U. When I did my first startup it was done out of two 1U servers that I rented the space for at about $150 a month including power and bandwidth. My partner and I got access badges, walked in and racked and cabled them ourselves.