It’s in focus because only a small angular area from the scene contributes to the light that reaches the sensor. You get blur when sensor elements (individual pixels) receive light from too wide of an area.