I guess with Lean one does not estimate and one just works on what one has to work on anyways.

Not so with Scrum. You'd better be getting something out of the points you're putting on stories to rationalize using Scrum over Lean. I say this having never working on a Lean team though. Story points are not exactly hour estimates but you are still ballparking something.