Saying that someone is serving time means that he is in prison. Example: After the gangster had served his time in jail, he got married and found a job.