LED point counter, tree form

I made a plastic shuffle board table few years ago. For my updating, this week been running 12v system LED's in the support structure and I want to add a point counter in a tree form. Yellow (5) on the bottom and blue/red (4 each). Scoring would go like this, yellow in five digit increments, blue/red would light up for 6,11,15,20 and stay lit til the next number 5 digits is reached. Maybe flash when reached at 21. My question is how to make this work, I need an up/down and a reset buttons. I look at the shuffle board counter but this is a little different. Any help would be great, it has been long time since I worked with electronics so be kind.
Here is a picture of the shuffle board and a crude counter I'm looking for.