Make a neural net with number of connections, such that memory storage for the neurons doesn't all fit in the fpga. That way you will have to make some streaming approach, which should make things extra interesting.
Hey, you asked for ideas. Now go implement that and send me a link to the design paper when you're done! XD