MLBench is a benchmark tool for any users, ML developers and device makers. You can run embeded models or you can even load your own model and test on any devices.