Tensorflow Nodejs vs Tensorflow Flask - a performance comparison
Tensorflow Nodejs vs Tensorflow Flask - a performance comparison One of those guys who wants to run his own servers , rather than use tfserving etc. Learnings: 1. Performance in web api servers is a double edge sword - software efficiency can burn hardware (CPU and RAM) when there are bursts from clients [Learnt about express rate limit library later, which was added on top of pm2 memory limit] 2. Arm 64 and install issues continues (earlier had isses with chrome, chromedrivers, selenium and now tensorflow) - seriously rethinking should I stick to x86 win wsl for my development laptop also :-)). The cheaper and more available t4g instances are out and aws throws out my spot instances frequently 3. The ability to handle load and backlog (i.e. bursts from clients) has gone up incredibly! I feel close to 2X-4X is the improvement The cost is not very different, as I am forced into a larger machine - Maybe all the effort was worth only to know this.