Companies should have a strong understanding of cost, reliability and latency before pushing billions of tokens.