Cutting-Edge LLMs Now ‘Industry Experts’ in Japan

Stockmark develops AI products that address the unique needs of Japanese businesses like Panasonic and Nippon Steel, helping them improve efficiency and growth. Today in Japan, 65% of white collar work focuses on information gathering and document creation. Generative AI has proven to improve the efficiency, speed and accuracy of these types of business processes globally. However with generic, off the shelf large language models (LLMs), only 0.1% of the training data is in Japanese. This did not meet the needs of Stockmark’s customers who require LLMs with greater insight on the Japanese business context and industry use cases. To overcome this challenge, Stockmark gathered approximately 220 billion tokens from domestic market data and technical management data in Japan. By training their new LLM on this Japanese specific dataset, they have developed an LLM that serves as an ‘expert’ advisor for Japanese businesses and industry use cases. This customized approach enables Stockmark’s clients to enhance productivity and accelerate growth beyond the capabilities of generic AI solutions.